Job Search
Wir können Ihnen helfen, eine außergewöhnliche Karriere aufzubauen
Pyspark Engineer IRC253379
| Job: | IRC253379 |
| Location: | United States - San Jose CA |
| Designation: | Senior Software Engineer |
| Experience: | 5-10 years |
| Function: | Engineering |
| Skills: | Apache Spark / PySpark, S3, Sparksql Development |
| Work Model: | Remote |
Description:
Retail giant in North America
Requirements:
Technical Skills:
- Expertise in PySpark, Spark SQL, DataFrames, and UDF.
- Strong proficiency in Python with experience in data structures, algorithms, and OOP.
- Experience with large-scale distributed data processing and parallel computing.
- Working knowledge of Apache Kafka for real-time streaming applications.
- Strong familiarity with cloud-based S3 or MinIo bucket
- Knowledge of SQL for querying large data sets and working with relational databases.
- Knowledge of database queries optimization
- Strong experience on processing large pyspark dataset on executors node and parallelism operations between executors and driver node
- Collaborate with cross-functional team to develop the application that meets the business requirements and quality software
Tools & Frameworks:
- Proficiency in data processing frameworks like Hadoop.
- Familiarity with data orchestration tools such as Apache Airflow and Spark Compute platform.
- Good experience on development IDE Pycharm
Job Responsibilities:
- Collaborate with cross-functional team to develop the application that meets the business requirements and quality software
- EST Timezone (preferably Charlotte)
Was wir anbieten
Exciting Projects:Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to work on market-defining products using the latest technologies.
Collaborative Environment: You can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
Work-Life Balance:GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules and opportunities to work from home.
Professional Development:We provide continuing education classes, professional certification and training (technical, soft skills, language, and communication skills) to help you realize your professional goals. Being part of a global organization, there are additional learning opportunities through international knowledge exchanges.
Excellent Benefits:We provide our employees with competitive salaries, health and life insurance, short-term and long-term disability insurance, a matched contribution 401K plan, flexible spending accounts, and PTO and holidays