Job Search
Data Engineer IRC220609
| Job: | IRC220609 |
| Location: | India - Noida, Pune |
| Designation: | Associate Consultant |
| Experience: | 5-10 years |
| Function: | Engineering |
| Skills: | Azure, azure data factory, Databricks, Python, Spark |
| Work Model: | Hybrid |
Description:
Join GlobalLogic, to be a valid part of the team working on a huge software project for the world-class company providing M2M / IoT 4G/5G modules e.g. to the automotive, healthcare and logistics industries. Through our engagement, we contribute to our customer in developing the end-user modules’ firmware, implementing new features, maintaining compatibility with the newest telecommunication and industry standards, as well as performing analysis and estimations of the customer requirements.
Requirements:
• Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field; or equivalent experience.
• 5 to 8 years of experience in data engineering, with specific expertise in big data platforms and technologies.
• Proficiency in Scala and Python programming languages.
• Extensive experience with Azure Cloud services, Azure Databricks, and Delta.
• Knowledge of Spark and Apache open-source technologies like Confluent Kafka and SOLR.
• Familiarity with Atlassian Bitbucket, MongoDB, and Docker Desktop.
• Capable of working in a high-performance, agile scrum environment, actively contributing to various projects and participating in development sprints.
• Strong ability to collaborate across departments and communicate technical concepts effectively.
• Possess excellent communication skills in English, essential for discussing technical requirements, presenting design and feature demos in sprints, and effectively conveying developed solutions to stakeholders during scrum activities.
• Experienced with version control systems, such as Azure DevOps.
• Able to establish and manage system performance metrics, focusing on rapid issue detection and effective problem resolution.
Job Responsibilities:
• Maintain the Measurement reporting system within big data platform, focusing on process monitoring, troubleshooting, and data readiness for regular reporting and optimization.
• Collaborate with Measurement software engineers to design and develop enhancements to the overall Measurement product.
• Collaborate with Advanced Analytics, Field Analytics, Solutions, and Ad-Ops teams to resolve any data inconsistencies or campaign setup issues impacting the weekly Measurement reporting process.
• Routinely monitor job statuses and identify operational failures, demonstrating a detail-oriented approach to ensure smooth running of existing software systems, while efficiently troubleshooting and debugging as needed.
• Monitor and react to the weekly Measurement refresh, identifying and diagnosing any failures or discrepancies.
• Create and maintain Scala based Databricks jobs on Microsoft Azure ADF
• Support data Input/Output from python code notebooks running the core measurement metrics.
• Using Databricks and Delta tables, optimize performance of new and existing jobs to reduce operational costs.
• Troubleshoot and debug process failures using knowledge of application areas and code flows.
• Execute adhoc queries against Parquet and Delta tables and generate reports from those queries.
• Create and maintain API based integrations to Salesforce and internal systems.
• Have a working knowledge of DSP Ad platform partners, such as Beeswax and Cadent.
• Follow Lead data engineer instructions for software functionality upgrades, enhancing system performance and capabilities.
• Collaborate effectively across multiple departments, including operations and product management, to gather requirements, troubleshoot issues, and design enhancements within an Agile Scrum framework.
• Provide technical leadership and mentorship to data engineers, guiding them in designing and implementing software solutions, ensuring adherence to best practices, and fostering their professional growth and development in data engineering within an agile framework.
What We Offer
Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.
Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.
Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.
Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.
Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!