Lead Data Engineer IRC246305

Description

Our customer is a fully integrated, global provider of rail solutions across rolling stock, signalling, operation, service & maintenance, digital technology and turnkey solutions. With a presence in 38 countries across six continents and over 12,000 employees, our mission is to contribute to society through the continuous development of superior rail transport solutions. We are proud of our global achievements, from our world famous ‘bullet trains’, to our signalling solutions and turnkey projects, state of the-art traffic management and digital solutions. Drawing on the wider Hitachi Group’s market-leading technology and research-and-development capabilities, we strive for industry leading innovations and solutions that can deliver value for customers and sustainable railway systems that benefit wider society.

Requirements

Must-Haves:

• 7+ years of experience in SQL and Python programming languages, specifically for data engineering tasks.
• Proficiency in working with cloud technologies such as Azure or AWS.
• Experience with Azure Data Factory or similar data integration tools for orchestrating and automating data pipelines.
• Experience working with large data environments, including data processing, data integration, and data warehousing.
• Ability to build and maintain APIs for data integration and consumption.
• Experience with data quality assessment and improvement techniques, including data profiling, data cleansing, and data validation.
• Familiarity with data lakes and their associated technologies, such as Azure Data Lake Storage, AWS S3, or Delta Lake, for scalable and cost effective data storage and management.
• Experience with NoSQL databases, such as MongoDB or Cosmos, for handling unstructured and semi-structured data.

Nice to Have:

• Experience with PowerBI, and ability to create reports using this tool
• Familiarity with Agile and Scrum methodologies, including working with Azure DevOps and Jira for project management.
• Knowledge of DevOps methodologies and practices, including continuous integration and continuous deployment (CI/CD).
• Experience with data backends for software platforms, including database design, optimization, and performance tuning.

Job responsibilities

• Responsible for the building, deployment, and maintenance of mission-critical analytics solutions that process data quickly at big-data scales
• Responsible for the design and implementation of data integration pipelines
• Contributes design, code, configurations, and documentation for components that manage data ingestion, real-time streaming, batch processing, data extraction, transformation, and loading across multiple data storages
• Take part in full cycle of feature development (requirements analysis, decomposition, design, etc)
• Design, develop, and implement different web and back-end solutions with other talented engineers in a collaborative team environment.
• Contribute to the overall quality of development services through brainstorming, unit testing, and proactive offering of different improvements and innovations.

#LI-TR2 #LI-Remote

What we offer

Culture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders. 

Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.

Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.

Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.