Job Search
Podemos ayudarlo a desarrollar una carrera excepcional.
Senior Data Engineer IRC234271
| Job: | IRC234271 |
| Location: | Ukraine - Kyiv |
| Designation: | Senior Software Engineer |
| Experience: | 5-10 years |
| Function: | Engineering |
| Skills: | Azure, azure data factory, Azure Data Lake Store, Databricks, ETL, Nosql DB, Pipeline Execution/ETL, Python, Scala, SQL |
| Work Model: | Remote |
Description:
Digital transformation project for aftermarket support for Hitachi Global Air Power
Requirements:
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering or related field
- 5+ years of overall work experience working on Data first systems
- 2+ years of experience on Data Lake/Data Platform projects on Azure
- Strong knowledge of SQL for handling relational databases and familiarity with NoSQL databases to manage structured and unstructured data effectively.
- Understanding of data warehousing concepts, including data storage, data marts, and ETL processes.
- Skilled in using Microsoft Azure services such as Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, and Azure Databricks. These tools are essential for data ingestion, storage, processing, and analytics.
- Knowledge of cloud storage solutions provided by Azure, such as Blob Storage and Table Storage, which are integral for data lakes.
- Familiarity with ETL tools and frameworks for data extraction, transformation, and loading. Skills in Azure Data Factory or similar tools are particularly valuable.
- Ability to perform data cleaning, transformation, and enrichment to ensure data quality and usability.
- Proficient in programming languages such as Python or Scala, which are widely used in data engineering for scripting and automation.
- Skills in scripting to automate routine data operations and processes, improving efficiency and reducing manual errors.
- Understanding of how to develop and maintain APIs, particularly JDBC/ODBC APIs for data querying. Knowledge of RESTful API principles is also beneficial.
- Awareness of data security best practices, including data encryption, secure data transfer, and access control within Azure.
Understanding of compliance requirements relevant to data security and privacy, such as GDPR. - Experience with data testing frameworks to ensure the integrity and accuracy of data through unit tests and integration tests.
- Proficiency with version control tools like Git to manage changes in data scripts and data models.
- Familiarity with DevOps practices related to data operations, including continuous integration and continuous deployment (CI/CD).
- Basic skills in data analysis to derive insights and identify data trends, which can help in troubleshooting and improving data processes.
Job Responsibilities:
Responsibilities
Data Ingestion & Integration:
- Assist in the development and maintenance of data ingestion pipelines that collect data from various business systems, ensuring data is integrated smoothly and efficiently into the data lake.
- Implement transformations and cleansing processes under the guidance of senior engineers to prepare data for storage, ensuring it meets quality standards.
Data Management:
- Help manage the organization of data within the data lake, applying techniques for efficient data storage and retrieval.
- Assist in managing and configuring data schemas based on requirements gathered by senior team members, ensuring consistency and accessibility of data.
- Support the maintenance of the data catalog, ensuring metadata is accurate and up-to-date, which facilitates easy data discovery and governance.
API Support & Data Access:
- Support the development and maintenance of JDBC/ODBC-based SQL query APIs, ensuring they function correctly to allow end-users to access and query the data lake effectively.
- Assist in optimizing and supporting simple analytical queries, ensuring they run efficiently and meet user and business requirements.
Quality Assurance & Testing:
- Conduct routine data quality checks as part of the data ingestion and transformation processes to ensure the integrity and accuracy of data in the data lake.
- Participate in testing of the data ingestion and API interfaces, identifying bugs and issues for resolution to ensure robustness of the data platform.
Collaboration and Teamwork:
- Work closely with the Principal Data Architect and Principal Data Engineer, assisting in various tasks and learning advanced skills and techniques in data management and engineering.
- Occasionally interact with other business stakeholders to understand data needs and requirements, facilitating better support and modifications in data processes.
Platform Monitoring & Maintenance:
- Help monitor the performance of data processes and the data lake infrastructure, assisting in troubleshooting and resolving issues that may arise.
Learning & Development:
- Continuously learn and upgrade skills in data engineering tools and practices, especially those related to Azure cloud services and big data technologies.
- Contribute ideas for process improvements and innovations based on day-to-day work experiences and challenges encountered.
We Offer
Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people’s lives.
Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.
DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.
Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.
Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.
Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.