Job Search
We can help you build an exceptional career
Senior Data Engineer IRC247384
| Job: | IRC247384 |
| Location: | Ukraine |
| Designation: | Senior Software Engineer |
| Experience: | 5-10 years |
| Function: | Engineering |
| Skills: | data engineer & data analyst |
| Work Model: | Remote |
Description:
The Generative AI Platform project leverages cutting-edge AI and ML technologies to develop and deploy cloud-agnostic Gen AI applications on demand and enable users to create custom solutions for Sales, Marketing, Software Engineering, and Customer Service use cases. Fully managed RAG workflow including ingestion, retrieval, and augmentation of data, securely connected to many types of information consolidated and aggregated from multiple sources. The Platform’s ultimate goal is to deliver the user-friendly LLM as a Service Model (LLMaaS) trained on internal company resources, which contributes to the adoption of AI among multiple consumers across the business.
#LI-YV1
Requirements:
- Data lakehouse experience & associated table formats to integrate heterogeneous data types flexibly
- Experience with cloud services (especially Azure) and ideally, on-prem as well
- Experience with ETL processes and data pipeline development & management of complex data workflows
- Experience with integrating data from various sources (e.g., APIs, flat files, databases) and within a complex microservices architecture.
- Understanding of data security best practices and compliance requirements
- Familiarity with data governance frameworks and tools
- Proficiency in implementing techniques for ensuring data quality and integrity, e.g., data validation & testing.
- Experience reconciling datasets at different temporal and spatial granularities, and leading and lagging datasets/metrics
- Knowledge of CI/CD pipelines and practices as they relate to data engineering
- Experience supporting data scientists and ML engineers with data pipelines and infrastructure
- Experience with Airflow for orchestration would be a big plus
- Experience with FOCUS datasets and Kubecost would be a big plus
- Experience with observability data and user tracking would also be a big plus
Job Responsibilities:
- Create data model creation for reconciling infrastructure cost datasets
- Design APIs and data pipelines
- Help to implement a Data Lakehouse
- Support with artifact generation, storage and transformation as part of a pipeline for a data science/simulation workload
- Conduct research and make recommendations on data products, services, protocols and standards in support of the wider team’s development efforts
- Install and configure data pipeline components and ensure access, consistency and integrity
What We Offer
Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people’s lives.
Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.
DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.
Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.
Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.
Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.