Job Search
Wir können Ihnen helfen, eine außergewöhnliche Karriere aufzubauen
Sr Data Engineer IRC243712
| Job: | IRC243712 |
| Location: | Colombia - Bogota, Medellin |
| Designation: | Senior Software Engineer |
| Experience: | 5-10 years |
| Function: | Engineering |
| Skills: | AWS, Containers, ETL, Informatica, Python, SQL |
| Work Model: | Remote |
Description:
We are looking for a Senior Data Engineer to join our team!
Our client is a growing startup focused to unleash the power of augmented intelligence to optimize claim outcomes.
The selected person will work together with the client on a backlog of tasks, which include the following highlights:
– Design and develop ETL pipelines to extract data from various sources, transform it, and load it into data warehouses.
– Optimize data processing workflows for scalability and performance, ensuring efficient data movement and transformation.
– Collaborate with data analysts and data scientists to understand data needs and ensure data quality, consistency, and accessibility.
– Maintain and monitor data pipelines, ensuring that they run smoothly, addressing any errors or failures that occur.
Requirements:
- 5+ years of hands-on experience working on Informatica as an ETL tool.
- 5+ years of experience working in the AWS ecosystem.
- 3+ hands-on experience developing ETL solutions using RDS and warehouse solutions using AWS services- S3, IAM, Lambda, RDS, Redshift,
- High degree of proficiency in at least one programming language required (Proficiency with Python preferred).
- High proficiency in SQL programming with relational databases. Experience writing complex SQL queries is a must.
- Experience working with distributed computing tools (Spark, Hive, etc.)
- Experience with data pipeline (using Hive, Spark, Spark SQL etc. is preferred), DAG orchestration and workflow management tools: Airflow, AWS step functions etc.
- Experience with Software engineering best-practices, including but not limited to version control (Git, TFS, Subversion, etc.), CI/CD (Jenkins, Maven, Gradle, etc.), automated unit testing, Dev Ops.
- Experience with containers (Docker, Kubernetes) is a plus.
- Experience in a fast-paced agile development environment.
Nice to Have
- AWS certifications (AWS Certified Solutions Architect, Developer, or DevOps).
- Knowledge of commercial claims management systems.
Job Responsibilities:
● Design, develop, maintain, and enhance highly scalable data engineering solutions using Informatica ICDM platform(Data Integration, Monitoring, Administration services).
● Design, build, document, and implement scalable pipelines with a clear focus on data quality and reliability leveraging informatica data profiling and governing services.
● Ingest and transform structured, semi-structured and unstructured data from multiple sources. Build an enterprise level ETL/ELT solution.
● Innovate and build proprietary algorithms to tackle complex problems involving interesting data challenges.
● Execute and continually optimize new customer data ingestion and model implementation processes.
● Integrating business knowledge with technical functionalities.
● Often work collaboratively with application engineers, data scientists, product managers, and product delivery teams.
● Develop solutions at the intersection of data and ML.
● Ability to contribute in an agile, collaborative and fast paced environment.
● Monitor workflow performance, reliability, and ensure SLA targets are met.
● Automate existing code and processes using scripting, CI/CD, infrastructure-as-code and configuration management tools.
● An excellent troubleshooter, and problem solver, who likes to think outside of the box to solve common problems.
● Ability to mentor for more junior staff members.
● AI is at the heart of everything we do, and if you desire to be closer to the AI scene, we have opportunities to work on problems like NLP, image analysis and featurization, and OCR labeling.
Was wir anbieten
Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to work on market-defining products using the latest technologies.
Collaborative Environment:Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
Work-Life Balance:GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules.We offer you the best quality of work life so that you exceed the expectations of our clients, while achieving your professional and personal ambitions.
Professional Development:Our dedicated Learning & Development team regularly organizes English classes, professional certifications, and technical and soft skill trainings. We also offer the chance to travel internationally
Excellent Benefits:We provide our employees with competitive salaries, family medical insurance, extended paternity leave, annual performance bonuses, and referral bonuses.