Our Esteemed Client is looking for experienced Data Engineers with strong skills in ETL Testing, Cloud Migration, and Python programming in an AWS environment. As part of our team, you’ll design and maintain data pipelines, perform ETL testing, and contribute to large-scale cloud migration projects. We seek candidates who are passionate about leveraging Python for custom data solutions and automation, with a desire to make a tangible impact on our data infrastructure.
Must-Have Skills:
- Extensive experience with Python and AWS
- Strong background in automating ETL processes and managing AWS infrastructure with Python.
- Proficient with AWS services: S3, Athena, EMR, Glue, Redshift, Kinesis, and SageMaker.
- SQL and Unix/Linux scripting expertise.
- Experience with Cloud/On-Prem ETL tools (Ab Initio, AWS Glue, Informatica, Alteryx).
- Experience in data migration from on-prem to cloud.
- Solid experience in DevOps/DataOps
- Data Science platform experience (SageMaker, H2O, etc.) is a plus.
Key Responsibilities:
- Collaborate with teams to deliver data applications.
- Automate ETL pipelines and manage data workflows using Python and AWS.
- Build reports, dashboards, and automation frameworks.
- Analyze data sources and validate data movement across systems.
- Troubleshoot and resolve data issues efficiently.
Nice-to-Have Skills:
- Familiarity with Jenkins, GitLab, Waterfall, and Agile.
- Experience with S3, HDFS, and test case management tools.
Soft Skills:
- Excellent communication and problem-solving skills.
- Self-driven with the ability to lead and guide teams.