Senior Data Engineer
We are looking for Senior Data Engineers to build data pipelines for the Data Center business group's Data Science team at the largest social media organization using its next generation data tools. As a member of a centralized Data Science/Data Engineering team you will contribute to a variety of projects and technologies, depending on partner needs.
Responsibilities
Partner with leadership, engineers, program managers and data scientists to understand data needs.
Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.
Build data expertise and own data quality for your areas.
Qualifications
5+ years Data Engineering experience
Expert in SQL with good understanding of how relational databases work
Good Python Programming experience
Experience with Data Warehousing Architecture
Experience with workflow management engines like Airflow, Dataswarm, Luigi etc.
5+ years experience in custom ETL design, implementation and maintenance
Experience with data quality and validation.
Experience with SQL performance tuning and e2e process optimization.
Experience querying massive datasets using Presto, Hive etc.