-
Experience in data acquisition, data set process, improving data reliability, quality and efficiency
-
Experience developing in Python using Spark and other data tools
-
Familiar with AWS technologies like Glue, S3 and RedShift
-
Experience with large data sets to address business issues
-
Experience with modern software delivery practices, including source control, testing, continuous delivery
-
Experience delivering product with Agile methodologies
-
Design and Implementation: Lead the design, construction, and optimization of systems for data collection, data transformation.
-
Data Pipeline Management: Create and maintain data pipelines used by both data scientists and business analysts.
-
Collaboration and Interpretation: Work closely with our internal and external SME to troubleshoot issues, as well as with our data scientists and analysts to efficiently utilize our curated data, and translate complex datasets into actionable insights.
-
Data Visualization infrastructure: Assist with the development and maintenance of our reporting infrastructure (in terms of data pipelines that feed our dashboards, reports, and custom visualizations, etc).
-
Continuous Improvement: Proactively identify and implement enhancements in data processing efficiency, integrity, and quality with a sharp eye towards elevating the standards of our data handling practices.
-
Qlik replicate is nice to have