Technical Lead - Data Engineering Contract / FTE Philadelphia, PA - Remote
Primary Skill :
- Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark
- Build Data Transformation in ADB
- Convert Scala Programs to PySpark Programs
- Understand the SCALA program in DataBricks
-
ADF
Secondary Skills:
- Azure data lake gen 2
- Synapse analytics (dedicated SQL pool)
- Exp in delta Lake
- Pyspark
Nice to Have: Tidal Scheduler , Exp in Healthcare Domain