Position: AWS - Databricks Architect
Location:- San Diego, CA (Onsite 3 days)
Job Title: AWS Databricks Architect (12 +Yrs of Experience)
Lead and manage a team of engineers and Sr engineers by providing guidance, mentorship, and fostering a collaborative work environment.
Establish and maintain positive relationships with client stack holders
Consult with client on project status, proposals, and technical issues and provide post-implementation support to them
Facilitates communication and collaboration between onshore and offshore teams, and ensure the successful design, development and execution of the product\project\deliverables on time
Experience in POC development, Capacity sizing, Tool Evaluation
MUST Have:
Possess excellent written and verbal communication skills.
Ability to run ETL jobs in Databricks
Unity catalog with delta, MongoDB, regular s3 based parquet files
Delta format based S3
Ability to articulate pros and cons of delta format
Ability to run Databricks with AWS glue catalog
Monitoring of Databricks jobs
Operations related experience of Databricks jobs
Best practices of setting up nested ETL jobs
Scheduling of jobs in Databricks
Passing runtime parameters to ETL jobs
Handling experience in AWS in data engineering project
Ability to coordinate/work with team in India
Good to Have:
Experience in client facing role