We are seeking an experienced Python and pySpark Developer to join our Data Science team. In this role, you will play a key part in developing and deploying high-quality data analysis projects and web applications, ensuring their efficiency, scalability, and performance.
Key Responsibilities
- Develop and maintain a Python library of common functions to support web app development and streamline pySpark and SQL queries.
- Define, implement, and manage the deployment process for the team’s applications in a production environment.
- Propose and develop optimal application architectures, and create proof-of-concept implementations.
- Provide first-line support for troubleshooting applications in production.
- Optimize performance of Spark jobs and SQL transformations to enhance efficiency and scalability.
- Work independently while collaborating with a small team, effectively sharing results and progress.
Equal Opportunity Employer
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.