Job Description :
Role: Data Engineer - 3 positions
REMOTE

The three roles are:

  1. Data Engineer with Scrum experience (preferably with a CSM or PSM)
  2. Data Engineer with Hudi Experience (CDC, etc)
  3. Data Engineer with strong IaC experience (Cloud Formation)

All three data engineers will need experience in:

Skillset

  1. AWS Basics IAM role and policy, VPC, Route53, CloudWatch, API Gateway, Streaming, Storage, Tagging
  2. Cloudformation hands-on delivery experience
  3. Cloudformation tools (SAM, Serverless, Stacker, Terraform)
  4. DevOps (Jenkins/GitLab/Code Pipeline/Monitoring & Metrics)
  5. AWS Cloud Stack:
    • Glue Suite
      • Catalog
      • Crawler
      • ETL
      • Glue Registry
    • LakeFormation
    • S3
    • Lambda
    • StepFunction

Experience

  • 3-5 years cloud development ( AWS / Azure )
  • 1-2 years in Data Lake / Data Pipeline / Lake House
  • 10+ years Object Oriented Language - Python, Groovy, Java
  • Quality Assurance / Testing concepts
  • Cloud based development life cycle. Solution includes infrastructure, cost conscientious.
  • Code Quality tool Prisma, SonarQube, OWASP Security Scanning, VeraCode
  • Data Governance Life Cycle, Access Model, Security, Privacy
  • Bachelor's degree in Computer Science or related field or equivalent combination of industry-related professional experience and education.
             

Similar Jobs you may be interested in ..