Job Title: Data Engineer
Location:Bloomfield, Connecticut, United States
Duration: Long Term
About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our innovative team members have been solving the most complex business, and IT challenges of our global clients.
Job Description:
FUTURE DUTIES AND RESPONSIBILITIES
" Data or Software Engineer developing
" delivering solid, scalable and innovative solutions
" understanding data infrastructure and related technologies
" data modelling, data warehousing and building end to end ETL pipelines
REQUIRED QUALIFICATIONS TO BE SUCCESSFUL IN THIS ROLE
" 8+ years of experience as a Data or Software Engineer developing production code
" Proven track record of delivering solid, scalable and innovative solutions
" A strong understanding of data infrastructure and related technologies
" Experience with data modelling, data warehousing and builiding end to end ETL pipelines
" Proficiency in Spark, Spark Scala SQL, SCALA programming.
" Proficiency in AWS Basics, AWS Open search, GIT Lab, IDE (IntelliJ, VSCode
" Deep understanding and experience with Apache Spark and related (DataFrame/Dataset) API's
" Working knowledge of different data storage formats (parquet, avro, json)
" Experience with the Databricks platform
" Advanced experience in one or more scripting languages (shell, YAML, etc)
" CI/CD experience with Terraform, GitLab CI, Docker
" Experience with search technologies (Lucene, Solr / Elasticsearch)
" Experience with AWS cloud technologies (S3, DynamoDB, RDS, Lambda)
" Streaming and event based system design
Employment Practices:
EEO, ADA, FMLA Compliant
VLink is an equal opportunity employer. At VLink, we are committed to embracing diversity, multiculturalism, and inclusion. VLink does not discriminate on the basis of race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. All aspects of employment including the decision to hire, promote, or discharge, will be decided on the basis of qualifications, merit, performance, and business needs.