Job Title: Data Integration Engineer
Job Description :
About Veda Infotech Services, LLC:
Veda Infotech Services, LLC is a dynamic software consulting firm with over 10 years of experience in delivering innovative and customized IT solutions. We serve clients across various industries, providing services such as software modernization, business intelligence, cloud computing, cybersecurity, and AI engineering. Our goal is to support digital transformation and optimize business operations through strategic IT consulting and cutting-edge technology. We value our professionals and offer comprehensive benefits, along with opportunities for growth, to work with our federal clients. This is a full-time position or W2 contract. U.S. Citizens and Green Card holders are highly encouraged to apply.
Location: Washington DC Job Type: Full-time/Contract Hourly Rate: $50 - $75 per hour
Overview: The Data Integration Specialist is responsible for managing and optimizing the data integration processes using various tools like ETL tools (Informatica, SQL Server) and Relational Databases (RDBMS). This role involves overseeing data extraction, transformation, and loading (ETL), working with large datasets, and ensuring the seamless integration of various data sources into a unified data warehouse or system.
Key Responsibilities:
- Design, develop, and implement robust ETL processes for data extraction, transformation, and loading across multiple systems and platforms.
- Ensure data quality and consistency while transforming raw data into structured formats suitable for analytical and operational use.
- Work with Informatica Cloud Data Integration, handling data migration and integration across cloud-based and on-premise systems.
- Leverage tools such as AWS Glue or Azure Data Factory for building scalable cloud data pipelines and automation workflows.
- Utilize SQL Server Integration Services (SSIS) for data transformation and integration tasks, working with on-premises data sources and relational databases.
- Write and optimize SQL queries for efficient data extraction, manipulation, and loading.
- Ensure seamless data integration with data warehouses and data lakes for efficient querying and reporting.
- Implement best practices for managing metadata, schema designs, and data pipelines.
- Work with data scientists, business analysts, and engineers to troubleshoot integration issues and optimize data workflows.
- Participate in code reviews, testing, and debugging for ETL jobs.
Key Skills & Technologies:
- Informatica Cloud Data Integration: Experience with cloud-based data integration solutions, data transformation, and migration.
- AWS Glue or Azure Data Factory: Knowledge of cloud ETL processes for modern data pipelines.
- SQL Server Integration Services (SSIS): Expertise in creating and managing ETL processes using SSIS for on-premise data.
- Talend, Apache NiFi: Knowledge of open-source tools for data integration.
- Relational Database Management Systems (RDBMS) like SQL Server, Oracle, PostgreSQL, and MySQL for managing structured data.
- Experience in optimizing database queries, schema design, and relational data integration.
- Familiarity with data cleansing, data validation, and quality frameworks to ensure that all integrated data is accurate and usable.
- Experience with Python and SQL for scripting data transformations and automation.
- Knowledge of shell scripting, PowerShell, and Bash for managing ETL workflows in cloud or hybrid environments.
- Understanding of building and maintaining data warehouses using platforms such as Amazon Redshift, Google BigQuery, or Microsoft SQL Server.
- Familiarity with data lake structures and techniques for managing large-scale, unstructured data.
Desired Certifications:
- Microsoft Certified: Azure Data Engineer Associate
- Informatica Cloud Data Integration Certification
- AWS Certified Data Analytics - Specialty
- Google Cloud Professional Data Engineer
Years of Experience:
- Minimum Experience: 7+ years in data integration, ETL processes, and relational database management.
Hourly Rate:
- The typical hourly rate for a Data Integration Specialist ranges from $60 to $80 per hour, depending on the expertise, certifications, and years of experience.