Azure Data Engineer
Job title: Azure Data Engineer in Herndon, VA at Softthink Solutions Inc
Company: Softthink Solutions Inc
Job description: About the Role:We seek a skilled Data Engineer to support multiple International organization projects. The consultant will work with a multidisciplinary team, delivering data solutions using cutting-edge technologies in a highly collaborative environment.Key Responsibilities:
- Design and implement data solutions using Microsoft Azure (preferred), AWS, or Google Cloud.
- Develop and optimize ETL/ELT processes using Azure Data Factory, Databricks, PySpark, SQL Server, and SSIS.
- Manage and optimize Data Lakes/Delta Lakes and complex data transformations.
- Build and maintain CI/CD pipelines using Azure DevOps.
- Migrate legacy data systems to modern platforms.
- 5+ years as a Data Engineer.
- Expertise in Microsoft Azure Data Services (Data Factory, Logic Apps, Azure Functions, Databricks, Synapse, DevOps).
- Strong SQL (T-SQL, Spark SQL) and Python/PySpark experience.
- Proven experience with Data Lakes, Delta Lakes, and ETL pipelines.
- Experience with CI/CD, PowerShell, and Bash scripting.
- Strong communication, collaboration, and problem-solving skills.
- AI/ML and Business Intelligence (BI) knowledge is a plus.
- Experience in Agile methodologies (SCRUM, PMP, PRINCE2).
- Certifications: Azure Data Engineer Associate, DP-500, or related.