Sr. Data Engineer, Remote, 10-12 Yrs Exp
Position:-Sr. Data Engineer Responsibilities : Design and implement data pipelines for data ingestion, transformation, and storage using AWS services. Ensure data quality and consistency through validation, monitoring, and automated checks. Optimize Amazon Redshift and Athena queries for performance and efficiency. Build and maintain data infrastructure on AWS, including data lakes (Amazon S3) and data warehouses (Amazon Redshift). Develop and maintain ETL/ELT processes using AWS Glue, Lambda, and Step Functions. Collaborate with Data Scientists and Machine Learning Engineers to understand and fulfill data requirements. Implement data governance, lineage, and security best practices leveraging AWS Lake Formation and IAM. Automate data pipeline deployments using CI/CD tools such as AWS CodePipeline and CodeBuild. Qualifications: Bachelor’s degree in Computer Science, Information Systems, or a related field. Strong experience in data warehousing and ETL/ELT processes. 10+ years of experience in data engineering. Proficiency in SQL and experience with Amazon Redshift and/or Athena. Experience with AWS data services (e.g., S3, Glue, Lambda, Redshift, Kinesis, EMR). Programming skills in Python or other relevant languages. Knowledge of data modeling and database design. Experience with data pipeline orchestration tools (e.g., AWS Step Functions, Airflow on AWS). Strong problem-solving and troubleshooting skills. Familiarity with LLMs and their application in improving data quality or automating data engineering processes. Job Type: Full-time Pay: ₹2,000,395.35 - ₹3,540,348.25 per year Experience:
- Data Engineering: 10 years (Required)
- ETL: 10 years (Required)
- Athena: 10 years (Required)
Work Location: Remote Apply Job!