Lead Data Transformation Engineer - Google Cloud Platform (Remote or Hybrid)
Job Overview:
We are seeking a highly skilled Lead Data Transformation Engineer to join our team, driving the transformation of our client's legacy system to a cutting-edge Google Cloud Platform. As a seasoned data engineering expert, you will play a key role in rearchitecting, transforming, and redesigning data pipelines, collaborating with software engineers to deliver innovative solutions.
Key Responsibilities:
- Design and implement large-scale data pipelines using Google Cloud Platform, Dataproc, Spark, and PySpark
- Collaborate with architects to develop architecture solutions using Composer and Spark
- Lead the migration of legacy systems to Google Cloud Platform, ensuring seamless integration and optimal performance
- Develop and maintain CI/CD pipelines, ensuring efficient and reliable data processing
- Work closely with cross-functional teams to identify and solve complex data engineering problems
Requirements:
- 10+ years of experience in data engineering, with a strong focus on data architecture and pipeline redesign
- 3+ years of experience with Google Cloud Platform, including migration expertise and experience with Dataproc and Spark
- 3+ years of experience with Apache Airflow and/or Composer
- 5+ years of experience with CI/CD pipelines
- Strong proficiency in at least one OOP language, with Java preferred
- Experience with databases, SQL, and large-scale batch processing using cloud services
- Excellent collaboration and problem-solving skills, with the ability to work effectively with architects and engineers
What We Offer:
- Competitive salary and benefits package
- Remote or hybrid work arrangement, with the option to work from our Phoenix, AZ office
- Opportunity to work with a leading client, driving innovation and transformation in their industry
- Collaborative and dynamic work environment, with a team of experienced professionals
How to Apply:
If you are a motivated and experienced data engineering professional, looking to take your career to the next level, please apply now. We look forward to hearing from you!
Apply To This Job
Apply for this job