Job Description
Job Overview:
We are seeking a highly skilled Lead Data Transformation Engineer to join our team, driving the transformation of our client's legacy system to a cutting-edge Google Cloud Platform. As a seasoned data engineering expert, you will play a key role in rearchitecting, transforming, and redesigning data pipelines, collaborating with software engineers to deliver innovative solutions.
Key Responsibilities:
- Design and implement large-scale data pipelines using Google Cloud Platform, Dataproc, Spark, and PySpark
- Collaborate with architects to develop architecture solutions using Composer and Spark
- Lead the migration of legacy systems to Google Cloud Platform, ensuring seamless integration and optimal performance
- Develop and maintain CI/CD pipelines, ensuring efficient and reliable data processing
- Work closely with cross-functional teams to identify and solve complex data engineering problems
Requirements:
- 10+ years of experience in data engineering, with a strong focus on data architecture and pipeline redesign
- 3+ years of experience with Google Cloud Platform, including migration expertise and experience with Dataproc and Spark
- 3+ years of experience with Apache Airflow and/or Composer
- 5+ years of experience with CI/CD pipelines
- Strong proficiency in at least one OOP language, with Java preferred
- Experience with databases, SQL, and large-scale batch processing using cloud services
- Excellent collaboration and problem-solving skills, with the ability to work effectively with architects and engineers
What We Offer:
- Competitive salary and benefits package
- Remote or hybrid work arrangement, with the option to work from our Phoenix, AZ office
- Opportunity to work with a leading client, driving innovation and transformation in their industry
- Collaborative and dynamic work environment, with a team of experienced professionals
How to Apply:
If you are a motivated and experienced data engineering professional, looking to take your career to the next level, please apply now. We look forward to hearing from you!
Apply Now
Apply Now