Job Title: Senior GCP Data Engineer / Lead Data Engineer
Experience: 15+ Years
Location: Dallas Texas
Employment Type: Contract
Job Summary:
We are looking for an experienced GCP Data Engineer with 15+ years of overall IT experience and strong expertise in designing, building, and managing scalable data pipelines and cloud-based data platforms on Google Cloud Platform (GCP). The ideal candidate should have deep experience in data engineering, ETL/ELT development, big data technologies, cloud migration, and data warehousing solutions.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using GCP services.
- Build and optimize ETL/ELT workflows for large-scale structured and unstructured data.
- Develop and manage data solutions using BigQuery, Cloud Dataflow, Dataproc, Cloud Composer, Pub/Sub, and Cloud Storage.
- Implement batch and real-time data processing solutions.
- Work on cloud data migration projects from on-premise or other cloud platforms to GCP.
- Design and maintain data lake and data warehouse architectures.
- Ensure data quality, governance, security, and compliance standards.
- Collaborate with business analysts, data scientists, and application teams to deliver data solutions.
- Optimize performance, cost, and scalability of GCP resources.
- Mentor junior engineers and provide technical leadership.
Required Skills:
- 15+ years of experience in Data Engineering / Big Data / ETL development.
- Strong hands-on experience with Google Cloud Platform (GCP) services.
- Expertise in BigQuery, Dataflow, Dataproc, Cloud Composer, Pub/Sub, Cloud Functions, Cloud Storage.
- Strong programming skills in Python, SQL, Java, or Scala.
- Experience with Apache Spark, Hadoop, Kafka, Airflow.
- Strong knowledge of data warehousing concepts and dimensional modeling.
- Experience in real-time streaming and batch processing.
- Knowledge of CI/CD, DevOps, and infrastructure automation.
- Experience with data governance and security best practices.
Preferred Qualifications:
- GCP Professional Data Engineer Certification.
- Experience with machine learning pipelines is a plus.
- Experience in Agile/Scrum environment.