GCP Data Engineer

Capco

Bengaluru +2 more

On-site

Who this role is best for

Strong fit for experienced data engineers who design and build distributed systems on GCP and lead feature teams in a collaborative environment.

Best fit for

Experienced data engineers with a proven track record in GCP and leadership in feature teams
— “Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems”
Candidates with expertise in real-time streaming and big data technologies
— “Experience working with (Real Time streaming), such as Kafka technologies”
Professionals who can build complex data pipelines and manage cloud infrastructure
— “Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google Cloud”

Things to consider

The role requires a strong grasp of both data engineering and client-facing leadership responsibilities
— “Competent in client handling and lead the feature team to deliver outcome”
Candidates must have experience with multiple cloud platforms and distributed frameworks
— “Experience with cloud platforms such as GCP, Azure or AWS. Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop)”

How to stand out

Emphasize hands-on experience with GCP data products like BigQuery and Dataflow
— “Expertise in GCP Data Products e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer”
Showcase strong SQL skills through complex query examples in your resume
— “Strong SQL ability to write complex queries is must”

Pace · SteadyCollaboration · HighAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

Designed, built, and supported distributed systems and large-scale data processing systems in production
Built Batch Data and Streaming Data Pipelines on Google Cloud

Typical background

8-12 years of hands-on experience in GCP Data Engineering

Skills & requirements

Required

GCP Data EngineeringBigQueryDataflowCloud StoragePub/subCloud ComposerApache KafkaPythonSQLJavaScalaGoDockerKubernetesJenkinsGitHubSpinnakerCI/CD

Preferred

GCP Cloud ArchitectGCP Cloud DeveloperProfessional Data EngineerApache Kafka Ccdak

Stack & domain

GCP Data EngineeringBigQueryDataflowCloud StoragePub/subCloud ComposerApache KafkaPythonSQLJavaScalaGoSparkFlinkBeamHadoopDockerKubernetesJenkinsGitHubSpinnakerData StructuresAlgorithmsSoftware DesignCore Programming ConceptsProblem SolvingTeamworkLeadershipCommunicationNegotiationDecision MakingTime ManagementAdaptabilityCreativityInfluenceCollaborationGCP Cloud ArchitectGCP Cloud DeveloperGCP Professional Data EngineerApache Kafka CcdakData EngineeringCloud ComputingBig DataDistributed SystemsData ProcessingData WarehousingData LakesData PipelinesReal-time StreamingAutomationCI/CDContainerizationCloud Platforms

About the role

Original posting from Capco via Greenhouse

Job Title: GCP Data Engineer
About Us
“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.
WHY JOIN CAPCO?
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.
MAKE AN IMPACT
Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.
#BEYOURSELFATWORK
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.
CAREER ADVANCEMENT
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.
DIVERSITY & INCLUSION
We believe that diversity of people and perspective gives us a competitive advantage.
Location - Bangalore , Hyderabad , Chennai
Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record.
Expertise in GCP Data Products e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer, Apache Kafka
Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google Cloud
Strong coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go). Strong SQL ability to write complex queries is must;
Strong working experience with operational data stores, data warehouse, big data technologies and data lakes
Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop)
Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS.
Experience working with (Real Time streaming), such as Kafka technologies.
Experience and knowledge of automation and CI/CD – Jenkins, GitHub & Spinnaker.
Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts.
Competent in client handling and lead the feature team to deliver outcome;
And any experience of these would be really useful:
Certification in GCP “Cloud Architect”, “Cloud Developer”, “Professional Data Engineer”
Certification in Apache Kafka (CCDAK)

Source: Capco careers (Greenhouse)