Skip to content

GCP Data Engineer

CAPCOIndia - Bengaluru; India - Chennai ; India - HyderabadOn-Site

Estimated salary, not published by the employer: Est. ₹17–25 LPA

Needs a free Superjobs account. You'll finish on CAPCO's Greenhouse page.

Skill score

Summary

The GCP Data Engineer designs, builds and supports batch and streaming data pipelines and large-scale data processing systems on Google Cloud, working with tools such as BigQuery, Dataflow, Pub/Sub and Kafka. It suits an experienced engineer with 8-12 years of hands-on work in production distributed systems who also leads feature teams and client work.

Function
Data Science
Estimated salary
Est. ₹17–25 LPA
Estimated for a mid-level role, ~8 yrs experience, India. Not published by the employer.
Work mode and location
On-Site, India - Bengaluru; India - Chennai ; India - Hyderabad
Experience
8–12 yrs

Job description

Skills required

Top skills

  • GCP data engineering
  • BigQuery
  • Dataflow
  • Cloud Storage

All skills (8)

  • Pub/Sub
  • Cloud Composer
  • Apache Kafka
  • Python
  • SQL
  • Spark
  • Hadoop
  • CI/CD

Qualifications

  • Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record.
  • Expertise in GCP Data Products e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer, Apache Kafka
  • Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google Cloud
  • Strong coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go). Strong SQL ability to write complex queries is must;
  • Strong working experience with operational data stores, data warehouse, big data technologies and data lakes
  • Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop)
  • Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS.
  • Experience working with (Real Time streaming), such as Kafka technologies.
  • Experience and knowledge of automation and CI/CD – Jenkins, GitHub & Spinnaker.
  • Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts.
  • Competent in client handling and lead the feature team to deliver outcome;

Nice to have

And any experience of these would be really useful

  • Certification in GCP “Cloud Architect”, “Cloud Developer”, “Professional Data Engineer”

Certification in Apache Kafka (CCDAK)

Other details

Location - Bangalore , Hyderabad , Chennai

Company info

“Capco, a Wipro company, is a global technology and management consulting firm. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors.

More jobs at CAPCO