GCP Data Engineer
CAPCOIndia - Bengaluru; India - Chennai ; India - HyderabadOn-Site
Estimated salary, not published by the employer: Est. ₹17–25 LPA
Needs a free Superjobs account. You'll finish on CAPCO's Greenhouse page.
Skill score
Summary
The GCP Data Engineer designs, builds and supports batch and streaming data pipelines and large-scale data processing systems on Google Cloud, working with tools such as BigQuery, Dataflow, Pub/Sub and Kafka. It suits an experienced engineer with 8-12 years of hands-on work in production distributed systems who also leads feature teams and client work.
- Function
- Data Science
- Estimated salary
- Est. ₹17–25 LPA
- Estimated for a mid-level role, ~8 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, India - Bengaluru; India - Chennai ; India - Hyderabad
- Experience
- 8–12 yrs
Job description
Skills required
Top skills
- GCP data engineering
- BigQuery
- Dataflow
- Cloud Storage
All skills (8)
- Pub/Sub
- Cloud Composer
- Apache Kafka
- Python
- SQL
- Spark
- Hadoop
- CI/CD
Qualifications
- Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record.
- Expertise in GCP Data Products e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer, Apache Kafka
- Good hands on experience to Build Batch Data and Streaming Data Pipelines on Google Cloud
- Strong coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go). Strong SQL ability to write complex queries is must;
- Strong working experience with operational data stores, data warehouse, big data technologies and data lakes
- Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop)
- Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS.
- Experience working with (Real Time streaming), such as Kafka technologies.
- Experience and knowledge of automation and CI/CD – Jenkins, GitHub & Spinnaker.
- Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts.
- Competent in client handling and lead the feature team to deliver outcome;
Nice to have
And any experience of these would be really useful
- Certification in GCP “Cloud Architect”, “Cloud Developer”, “Professional Data Engineer”
Certification in Apache Kafka (CCDAK)
Other details
Location - Bangalore , Hyderabad , Chennai
Company info
About CAPCO
“Capco, a Wipro company, is a global technology and management consulting firm. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors.