Sr Data Engineer
CAPCOIndia - PuneOn-Site
Needs a free Superjobs account. You'll finish on CAPCO's Greenhouse page.
Skill score
Summary
The Data Engineer builds and supports data pipelines on Azure and Databricks, using Python, PySpark and Spark SQL for batch processing, ETL and Delta Lake lakehouse architecture. The role suits an experienced engineer who works on enterprise production pipelines and infrastructure as code with Terraform.
- Function
- Data Science
- Estimated salary
- Est. ₹16–24 LPA
- Estimated for a senior role, ~6 yrs experience (typical for the level), India. Not published by the employer.
- Work mode and location
- On-Site, India - Pune
Job description
Overview
Role: Data Engineer
Skills required
Top skills
- Python
- PySpark
- Spark SQL
- Databricks
All skills (8)
- Azure
- CI/CD
- REST API
- ETL pipelines
- Delta Lake
- Lakehouse architecture
- Batch processing
- ADLS
Qualifications
Python, PySpark, Spark SQL, Databricks, Azure, CI/CD, Rest API, ETL Pipelines, Delta Lakes & Lakehouse Archiecture,
Spark fundamentals: Partitioning, caching, distributed processing, performance enhancement, Exception handling
Batch Processing, ADLS,
Terraform/IaC, Enterprise production pipeline development/support
Company info
About CAPCO
“Capco, a Wipro company, is a global technology and management consulting firm. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors.