Data Engineer
CAPCOIndia - PuneOn-Site
Needs a free Superjobs account. You'll finish on CAPCO's Greenhouse page.
Skill score
Summary
The Data Engineer builds and supports data pipelines on Azure and Databricks, using Python, PySpark and Spark SQL for batch processing, ETL and Delta Lake or lakehouse storage. The role suits engineers with hands-on Spark performance tuning and production pipeline experience who want to work on banking and financial services transformation projects.
- Function
- Data Science
- Estimated salary
- Est. ₹9.5–14 LPA
- Estimated for a mid-level role, ~3 yrs experience (typical for the level), India. Not published by the employer.
- Work mode and location
- On-Site, India - Pune
Job description
Overview
Role: Data Engineer
Skills required
Top skills
- Python
- PySpark
- Spark SQL
- Databricks
All skills (8)
- Azure
- CI/CD
- REST API
- ETL pipelines
- Delta Lake
- Lakehouse architecture
- Spark performance tuning
- Terraform
Qualifications
Python, PySpark, Spark SQL, Databricks, Azure, CI/CD, Rest API, ETL Pipelines, Delta Lakes & Lakehouse Archiecture,
Spark fundamentals: Partitioning, caching, distributed processing, performance enhancement, Exception handling
Batch Processing, ADLS,
Terraform/IaC, Enterprise production pipeline development/support
Company info
About CAPCO
“Capco, a Wipro company, is a global technology and management consulting firm. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors.