Skip to content

Sr Data Engineer

CAPCOIndia - PuneOn-Site

Estimated salary, not published by the employer: Est. ₹16–24 LPA

Needs a free Superjobs account. You'll finish on CAPCO's Greenhouse page.

Skill score

Summary

The Data Engineer builds and supports data pipelines on Azure and Databricks, using Python, PySpark and Spark SQL for batch processing, ETL and Delta Lake lakehouse architecture. The role suits an experienced engineer who works on enterprise production pipelines and infrastructure as code with Terraform.

Function
Data Science
Estimated salary
Est. ₹16–24 LPA
Estimated for a senior role, ~6 yrs experience (typical for the level), India. Not published by the employer.
Work mode and location
On-Site, India - Pune

Job description

Overview

Role: Data Engineer

Skills required

Top skills

  • Python
  • PySpark
  • Spark SQL
  • Databricks

All skills (8)

  • Azure
  • CI/CD
  • REST API
  • ETL pipelines
  • Delta Lake
  • Lakehouse architecture
  • Batch processing
  • ADLS

Qualifications

Python, PySpark, Spark SQL, Databricks, Azure, CI/CD, Rest API, ETL Pipelines, Delta Lakes & Lakehouse Archiecture,

Spark fundamentals: Partitioning, caching, distributed processing, performance enhancement, Exception handling

Batch Processing, ADLS,

Terraform/IaC, Enterprise production pipeline development/support

Company info

“Capco, a Wipro company, is a global technology and management consulting firm. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors.

More jobs at CAPCO