Senior Data Engineer-4
MastercardHyderabad, IndiaOn-Site
Needs a free Superjobs account. You'll finish on Mastercard's site.
Skill score
Summary
The Senior Data Engineer in Hyderabad owns end-to-end delivery of complex batch and real-time data pipelines on Databricks, Spark and dbt, while mentoring junior and mid-level engineers and leading code and design reviews. This suits an experienced individual contributor who combines deep technical skill with the ability to deliver independently and raise the bar for peers.
- Function
- Data Science
- Estimated salary
- Est. ₹14–21 LPA
- Estimated for a senior role, ~5 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Hyderabad, India
- Experience
- 5+ yrs
- Employment type
- Full-time
Job description
Overview
Senior Data Engineer-4
Mastercard is seeking a Senior Data Engineer to join our team in Hyderabad, India. This is an experienced individual-contributor role that owns end-to-end pipeline delivery and mentors peers. It will appeal to you if you combine deep technical expertise with the ability to independently deliver complex data solutions and raise the bar for the engineers around you.
About the team
You will bring cutting edge software and full stack development skills with advanced knowledge of cloud and data lake experience while working with massive data volumes. Our teams are small, agile, and focused on the needs of the high growth fintech marketplace, and you will work across functional teams within Mastercard to deliver on our cloud strategy while keeping our systems resilient, responsive, and maintainable on cloud.
Roles and responsibilities
Own the end-to-end design, development, and delivery of complex batch and real-time data pipelines using Databricks, Spark, Python, and PySpark.
Drive dbt-based transformation architecture with rigorous Test-Driven Development (TDD) and modular design.
Design and own CI/CD pipelines using GitLab and Jenkins, and champion DataOps practices across the team.
Administer and optimize Databricks objects and the platform using Databricks Asset Bundles, managing performance, access, and cost.
Establish data observability frameworks covering quality, freshness, lineage, and anomaly detection.
Lead the design of real-time data streaming pipelines (e.g., using Kafka, Spark Structured Streaming).
Mentor junior and mid-level engineers, and lead code and design reviews.
Partner with stakeholders on requirements, delivery planning, and technical trade-offs.
Plan and execute deployments, migrations, and upgrades with minimal disruption to operations.
Skills required
Top skills
- Databricks
- Spark
- Python
- PySpark
All skills (8)
- dbt
- CI/CD
- GitLab
- Jenkins
- SQL
- Kafka
- Spark Structured Streaming
- AWS
Qualifications
Bachelor's degree in computer science or a related technical field (Master's a plus).
5+ years of data engineering experience.
Deep hands-on experience with Databricks (including administration), Spark, and Python.
Strong background in PySpark and distributed data processing.
Proven track record using dbt for robust, testable transformation workflows following TDD.
Familiarity with Databricks Asset Bundles for object deployment and version control.
Strong CI/CD (GitLab, Jenkins) and DataOps expertise.
Experience with real-time data processing and streaming pipelines.
Expert SQL development and strong cloud infrastructure experience (AWS, Azure, or GCP).
Demonstrated experience mentoring engineers and leading technical delivery.
Nice to have
Ideally you have experience in banking, e-commerce, credit cards or payment processing and exposure to both SaaS and premises-based architectures. In addition, you have a post-secondary degree in computer science, mathematics, or quantitative science.
Company info
About Mastercard
Mastercard is a global payments company that provides payment transaction processing and related payment services, including credit, debit and prepaid card payments that let people, businesses and governments transact securely. Its products and services are used by consumers, merchants and card-issuing banks and credit unions worldwide.
Recent news
Mastercard Expands Crypto Card Program with New Partnerships
Mastercard Appoints Former PayPal Exec as New Chief Financial Officer
Mastercard Unveils New Sustainable Card Program