Skip to content

Databricks Data Engineer

HITACHI SOLUTIONSPune, PUNE, IndiaOn-Site

Estimated salary, not published by the employer: Est. ₹13–19 LPA

Needs a free Superjobs account. You'll finish on HITACHI SOLUTIONS's SmartRecruiters page.

Skill score

Summary

The Databricks Data Engineer designs, builds, and maintains complex data pipelines and APIs for business-critical operations and large-scale analytics, with a focus on Spark and Delta Lake. The role suits experienced engineers who learn quickly, work with minimal oversight, and have strong data or software engineering backgrounds.

Function
Data Science
Estimated salary
Est. ₹13–19 LPA
Estimated for a mid-level role, ~5 yrs experience, India. Not published by the employer.
Work mode and location
On-Site, Pune, PUNE, India
Experience
5+ yrs
Employment type
Full-time

Job description

Overview

Job Description

We are looking for a highly experienced Data Engineer to join our product organization in a full-time role. This position focuses on Big Data systems design and data architecture, with a special emphasis on Spark and Delta/Data Lake technology.

In this role, you will help design, develop, enhance, and maintain complex data pipeline and API products that manage business-critical operations and large-scale analytics. We are looking for applicants who demonstrate a capability to learn new concepts quickly and bring a robust background in data engineering or software engineering expertise.

Roles and responsibilities

  • Collaborate: Work collaboratively with other engineers to architect and implement complex systems with minimal oversight, while partnering with team leadership to identify how best to improve and expand platform capabilities.
  • Build & Design: Design, develop, and maintain complex data pipeline products that support business-critical operations and large-scale analytics applications.
  • Support the Team: Partner with analytics, data science, and engineering teams to understand and solve their unique data needs and challenges.
  • Continuous Learning: Dedicate time to staying current with the latest developments in the space and embrace new concepts to keep up with fast-moving data engineering technology.
  • Autonomy: Enjoy a role that offers strong independence and autonomy while contributing to the technical maturity of the organization.

Skills required

Top skills

  • Data Engineering
  • Databricks
  • Spark
  • Delta Lake

All skills (10)

  • Python
  • PySpark
  • SparkSQL
  • Airflow
  • Big Data pipelines
  • Django
  • FastAPI
  • SQL
  • Scala
  • Microsoft Fabric

Qualifications

Qualifications & Skills

  • Experience: 5+ years of Data Engineering experience, including 4+ years designing and building Databricks data pipelines is essential. While Azure cloud experience is preferred, we are happy to consider experience with AWS, GCP, or other cloud platforms.

• Technical Stack

  • 4+ years of hands-on experience with Python, Pyspark, or SparkSQL is key. Experience with Scala is a plus.
  • 4+ years of experience with Big Data pipelines or DAG Tools (such as Airflow, Dbt, Data Factory, or similar).
  • 4+ years of Spark experience, especially with Databricks Spark and Delta Lake.
  • 4+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes.
  • 5+ years of relevant software development experience, including Python 3.x, Django/Flask Frameworks, FastAPI (or other standard industry API), and relational databases (SQL/ORM).

Nice to have

• Additional Skills (Great to have)

  • Experience with Microsoft Fabric specifically with Pyspark on Fabric and Fabric Pipelines
  • Experience with conceptual, logical, and/or physical database designs.
  • Strong SQL experience, specifically writing complex, highly optimized queries across large volumes of data.
  • Strong data modeling/profiling capabilities using Kimball/star schema methodology as well as medallion architecture.
  • Professional experience with Kafka, EventHub or other live streaming technologies.
  • Familiarity with database deployment pipelines (e.g., dacpac or similar).
  • Experience with unit testing or data quality frameworks.

Other details

We offer competitive compensation and benefits package, regular performance review, performance bonuses, and regular trainings.

Company info

About HITACHI SOLUTIONS

Hitachi Solutions, Ltd., headquartered in Tokyo, Japan, is a core member of Information & Telecommunication Systems Company of Hitachi Group and a recognized leader in delivering proven business and IT strategies and solutions to companies across many industries. The company provides value-driven services throughout the IT life cycle from systems

More jobs at HITACHI SOLUTIONS