Data Engineer
ProdigalBengaluruOn-Site
Needs a free Superjobs account. You'll finish on Prodigal's Greenhouse page.
Skill score
Summary
The Data Engineer builds and maintains scalable data pipelines and dbt transformation layers in Databricks, producing clean, tested, well-modeled data that powers analytics and AI/ML work. The role suits an engineer with 2-3 years of production data engineering experience who is strong in SQL, PySpark, dimensional modeling and dbt, and who works with AI-native tools.
- Function
- Data Science
- Estimated salary
- Est. ₹8–12 LPA
- Estimated for a mid-level role, ~2 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Bengaluru
- Experience
- 2–3 yrs
Job description
Overview
About the role
We are looking for a passionate and driven Data Engineer to join our team. You will be instrumental in building scalable data pipelines, generating powerful insights, and supporting our AI/ML initiatives. If you enjoy working across data engineering and analytics and want to help shape the future of Agentic AI, we'd love to hear from you!
Roles and responsibilities
- Design, build and manage robust data pipelines for collecting, transforming and modeling data within our Databricks data lake - dbt is your primary tool, not an afterthought
- Own the dbt layer end to end - models, sources, tests, macros, incremental strategies and documentation. If it touches transformation, it goes through dbt and you're accountable for it being clean, tested and re-runnable
- Turn raw, messy data into reliable, well-modeled assets that downstream teams can actually trust - no untested models, no undocumented logic, no shortcuts
- Collaborate closely with cross-functional teams to deliver actionable insights that drive product, AI and business decisions - translating business logic into dbt models that are built to last
- Support AI and ML initiatives by ensuring clean, validated and well-structured data is always available when the models need it
- Identify and fix performance bottlenecks in dbt models, Databricks queries and downstream reporting pipelines
Skills required
Top skills
- SQL
- dbt
- Databricks
- PySpark
All skills (8)
- Spark SQL
- Python
- Dimensional modeling
- AWS
- Data pipelines
- Claude Code
- Cursor
- Machine learning fundamentals
Qualifications
- 2-3 years of hands-on experience in data engineering - you've built things in production, not just in notebooks
- Strong SQL - you can write and reason about complex joins, aggregations and window functions, and you know why a query is slow before you tune it
- Python for data engineering with production-grade PySpark or Spark SQL experience. Databricks strongly preferred
- Dimensional modeling - star schemas, fact vs dimension grain, SCD Type 2, and incremental loads you can confidently re-run without breaking things
- dbt as your transformation framework of choice - models, tests, sources and incremental strategies are second nature to you
- AWS hands-on experience across Lambda, S3, CloudFront, SQS and beyond
- AI-native workflow - we ship with Claude Code and Cursor and we expect you to use them well, not just know they exist
- Sharp problem solving - you find the right balance between getting it right and getting it done, and communicate clearly when tradeoffs are being made
- Self-driven and curious - you thrive in fast paced environments, pick things up quickly and keep an eye on what's emerging in the data ecosystem
Nice to have
- Bonus - Foundational knowledge in ML/AI fundamentals
Other details
Mode of Work - In-Office (Koramangala,Bengaluru)
⚙️ Our Tech Stack
- Products built using Python, Cursor, Claude, dbt, Airflow
- Databases such as MongoDB, PostgreSQL, Redis, Databricks,
- Deployments on EKS, EC2, Lambda and other AWS services
Benefits
Top Tier Benefits
Health insurance for you and your family, meals at office on us, travel reimbursement, unlimited leaves, subsidized gym membership, unlimited learning & development, flexible work schedule and a world-class team to learn and grow with!
From day 1, Prodigal has been defined by talented, humble, and hungry leaders and we want this mindset and culture to continue to blossom from top to bottom in the company. If you have an entrepreneurial spirit and want to work in a fast-paced, intellectually-stimulating environment where you will be pushed to grow, then please reach out because we are looking to build a transformational company that reinvents one of the biggest industries in the US.
Company info
About Prodigal
Prodigal is the connected AI platform leading financial institutions use to run their operations. We work with banks, lenders, credit unions, and other financial companies that lend money to people and manage those relationships over time. Prodigal has spent the last eight years building that understanding. More than a billion