Skip to content

Data Engineer - Python / Big Data

Finnovation Tech Solutions Private LimitedBangalore, Karnataka, IndiaOn-Site

Estimated salary, not published by the employer: Est. ₹9.5–14 LPA

Needs a free Superjobs account. You'll finish on Finnovation Tech Solutions Private Limited's site.

Skill score

Summary

The Data Engineer - Python / Big Data designs, builds and optimizes scalable cloud data pipelines, warehouses and lakes, and supports data quality and governance. It suits a mid-level engineer with 3+ years of Python, SQL and AWS or Spark experience who enjoys ownership of high-volume data systems.

Function
Data Science
Estimated salary
Est. ₹9.5–14 LPA
Estimated for a mid-level role, ~3 yrs experience, India. Not published by the employer.
Work mode and location
On-Site, Bangalore, Karnataka, India
Experience
3+ yrs
Employment type
Full-time

Job description

Overview

About the Role

We are looking for a skilled Data Engineer – Python / Big Data to design, build, and optimize scalable, high-performance data systems in cloud environments. In this role, you will be responsible for developing robust data pipelines, managing data infrastructure, and enabling reliable, high-quality data availability for analytics, product, and business teams.

You will work closely with cross-functional teams to build scalable data products such as data lakes, data warehouses, and real-time data systems that power critical business decisions.

Position: Data Engineer - Python / Big Data

Employment Type: Full-Time

Experience Level: Mid-Level

Location: Bengaluru, India (Onsite)

Roles and responsibilities

Data Engineering & Platform Development

  • Design, develop, and maintain scalable data products including data warehouses, data lakes, and databases
  • Build and optimize ETL/ELT pipelines for batch and real-time data processing
  • Develop robust and reusable data models to support analytics and reporting needs

Pipeline Development & Optimization

  • Build and maintain automated, scalable data pipelines
  • Monitor, troubleshoot, and optimize pipeline performance for latency, cost, and reliability
  • Ensure high availability and data integrity across systems

Cloud & Big Data Engineering

  • Work with AWS services including EC2, S3, Lambda, Redshift, Glue, EMR, and DynamoDB
  • Implement distributed data processing solutions using Spark, Flink, or Kafka
  • Design cloud-native data architectures for scalability and efficiency

Technical Leadership & Collaboration

  • Provide technical guidance on data architecture and engineering best practices
  • Collaborate with data scientists, analysts, and engineering teams to deliver data-driven solutions
  • Contribute to CI/CD processes and engineering automation

Data Quality & Governance

  • Ensure accuracy, consistency, and reliability of data systems
  • Implement data validation and monitoring frameworks
  • Support secure and compliant data handling practices

Skills required

Top skills

  • Python
  • SQL
  • Git
  • CI/CD

All skills (8)

  • ETL/ELT pipelines
  • Data modeling
  • AWS
  • Spark
  • Kafka
  • Flink
  • MySQL
  • Airflow

Qualifications

Technical Expertise

  • 3+ years of experience in data engineering, preferably in cloud and big data environments
  • Strong proficiency in Python and SQL (MySQL preferred)
  • Hands-on experience with ETL/ELT pipelines and data modeling
  • Strong understanding of scalable data architectures and distributed systems

Big Data & Cloud Skills

  • Experience with AWS cloud services (EC2, S3, Lambda, Redshift, Glue, EMR, DynamoDB)
  • Hands-on experience with Spark, Kafka, Flink, or similar distributed processing tools
  • Familiarity with real-time and batch data processing systems

Engineering Practices

  • Experience with Git-based version control systems
  • Understanding of CI/CD pipelines and deployment automation
  • Strong debugging and performance optimization skills

Education

  • BE / BTech in Computer Science or related field
  • MCA graduates also eligible

Soft Skills

  • Strong analytical and problem-solving mindset
  • Excellent communication and collaboration skills
  • Ability to manage multiple priorities in a fast-paced environment
  • Strong attention to detail and quality-focused approach

Nice to have

  • Experience in fintech or high-scale consumer platforms
  • Exposure to data governance or data quality frameworks
  • Familiarity with orchestration tools like Airflow or similar
  • Experience working in startup or product-based environments

Company info

About Finnovation Tech Solutions Private Limited

Finnovation Tech Solutions operates KreditBee, an online platform offering instant personal loans and other credit products, including two-wheeler, business and loans against property, to individual borrowers in India. The company is expanding its offering into UPI, insurance and credit-related services as it works toward a digital bank.

More jobs at Finnovation Tech Solutions Private Limited