Data Engineer - Python / Big Data
Finnovation Tech Solutions Private LimitedBangalore, Karnataka, IndiaOn-Site
Needs a free Superjobs account. You'll finish on Finnovation Tech Solutions Private Limited's site.
Skill score
Summary
The Data Engineer - Python / Big Data designs, builds and optimizes scalable cloud data pipelines, warehouses and lakes, and supports data quality and governance. It suits a mid-level engineer with 3+ years of Python, SQL and AWS or Spark experience who enjoys ownership of high-volume data systems.
- Function
- Data Science
- Estimated salary
- Est. ₹9.5–14 LPA
- Estimated for a mid-level role, ~3 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Bangalore, Karnataka, India
- Experience
- 3+ yrs
- Employment type
- Full-time
Job description
Overview
About the Role
We are looking for a skilled Data Engineer – Python / Big Data to design, build, and optimize scalable, high-performance data systems in cloud environments. In this role, you will be responsible for developing robust data pipelines, managing data infrastructure, and enabling reliable, high-quality data availability for analytics, product, and business teams.
You will work closely with cross-functional teams to build scalable data products such as data lakes, data warehouses, and real-time data systems that power critical business decisions.
Position: Data Engineer - Python / Big Data
Employment Type: Full-Time
Experience Level: Mid-Level
Location: Bengaluru, India (Onsite)
Roles and responsibilities
Data Engineering & Platform Development
- Design, develop, and maintain scalable data products including data warehouses, data lakes, and databases
- Build and optimize ETL/ELT pipelines for batch and real-time data processing
- Develop robust and reusable data models to support analytics and reporting needs
Pipeline Development & Optimization
- Build and maintain automated, scalable data pipelines
- Monitor, troubleshoot, and optimize pipeline performance for latency, cost, and reliability
- Ensure high availability and data integrity across systems
Cloud & Big Data Engineering
- Work with AWS services including EC2, S3, Lambda, Redshift, Glue, EMR, and DynamoDB
- Implement distributed data processing solutions using Spark, Flink, or Kafka
- Design cloud-native data architectures for scalability and efficiency
Technical Leadership & Collaboration
- Provide technical guidance on data architecture and engineering best practices
- Collaborate with data scientists, analysts, and engineering teams to deliver data-driven solutions
- Contribute to CI/CD processes and engineering automation
Data Quality & Governance
- Ensure accuracy, consistency, and reliability of data systems
- Implement data validation and monitoring frameworks
- Support secure and compliant data handling practices
Skills required
Top skills
- Python
- SQL
- Git
- CI/CD
All skills (8)
- ETL/ELT pipelines
- Data modeling
- AWS
- Spark
- Kafka
- Flink
- MySQL
- Airflow
Qualifications
Technical Expertise
- 3+ years of experience in data engineering, preferably in cloud and big data environments
- Strong proficiency in Python and SQL (MySQL preferred)
- Hands-on experience with ETL/ELT pipelines and data modeling
- Strong understanding of scalable data architectures and distributed systems
Big Data & Cloud Skills
- Experience with AWS cloud services (EC2, S3, Lambda, Redshift, Glue, EMR, DynamoDB)
- Hands-on experience with Spark, Kafka, Flink, or similar distributed processing tools
- Familiarity with real-time and batch data processing systems
Engineering Practices
- Experience with Git-based version control systems
- Understanding of CI/CD pipelines and deployment automation
- Strong debugging and performance optimization skills
Education
- BE / BTech in Computer Science or related field
- MCA graduates also eligible
Soft Skills
- Strong analytical and problem-solving mindset
- Excellent communication and collaboration skills
- Ability to manage multiple priorities in a fast-paced environment
- Strong attention to detail and quality-focused approach
Nice to have
- Experience in fintech or high-scale consumer platforms
- Exposure to data governance or data quality frameworks
- Familiarity with orchestration tools like Airflow or similar
- Experience working in startup or product-based environments
Company info
About Finnovation Tech Solutions Private Limited
Finnovation Tech Solutions operates KreditBee, an online platform offering instant personal loans and other credit products, including two-wheeler, business and loans against property, to individual borrowers in India. The company is expanding its offering into UPI, insurance and credit-related services as it works toward a digital bank.