Skip to content

Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) - Tieto Tech Consulting (m/f/d)

TietoBangalore, IndiaOn-Site

Estimated salary, not published by the employer: Est. ₹12–18 LPA

Needs a free Superjobs account. You'll finish on Tieto's SmartRecruiters page.

Skill score

Summary

The Senior PySpark Developer builds and runs Spark-based data pipelines on Cloudera Data Platform, manages Apache Iceberg data lake tables and Airflow workflows, and works across AWS data services. It suits an experienced data engineer who can lead development and troubleshoot large-scale data processing.

Function
Development
Estimated salary
Est. ₹12–18 LPA
Estimated for a senior role, ~5 yrs experience, India. Not published by the employer.
Work mode and location
On-Site, Bangalore, India
Experience
5+ yrs
Employment type
Full-time

Job description

Overview

Role Level: Senior Developer / Lead Developer

Experience: 5+ years overall with strong expertise in PySpark, Cloudera CDP, Apache Iceberg, Airflow, and AWS Data Engineering.

Skills required

Top skills

  • PySpark
  • Spark data processing
  • Cloudera Data Platform
  • Apache Iceberg

All skills (8)

  • Apache Airflow
  • SQL
  • Data modeling
  • ETL/ELT development
  • Git
  • CI/CD pipelines
  • AWS data services
  • Kafka

Qualifications

Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
  • 5+ years of IT experience with5+ years in Data Engineering and Big Data development.
  • Strong hands-on experience with PySpark and Spark-based data processing.
  • Experience developing data pipelines on Cloudera Data Platform (CDP).
  • Strong knowledge of Apache Iceberg table architecture and data lake concepts.
  • Experience designing and managing workflows using Apache Airflow.
  • Experience with SQL and data modeling techniques.
  • Strong understanding of ETL/ELT development and data transformation frameworks.
  • Experience working with large-scale structured and unstructured datasets.
  • Knowledge of Git, CI/CD pipelines, and DevOps practices.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent communication and collaboration skills.

Nice to have

  • Experience with AWS services including S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, and CloudWatch.
  • Experience building cloud-native data lake and Lakehouse solutions.
  • Strong knowledge of data partitioning, performance tuning, and query optimization.
  • Experience with Kafka or event-driven data processing frameworks.
  • Experience with Java or Python application development.
  • Experience implementing data quality, metadata, and data governance solutions.
  • Healthcare, Medicaid, Claims Processing, or Insurance industry experience.
  • Experience working in Agile development environments.
  • AWS Certification and/or Cloudera Certification preferred.
  • Experience supporting large-scale cloud migration and modernization initiatives.

Company info

We solve our clients’ toughest technology challenges and deliver reliable outcomes that drive measurable results. By merging data, cloud, AI, and design with deep industry expertise and consulting, we create impactful yet intuitive digital solutions that empower people and move businesses forward.

More jobs at Tieto