Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) - Tieto Tech Consulting (m/f/d)
TietoBangalore, IndiaOn-Site
Needs a free Superjobs account. You'll finish on Tieto's SmartRecruiters page.
Skill score
Summary
The Senior PySpark Developer builds and runs Spark-based data pipelines on Cloudera Data Platform, manages Apache Iceberg data lake tables and Airflow workflows, and works across AWS data services. It suits an experienced data engineer who can lead development and troubleshoot large-scale data processing.
- Function
- Development
- Estimated salary
- Est. ₹12–18 LPA
- Estimated for a senior role, ~5 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Bangalore, India
- Experience
- 5+ yrs
- Employment type
- Full-time
Job description
Overview
Role Level: Senior Developer / Lead Developer
Experience: 5+ years overall with strong expertise in PySpark, Cloudera CDP, Apache Iceberg, Airflow, and AWS Data Engineering.
Skills required
Top skills
- PySpark
- Spark data processing
- Cloudera Data Platform
- Apache Iceberg
All skills (8)
- Apache Airflow
- SQL
- Data modeling
- ETL/ELT development
- Git
- CI/CD pipelines
- AWS data services
- Kafka
Qualifications
Required Qualifications
- Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
- 5+ years of IT experience with5+ years in Data Engineering and Big Data development.
- Strong hands-on experience with PySpark and Spark-based data processing.
- Experience developing data pipelines on Cloudera Data Platform (CDP).
- Strong knowledge of Apache Iceberg table architecture and data lake concepts.
- Experience designing and managing workflows using Apache Airflow.
- Experience with SQL and data modeling techniques.
- Strong understanding of ETL/ELT development and data transformation frameworks.
- Experience working with large-scale structured and unstructured datasets.
- Knowledge of Git, CI/CD pipelines, and DevOps practices.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and collaboration skills.
Nice to have
- Experience with AWS services including S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, and CloudWatch.
- Experience building cloud-native data lake and Lakehouse solutions.
- Strong knowledge of data partitioning, performance tuning, and query optimization.
- Experience with Kafka or event-driven data processing frameworks.
- Experience with Java or Python application development.
- Experience implementing data quality, metadata, and data governance solutions.
- Healthcare, Medicaid, Claims Processing, or Insurance industry experience.
- Experience working in Agile development environments.
- AWS Certification and/or Cloudera Certification preferred.
- Experience supporting large-scale cloud migration and modernization initiatives.
Company info
About Tieto
We solve our clients’ toughest technology challenges and deliver reliable outcomes that drive measurable results. By merging data, cloud, AI, and design with deep industry expertise and consulting, we create impactful yet intuitive digital solutions that empower people and move businesses forward.