GCP Big Data Engineer – Python, Spark, Dataflow, BigQuery & ETL/ELT
SynechronGurugram, 2 Locations, Bengaluru - Bellandur (GTP)On-Site
Needs a free Superjobs account. You'll finish on Synechron's site.
Skill score
Summary
The Data Engineer designs, builds and optimizes scalable data pipelines on Google Cloud Platform using Spark, Dataflow and BigQuery, and keeps data quality, security and governance in place. It suits an engineer with 5+ years of GCP and big data experience who is comfortable with ETL/ELT, Python and collaborating with analytics and business teams.
- Function
- Data Science
- Estimated salary
- Est. ₹13–19 LPA
- Estimated for a mid-level role, ~5 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Gurugram, 2 Locations, Bengaluru - Bellandur (GTP)
- Experience
- 5+ yrs
- Employment type
- Full-time
Job description
Overview
Synechron is seeking a highly skilled Data Engineer specializing in Google Cloud Platform (GCP) and Big Data technologies to architect, develop, and optimize scalable data pipelines and data management solutions. This role is pivotal in supporting enterprise data initiatives, ensuring data quality, security, and accessibility for critical business insights. The successful candidate will collaborate across teams to drive data platform innovations and operational excellence aligned with organizational goals.
Roles and responsibilities
- Design, develop, and maintain scalable, resilient data pipelines on GCP to support enterprise analytics and reporting solutions
- Collaborate with business stakeholders, data scientists, and analytics teams to understand data requirements and implement optimized data workflows
- Implement and enforce data quality, security, and governance standards across platforms
- Optimize data ingestion, transformation, and processing workflows to ensure high performance and cost efficiency
- Perform data profiling, troubleshooting, and resolution of pipeline issues to ensure operational reliability
- Stay current with emerging data engineering best practices, tools, and industry trends, leading continuous improvement initiatives
- Develop and optimize data pipelines ensuring high performance, data quality, and security
- Collaborate with analytics, data science, and cross-functional teams to translate business requirements into scalable data solutions
- Automate data workflows, manage infrastructure as code, and support deployment pipelines
- Perform data profiling and troubleshooting to resolve pipeline issues promptly
- Implement security best practices for data access, encryption, and compliance
- Document architecture, workflows, procedures, and operational guidelines
- Participate in sprint planning, reviews, and continuous improvement initiatives
Skills required
Top skills
- GCP BigQuery
- Dataflow
- Cloud Storage
- Cloud Pub/Sub
All skills (8)
- Apache Spark
- ETL/ELT pipelines
- Python
- Git
- Linux/Unix
- PostgreSQL
- Apache Airflow
- Docker
Qualifications
- Required:
- Extensive experience with GCP services including BigQuery, Dataflow, Cloud Storage, and Cloud Pub/Sub
- Strong proficiency in Apache Spark for distributed data processing and analytics
- Hands-on expertise in building and maintaining data pipelines using ETL/ELT processes
- Proficiency in Python for data scripting, automation, and orchestration tasks
- Experience with distributed data storage and management, including relational and NoSQL databases (PostgreSQL, MySQL, MongoDB)
- Familiarity with version control tools such as Git
- Knowledge of Linux/Unix environments for data processing and scripting
Nice to have
- Preferred:
- Experience with data governance, metadata management, and data security best practices
- Knowledge of data orchestration tools like Apache Airflow or Prefect
- Understanding of containerization (Docker) and orchestration (Kubernetes) for data deployment
- Programming Languages:
Required: Python for scripting and orchestration
Preferred: SQL, Java (for integration or data processing tasks)
- Databases & Data Management:
BigQuery, PostgreSQL, MySQL, MongoDB, data modeling, data security, and query optimization
- Cloud Technologies:
GCP services including BigQuery, Dataflow, Cloud Storage, Pub/Sub, IAM, and Cloud Function deployment
- Frameworks & Libraries:
Apache Spark, Dataflow, Airflow (preferred), TensorFlow or PyTorch (if ML integrations are involved)
- Development & Orchestration Tools:
Git, Jenkins, Docker, Kubernetes, Terraform, Apache Airflow, and other CI/CD tools
- Security & Compliance:
Implementing security policies, data encryption, access controls, and compliance standards such as GDPR or HIPAA
Experience Requirements
- 5+ years of practical experience in data engineering, with a significant focus on GCP and Big Data ecosystems
- Hands-on experience designing and implementing end-to-end data pipelines and workflows at scale
- Proven expertise in distributed data processing, data security, and infrastructure automation
- Experience working in agile teams supporting enterprise or large-scale data platforms
- Industry experience in finance, healthcare, retail, or technology sectors is advantageous
- Bachelor’s or Master’s degree in Computer Science, Data Science, Information Technology, or a related field
- Extensive experience with GCP and Big Data processing frameworks such as Hadoop, Spark, and Dataflow
- Certifications in GCP (e.g., Professional Data Engineer), AWS, or Azure are a plus
- Proven ability to develop robust, scalable, and secure data pipelines supporting enterprise analytics
Professional Competencies
- Strong analytical and problem-solving skills, especially related to distributed data systems
- Excellent collaboration and communication skills to work effectively across teams and stakeholders
- Leadership qualities to guide data engineering best practices and mentor junior team members
- Strategic mindset to align data platform development with organizational goals
- Continuous learner to stay updated with evolving data technologies and industry standards
- Effective time management skills to handle multiple data projects simultaneously
Company info
About Synechron
Synechron provides agentic AI, data, cloud and software engineering services that help banks, asset managers and insurers modernize their operations. Its clients are financial services firms in banking, asset management and insurance.