Lead Data Engineer (Banking)
Unison GroupSingapore, Singapore, SingaporeOn-Site
Needs a free Superjobs account. You'll finish on Unison Group's site.
Skill score
Summary
The Lead Data Engineer builds and runs production data pipelines inside banks, covering customer, account, transaction, payments and AML data, and works within bank release and change controls. The role suits engineers with deep banking data experience who can also guide a team, design frameworks and handle large-scale historical processing.
- Function
- Data Science
- Estimated salary
- Est. $94k–142k/yr
- Estimated for a manager role, ~12 yrs experience, Singapore. Not published by the employer.
- Work mode and location
- On-Site, Singapore, Singapore, Singapore
- Experience
- 12+ yrs
- Employment type
- Full-time
Job description
Overview
Role: Lead Data Engineer (Banking)
Roles and responsibilities
- Framework design, code standards, code reviews and estimation.
- Guiding a team of engineers and working with architects and analysts.
Skills required
Top skills
- Teradata SQL
- BTEQ
- TPT
- FastLoad/MultiLoad
All skills (8)
- Spark
- PySpark/Scala
- Hive
- Impala
- Apache Iceberg
- Trino
- ETL/ELT development
- SCD Type 2
Qualifications
Banking and domain
- Production delivery of data pipelines inside banks.
- Customer, account, transaction, payments and AML data.
- Working within bank release, scheduling and change controls.
Core data engineering
- Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.
- Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.
- Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.
- ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.
- Reconciliation, data quality and SLA monitoring.
- Performance at scale: tables of 1 billion+ rows and multi-year history.
Requirements
Experience
- Lead: 12+ years, including 6+ in banking.
- Senior: 8+ years, including 4+ in banking ·
Banking and domain
- Production delivery of data pipelines inside banks.
- Customer, account, transaction, payments and AML data.
- Working within bank release, scheduling and change controls.
Core data engineering
- Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.
- Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.
- Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.
- ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.
- Reconciliation, data quality and SLA monitoring.
- Performance at scale: tables of 1 billion+ rows and multi-year history.
Integration and platforms
- Kafka, Spark Streaming, Informatica (PowerCenter, IDMC, IDL) and Talend; REST API development.
- Denodo, Snowflake and NoSQL databases.
- Airflow, Control-M or Autosys; Git, CI/CD, GitOps and Kubernetes.
Nice to have
- Databricks: Delta Lake, Unity Catalog and Workflows.
- Data services on Azure, Google Cloud, Huawei Cloud or Alibaba Cloud.
- Data modelling for Qlik Sense or Power BI.
Certifications (preferred): Teradata Vantage; Cloudera Data Engineer; Databricks Data Engineer Associate or Professional
Company info
About Unison Group
Unison Group provides digital transformation services to enterprises, offering technology solutions across fintech, AI, risk management, analytics and cloud. Its clients are large organizations in finance, technology and consulting, including regulated multinational businesses.