Skip to content

Data Engineer

Jumbotail Technologies Private LimitedBangaloreOn-Site

Estimated salary, not published by the employer: Est. ₹6–9 LPA

Needs a free Superjobs account. You'll finish on Jumbotail Technologies Private Limited's site.

Skill score

Summary

The data engineer designs, builds and maintains the data lake, warehouse, pipelines and orchestration that keep data consistent, reliable and usable for analytics, data science and ML workloads. The role suits someone with several years of data engineering experience who enjoys owning infrastructure and working closely with analysts, scientists and product managers.

Function
Data Science
Estimated salary
Est. ₹6–9 LPA
Estimated for a mid-level role, ~1 yr experience, India. Not published by the employer.
Work mode and location
On-Site, Bangalore
Experience
1–5 yrs
Employment type
Full-time

Job description

Overview

As a data engineer, you will be responsible for ideating, designing, developing and maintaining all the engineering building blocks which are required to keep the data consistent, reliable and consumable.

Roles and responsibilities

  • Architect the Data lake and Data warehouse infrastructure to enable the users to execute business intelligence, data analytics, data science and ML/AI workloads
  • Design, develop and maintain data pipelines for optimal extraction, transformation, and loading of data from a wide variety of data sources.
  • Build workflow orchestration tools to enable users to run periodic jobs on our data infrastructure
  • Build frameworks for data processing jobs to run decision science workloads such as personalisation, fraud detection, optimisation algorithms and more
  • Building observability over the data pipelines to maintain consistent data with an agreed upon latency
  • Ideate processes to maintain the health of the infrastructure such as cpu, memory monitoring, query monitoring, workload monitoring and educate the teams to follow the best practices. Set the standards high.
  • Work closely with decision scientists, data analysts and product managers to understand their data needs, their technical issues and help them in performance tuning.
  • Keep the data secure from the external world and have fine grained access control within the organization to make sure that only relevant data is available to every user.
  • Create or integrate with tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Skills required

Top skills

  • Data pipelines
  • Data warehousing
  • SQL
  • Performance tuning

All skills (8)

  • Apache Spark
  • Hadoop
  • Airflow
  • Kafka
  • Amazon Redshift
  • AWS or Google Cloud Platform
  • Java, Scala or Python
  • Machine learning workloads

Qualifications

  • Proven experience in Data engineering role with at least 1-5 years of experience
  • High sense of ownership and strong decision making skills backed by first principles thinking
  • Strong analytical skills to break down the complex problems and build the right solutions
  • Good knowledge on data engineering concepts such as ETL pipelines, building data lake, building data warehouses/ data marts, Stream and event processing, distributed processing of large scale data.
  • Experience building and optimising big data' data pipelines, architectures and data sets.
  • In depth knowledge in data warehousing concepts and familiarity with at least one of the warehousing tools such as Amazon Redshift, Snowflake and more.
  • Strong SQL knowledge and understanding of performance tuning techniques
  • Good knowledge of big data tools such as Hadoop, Apache Spark, Apache Druid, S3, Glue, Athena, Flink, Airflow, etc.
  • Good exposure on streaming technologies like Kafka, SQS, Kinesis
  • Good understanding of SQL and NoSql databases
  • Experience with Amazon web services or Google Cloud Platform.
  • Proficient in Java, Scala or Python.
  • Experience in machine learning workloads is a plus
  • Experience in supporting and working with product managers, decision scientists and data analysts in a dynamic environment

Company info

About Jumbotail Technologies Private Limited

Jumbotail is India's leading B2B marketplace and New Retail platform, serving lakhs of mom & pop stores (“Kiranas”). Jumbotail helps retailers by providing them doorstep delivery for all their food and grocery needs with the help of its own supply chain and logistics delivery network built on top of cutting

More jobs at Jumbotail Technologies Private Limited