Data Engineer
CAPCOIndia - BengaluruOn-Site
Estimated salary, not published by the employer: Est. ₹17–25 LPA
Needs a free Superjobs account. You'll finish on CAPCO's Greenhouse page.
Skill score
Summary
The Data Engineer builds and maintains data pipelines and workflows on AWS, using Python and REST APIs to integrate data sources and writing SQL to detect changes in source data. The role suits an engineer with at least 8 years of experience who is comfortable with AWS integration work and collaborates with stakeholders on data requirements.
- Function
- Data Science
- Estimated salary
- Est. ₹17–25 LPA
- Estimated for a mid-level role, ~8 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, India - Bengaluru
- Experience
- 8+ yrs
Job description
Overview
Job Title: Data Engineer
Roles and responsibilities
- Design, develop, and maintain data pipelines and workflows using AWS EventBridge, Step and Lambda Functions, and Secrets Manager.
- Utilize Python as the primary programming language to develop and maintain data applications.
- Implement and manage REST API calls to integrate various data sources and services.
- Collaborate with stakeholders to understand data requirements and deliver solutions.
- Optimize data workflows for performance, scalability, and reliability.
- Ensure data security and compliance by managing secrets and sensitive information using AWS Secrets Manager.
- Monitor and troubleshoot data pipelines to ensure smooth operation and timely data delivery."
Skills required
Top skills
- AWS EventBridge
- AWS Step Functions
- AWS Lambda
- AWS Secrets Manager
All skills (7)
- AWS S3
- Python
- REST APIs
- SQL
- Data modeling
- Data pipelines
- Data transformation
Qualifications
- "Proven experience as a Data/Integration Engineer or in a similar role.
- Strong knowledge of AWS services, particularly EventBridge, Step Functions, S3, AWS Lambda and Secrets Manager.
- Proficiency in Python and experience with REST APIs
- Expertise in writing and optimizing SQL queries to detecting changes in source data
- Experience with data modeling and transformation to meet required web service contracts.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Other details
Location - Bangalore
Experience - 8+ yrs
Company info
About CAPCO
“Capco, a Wipro company, is a global technology and management consulting firm. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors.