capco

Data Engineer - Scala + Spark + Java (Bng & Pune)

Apply Now

At a Glance

Location
India - Bengaluru; India - Chennai ; India - Gurugram; India - Mumbai; India - Pune
Posted
2026-06-19T08:03:19-04:00

Key Requirements

Required Skills

AWSAgileAzureCI/CDDevOpsETLGCPJavaKafkaMicroservicesSQLScalaSpark

Domain Knowledge

  • Finance

Requirements

Proven experience building and supporting

large-scale distributed data processing systems

handling tens of millions of records daily.

Expertise in developing and consuming

Strong understanding of Spark architecture, performance tuning, partitioning, caching, and optimization techniques.

Experience with data modeling, ETL/ELT processes, and large-scale batch and streaming data pipelines.

Responsibilities

Design, develop, and optimize large-scale data processing applications using

Scala, Apache Spark, and Java

Build and maintain high-performance data pipelines capable of processing

80–90 million records daily

with a focus on scalability, reliability, and efficiency.

Develop and integrate

About the Company

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.