Senior Data Engineer
Barclays · pune, India
pythonjavaawssparkdata-pipelinesdata-lakesdata-warehousingairflowmachine-learningdata-qualityexperienced
Job Description
As a Senior Data Engineer at Barclays, you will architect and implement high-performance data pipelines and flows for low-latency insights. This role involves handling large-scale data ingestion and processing, optimizing the data lifecycle, and collaborating with data scientists to deploy machine learning models. You will work with AWS services and distributed processing engines like Spark to ensure data quality and efficiency.
Qualifications
Extensive experience in data engineering, proficiency in Python and Java, strong knowledge of AWS and distributed processing engines.
Skills Required
- python
- java
- aws
- spark
- data-pipelines
- data-lakes
- data-warehousing
- airflow
- machine-learning
- data-quality
Location
City: pune · Country: India