- Experience
- 2 – 5 years
- Pay
- Not disclosed
- Education
- Bachelor's or university degree in IT or Engineering, or equivalent experience
- Location
- Pune, India
- Work mode
- On-site
- Job type
- Full-time
About this role
Citi is a global bank. This role is on a Spark-based data platform team. You will build and run data pipelines, watch running jobs, and fix issues when alerts fire.
What you will do
- Build and test PySpark and Spark pipelines for batch and streaming
- Monitor Spark streaming jobs that run through the week
- Monitor hourly Spark batch jobs that write to Hive tables
- Respond to job failure alerts
- Work with Oracle, Hadoop, Impala and SAS data sources
- Set up JDBC connections from SAS, Python and R
- Handle schema and access requests during deployments
- Help retire old applications
What the employer expects
- 2-5 years of relevant experience
- Strong Python and PySpark
- Spark (streaming and batch) in production
- Good SQL with Oracle, Impala and Hive
- Familiarity with Kafka or event-driven systems
- Experience with Autosys or ITRS monitoring
- Knowledge of data governance and security
- Good to have: SAS and GitHub
Skills
- Python
- PySpark
- Apache Spark
- Spark Streaming
- Kafka
- Hive
- Impala
- Oracle
- SQL
- Autosys
Apply on the employer's site
The application opens on Citi careers page. Dev Portal Notes does not collect your application or charge a fee.
Know someone who fits this role?
Applications are handled on the employer's own site.
Prepare for this role
Close the skill gap
Udemy
The Python Mega Course
Python taught by building real applications, from scripting through web apps and data work.
Get the coursePluralsight
Library of tech courses
Explore expert-led courses on programming, DevOps, AI and more with Pluralsight's monthly plan.
Browse coursesSome links on this page may generate a small commission at no extra cost to you.