- Experience
- 3 – 5 years
- Pay
- Not disclosed
- Education
- Bachelor’s degree in computer science, Data Engineering, Information Systems, Engineering, Mathematics, or related field
- Location
- Hyderabad, India
- Work mode
- On-site
- Job type
- Full-time
About this role
Amgen is a biotechnology company that discovers, develops, manufactures and delivers innovative medicines. The Associate Data Engineer develops, tests, and maintains data pipelines using Databricks, PySpark, and Python to support analytics, reporting, and machine learning use cases.
What you will do
- Develop, test, and maintain data pipelines using Databricks, PySpark, and Python
- Ingest, transform, and process structured and semi-structured data
- Support development of scalable ETL/ELT workflows
- Work with data engineers, analysts, and data scientists on data requirements
- Perform data cleansing, validation, and quality checks
- Optimize Spark jobs and Databricks notebooks
- Create and maintain documentation for data pipelines and processes
- Assist in troubleshooting pipeline failures and performance bottlenecks
- Follow best practices for version control, code quality, testing, and deployment
- Support basic AI/ML data preparation activities
- Monitor scheduled jobs and workflows
- Collaborate in Agile or iterative development environment
What the employer expects
- Hands-on experience with Python for data processing, scripting, and automation
- Strong working knowledge of PySpark and distributed data processing
- Proven hands-on experience using Databricks including notebooks, clusters, jobs, workflows, Delta tables
- Ability to build, maintain, and troubleshoot scalable ETL/ELT pipelines in Databricks
- Experience working with Delta Lake and lakehouse architecture
- Working knowledge of SQL
- Ability to work with structured and semi-structured data formats
- Understanding of data engineering concepts
- Basic understanding of AI and machine learning concepts
- Familiarity with cloud-based data platforms
- Understanding of Git
Skills
- Python
- PySpark
- Databricks
- SQL
- Delta Lake
- ETL/ELT
- Git
- AWS
- Azure
- GCP
Apply on the employer's site
The application opens on Amgen careers. Dev Portal Notes does not collect your application or charge a fee.
Know someone who fits this role?
Applications are handled on the employer's own site.
Prepare for this role
Close the skill gap
Udemy
The Python Mega Course
Python taught by building real applications, from scripting through web apps and data work.
Get the coursePluralsight
Library of tech courses
Explore expert-led courses on programming, DevOps, AI and more with Pluralsight's monthly plan.
Browse coursesSome links on this page may generate a small commission at no extra cost to you.