Role Overview
We are looking for an experienced Data Engineer to join our Data Platform team. The candidate will work on building and maintaining scalable data pipelines and solutions using Azure Data Services.
About Abgcareers
Aditya Birla Group is a leading multinational conglomerate operating in various sectors, including manufacturing, services, and digital initiatives.
Key Responsibilities
- Design, develop, and maintain data pipelines using Azure Data Factory (ADF)
- Manage and optimize data storage in Azure Data Lake Storage (ADLS)
- Implement transformations and data processing using Azure Databricks (PySpark/SQL)
- Ensure data quality, integrity, and security across all Medallion layers (Bronze, Silver, Gold)
- Work closely with business teams to gather requirements and translate them into technical solutions
- Collaborate with cross-functional teams (BI, Application Owners, Infra) and external implementation partners
Requirements & Eligibility
- Strong experience in Azure Data Factory, Azure ADLS, Azure Databricks (PySpark, SQL)
- Good understanding of data modeling (Star/Snowflake schema) and data warehousing concepts
- Hands-on experience with Power BI integration and enabling data for reporting
- Hands-on experience in creating optimized SQL queries and developing efficient scripts using PySpark for large-scale data processing
- Familiarity with CI/CD for data pipelines and DevOps practices
- Strong problem-solving skills and ability to work in an agile environment
Required Skills & Tech
Azure Data FactoryAzure ADLSAzure DatabricksPySpark