4Bell Technology
Data Engineer(R-2088)
1,000,000.00-1,100,000.00/A
Any Degree
IT (Information Technology)
Contract
Bangalore/Bengaluru
30-Oct-2026
Data Engineer Databricks PySpark SQL SAP data integration ETL/ELT pipelines Medallion Architecture Data Lake / Data Warehouse Azure / AWS Power BI
Job Description
Key Responsibilities:• Set up and configure Databricks environment from scratch.
• Develop direct and indirect data integration methods from SAP to Databricks.
• Create automated and continuous data pipelines from SAP ERP and other applications.
• Design and manage structured data architecture in Databricks.
• Build data lake/medallion architecture (Bronze, Silver, Gold layers).
• Develop ETL/ELT processes for data cleansing, transformation, and optimisation.
• Enable real-time or scheduled data refresh for analytics usage.
• Integrate Databricks data with Power BI for reporting and dashboards.
• Optimize data models for business, sales, aftermarket, inventory, and operational analytics.
• Implement data governance, security, and access management.
• Monitor data quality, performance, and pipeline stability.
• Support future AI, automation, and advanced analytics initiatives
Key Skills & Competencies
• Strong experience with Databricks
• Experience integrating SAP ERP data with external data platforms
• Knowledge of SAP data extraction methods: o SAP BW o SAP HANA o SAP Tables o SAP APIs / OData o SAP SLT o SAP Data Services
• Strong SQL and PySpark knowledge • Experience with cloud platforms (Azure, AWS, Cloud)
• Experience in data modeling and data warehouse concepts
• Knowledge of ETL/ELT pipeline development
• Experience connecting Databricks with Microsoft Power BI
• Understanding of automation, scheduling, and monitoring tools