4Bell Technology

Job Description

·         Hands-on project experience in End-to-End Data Engineering project

·         Build Scalable and cost effective data pipeline in Azure D&A Platform using Pyspark, SQL

·         Worked in Data & Analytics project to migrate from SAP BW Legacy to Azure Data Lake using Pyspark , SQL, Synapse and Datarbricks

·         Ensure compliance with the client’s IT process.

·         Strong verbal and written English language skills

·         Client interaction, Requirement gathering and development

·         Travel to Mumbai during execution as needed

Role and Responsibility:-

·         Perform Discovery and Assessment of existing Legacy Data warehouse

·         Define Data Engineering Migration Approach and Steps to follow

·         Design and develop, scalable data pipelines using Pyspark, SQL, Azure Databricks

·         Build and optimize batch and near real-time data processing solutions.

·         Perform data transformation, cleansing, enrichment, and validation as part of data engineering workflow with data quality checks

·         Perform Deployment, Historical Data Load, Pre vs Post Validation, Parallel Run Validation and Cutover