4Bell Technology

Staffing & Recruiting

Big Data Engineer(R-1888)

1,000,000.00-1,200,000.00/A

Any Degree

IT (Information Technology)

Contract

Hyderabad

13-Sep-2026

Big data Engineer Python Pyspark SQL Hadoop Apache Spark/Hive ETL Data Pipeline/data modeling Apache Kafka/Spark streaming Azure/Aws/GCP

Job Description

Key Responsibilities

  • Design and develop scalable batch and real-time data ingestion pipelines.
  • Build ETL/ELT workflows using Apache Spark, PySpark, and Hadoop technologies.
  • Develop and optimize data processing pipelines for analytics and machine learning.
  • Implement streaming solutions using Kafka, Spark Streaming, or Event Hubs.
  • Build and maintain Data Lake solutions on Azure, AWS, or GCP.
  • Optimize Spark jobs, SQL queries, and distributed workloads for performance.
  • Ensure data quality, governance, monitoring, and production support.
  • Collaborate with cross-functional teams to deliver scalable enterprise data solutions.

Mandatory Skills

  • Python, PySpark, SQL
  • Apache Spark
  • Hadoop Ecosystem (HDFS, Hive, YARN)
  • Apache Kafka
  • ETL/ELT & Data Pipeline Development
  • Distributed Computing
  • Databricks
  • Cloud Platforms: Azure (preferred) / AWS / GCP
  • Git & CI/CD