4Bell Technology

Staffing & Recruiting

Data QA & Test Automation(R-1727)

900,000.00-1,000,000.00/A

Any Degree

IT (Information Technology)

Contract

Bangalore/Bengaluru

08-Aug-2026

Database testing SQL BigQuery Python / pytest Cloud Composer GCP data pipelines Dataform Pub/Sub Data pipelines Data warehouses

Job Description

Responsibilities

•       Build and maintain the automated test suite and integrate it into CI/CD as quality gates, so every pipeline is validated automatically on each build and release across Dev and QA.

•       Validate the technical-debt workstreams: standardized metadata columns, CDC / Upsert + History logic, and the Core Framework components (Logging, Heartbeat, Audit, DLQ, Retry).

•       Run end-to-end pipeline validation for all DaaP data products across the data lake zones (Raw → Refined → Curated → Semantic), confirming correct and complete output.

•       Execute source-to-target reconciliation — row-count parity, aggregate / summation checks, and domain-specific reconciliation (e.g., GL vs. subledger for Finance products).

•       Run comparative (before / after) and regression testing to prove the refactored / rebuilt pipelines produce results identical to the legacy pipelines, and to catch regressions on every change.

•       Validate data-quality rules, schema-drift detection, freshness / SLA checks, and error-handling paths (DLQ routing, retries, correlation-ID tracing).

•       Log and track defects, drive P1 / P2 resolution, report coverage and results via dashboards, and provide the go / no-go test sign-off that gates entry into UAT.

Required Skills

•       Strong SQL / BigQuery skills for cross-zone data validation, reconciliation, and analysis (Raw, Refined, Curated).

•       Hands-on experience building automated test frameworks for data pipelines (e.g., Python / pytest, Dataform assertions, the Dual-Mode DQ Runner; familiarity with Great Expectations).

•       Experience testing GCP data pipelines and services: BigQuery, Cloud Composer (Airflow), Cloud Functions, Dataform, Pub/Sub, and GCS.

•       Experience with data reconciliation, regression and comparative testing, CDC validation, and schema-drift / freshness checks.

•       CI/CD test integration with Azure DevOps and GitHub Actions for multi-environment validation.

•       Proficiency in JIRA-based Agile defect management and sprint-based delivery.

8-10 years of QA / test automation experience, including at least 3 years validating cloud-based data pipelines or data warehouses