4Bell Technology

Job Description

Role:

As a Senior Data/AI Engineer, you will design and build connectors that discover and ingest metadata from data and AI platforms into an enterprise-grade SaaS platform in the data privacy, data governance and AI governance space. You will define how data from external systems maps to the platform’s data models, set ingestion patterns, and guide a team of Data/AI Engineers.

Key Responsibilities:

·       Design connectors for data and AI platforms (e.g., Snowflake, Databricks, BigQuery, AWS SageMaker, AWS Bedrock, Azure ML, Azure OpenAI) to discover data and AI assets.

·       Define how source metadata (datasets, schemas, models, pipelines, agents and lineage) maps to the platform’s data models.

·       Establish reusable ingestion patterns: full and incremental sync, pagination, rate limiting, retries, error handling and scheduling.

·       Build and review connector code in Python and/or Java.

·       Provide technical guidance and code reviews for Data/AI Engineers.

·       Ensure data quality, security and least-privilege access in connector design.

·       Work with the AI Architect and Tech Leads on connector architecture and design reviews.

·       Write technical documentation and connector specifications.

What You’ll Bring:

·       Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent experience.

·       5–8 years of experience in data engineering or integration engineering, including at least 2 years building connectors or ingestion pipelines.

·       Strong programming skills in Python and/or Java.

·       Hands-on experience with cloud data and AI platforms.

Mandatory Skills:

·       Strong proficiency in Python (and/or Java) for building data integration services.

·       Experience with REST and GraphQL APIs, SDKs, and OAuth2 or service-principal authentication.

·       Hands-on experience with at least two of: Snowflake, Databricks, BigQuery, Redshift or Azure Synapse.

·       Exposure to AI/ML platforms such as AWS SageMaker, AWS Bedrock, Azure ML, Azure OpenAI or Vertex AI.

·       Strong skills in data modeling, metadata management, schema mapping and transformation.

·       Strong SQL skills.

·       Experience with AWS and Azure services (IAM, S3/ADLS, Lambda/Azure Functions).

·       Familiarity with automated testing, Git and CI/CD pipelines.

Good to Have:

·       Experience with data catalog and lineage tools such as Unity Catalog, Microsoft Purview, Collibra or OpenLineage.

·       Experience with Apache Spark or Kafka.

·       Domain knowledge of data privacy or data/AI governance.