Role Overview:
We are seeking a hands-on Data Engineer with 5+ years of experience to design and deliver scalable data integration solutions. The ideal candidate has strong expertise in Databricks, PySpark, SQL and Python, with proven experience transforming data into complex JSON structures and integrating with Reltio MDM through REST APIs. The role focuses on building dependable ETL/ELT pipelines, ensuring data quality and supporting accurate master data ingestion.
About Teqfocus:
Teqfocus is a Data and AI company that helps enterprises build and scale the Agentic Enterprise - connecting the data foundation, the intelligence layer, and the applications teams run their businesses on into a single, coherent architecture.
As a Salesforce Summit Partner, we work in Healthcare, Life Sciences, Financial Services, Insurance, and Hi-Tech - industries where getting AI right matters and the tolerance for failure is low. Our delivery model is senior-heavy by design. The same team that scopes an engagement ships it to production. There are no junior shadow teams, no sub-contractors brought in when the problem gets hard, and no hand-off to a separate managed services vendor when the project closes.
We run an internal innovation practice that builds the reusable patterns, pre-tested architectures, and industry-specific frameworks that give every Teqfocus client a head start - and give every Teqfocus practitioner work that compounds over time.
We are a diverse, immigrant-entrepreneurial company. We were built on the conviction that the best outcomes come from people who take genuine ownership of what they build - and are trusted to do so.
www.teqfocus.com
Key Responsibilities:
- Read, extract and process data from Databricks, including Delta Lake tables and data layers, using PySpark and SQL.
- Develop Python transformations to convert structured source datasets into complex, nested JSON payloads aligned to target data models.
- Integrate Databricks and other data platforms with external applications through REST APIs, managing authentication, payloads, response handling, errors and retries.
- Work hands-on with Reltio MDM data models, entity types, attributes and relationships; build and support ingestion through Reltio APIs.
- Design and maintain ETL/ELT pipelines for bulk and incremental loads, including source-to-target mapping, validation and reconciliation.
- Implement robust logging, exception handling, data-quality checks and troubleshooting across integration and ingestion workflows.
Required Skills & Qualifications:
- 5+ years of professional experience in data engineering, data integration or ETL/ELT development.
- Databricks & PySpark: Hands-on experience extracting, reading and processing data from Databricks (Delta Lake/data layers) using PySpark and SQL.
- Python & JSON: Strong Python proficiency building transformations from structured datasets into complex, nested JSON payloads based on target data models.
- REST API Integration: Practical experience integrating data platforms with external systems using REST APIs, including authentication, payload handling, error management and retry mechanisms.
- Reltio MDM: Hands-on knowledge of its data model, entity types, attributes, relationships and data ingestion APIs.
- ETL/ELT Pipeline Development: Experience building robust pipelines with bulk and incremental loads, source-to-target data mapping, validation, reconciliation and error handling.
- Strong SQL skills, data troubleshooting capabilities and ability to collaborate across engineering and business teams.
Good to Have:
- Experience with Databricks workflows/jobs, Spark optimization and pipeline monitoring.
- Familiarity with MDM match/merge, survivorship rules, data governance and master data quality practices.
- Experience working with API-based ingestion at scale and ensuring reliable operational observability.