Technical Lead, Data Ingestion (Tech Lead)
- Montréal-Est, QC, Canada
- Montreal, QC, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Posting language
- English
- Posted
Original job description
Mandate Overview:
- The Tech Lead leads the ingestion POD of the CDAC project,
which integrates several legacy systems and the new group insurance system into
an Azure cloud environment, exposed to users through Power BI. He builds the
complex components, configures ingestion pipelines and takes part in data
loading, while supporting and coordinating developers. Technical governance is
explicit: validating infrastructure configurations (repo, ingestion and
enrichment framework, Synapse and SQL databases, gateways, MFT flows, file
servers), validating access against the security model, refactoring, and
coordinating branches and promotions with the other PODS. The context is
strongly schedule-driven, and the targeted seniority is 8 years and more.
- Target candidate: a senior data developer, 8+ years,
who has led a development team on Azure ingestion pipelines (Data Factory, Data
Lake, Synapse) in a large organization while remaining the main code
contributor. He shows tooled quality practices (TDD, automated testing, CI/CD)
and command of production releases in an environment with standardized
processes.
Requirements
Required:
- Excellent ETL knowledge
- Experience in data projects
- Azure data storage environments (Data Storage, Data Lake,
Blob Storage, Azure Data Factory, Azure SQL Database, Synapse Analytics,
Flyway)
- Relational and dimensional models
- Testing approaches: TDD, user interface testing, automated
testing, continuous integration
- Source control and deployment (GitHub, GitHub Actions,
Concourse)
- Power BI (Desktop, Service, components including gateway)
- Architecture patterns: object-oriented, cloud (IaaS, CaaS,
PaaS, SaaS, iPaaS), application resilience, event-driven
- Functional knowledge
- Soft skills: leadership, resourcefulness, autonomy, teamwork
and task sharing, standardized processes, pleasant personality
Desired:
- Industry knowledge (checked on the form)
- Checked competencies: action-oriented, managing complexity,
results-driven, analysis and synthesis
Asset:
- Domain Driven Design (DDD)
- Security principles and protocols: SSO, Auth0, SAML, OpenID,
JWT, OAuth2, ABAC/RBAC
Profiles to Exclude:
- Profile
mentioning Azure Data Factory or Synapse without an ingestion pipeline built
and deployed in a described mandate.
- BI analyst
or developer profile whose experience is limited to Power BI reports and
dashboards, without ETL development.
- Team lead
or development manager profile without hands-on development in recent mandates.
- Data or
solution architect profile who designs without developing or executing
production releases.
- Profile
whose ETL experience is exclusively on on-premise tools, without a completed
Azure project.
- Profile
without demonstrated automated testing or continuous integration practice in a
mandate.
More about this job
Responsibilities
The Technical Lead will manage the ingestion POD for the CDAC project, overseeing the integration of legacy and insurance systems into an Azure cloud environment. They are responsible for building complex components, configuring ingestion pipelines, and providing technical governance across infrastructure and security models.
Requirements
The ideal candidate is a senior data developer with over 8 years of experience leading development teams on Azure ingestion pipelines. Proficiency in ETL, TDD, CI/CD, and relational/dimensional modeling is required, along with strong leadership and analytical skills.
Skills
- Azure Data Factory
- Azure Synapse Analytics
- ETL
- Data Ingestion
- SQL
- Power BI
- TDD
- CI/CD
- GitHub
- Data Lake
- Azure SQL Database
- Flyway
- Relational Modeling
- Dimensional Modeling
- Leadership
- Automated Testing
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Management & Leadership
- Engineering
Keywords
- Azure
- Data Ingestion
- ETL
- Synapse Analytics
- Data Factory
- Data Lake
- Power BI
- SQL
- TDD
- CI/CD
- GitHub Actions
- Concourse
- Flyway
- Cloud Architecture
- IaaS
- PaaS
- SaaS
- iPaaS
- Event-driven
- Domain Driven Design
- SSO
- Auth0
- SAML
- OpenID
- JWT
- OAuth2
- ABAC
- RBAC
- Technical Lead
- Data Engineering