Senior Python Developer - Data Lineage & Gen AI - 8+ Years

Role: Senior Python Developer - Data Lineage & Gen AI

Location: Mississauga, Canada

Visa

Salary Expectation

Job Summary: We are seeking a hands-on Python Developer to design and build scalable data lineage solutions that parse and analyze large, multi-language codebases to generate accurate, column-level data lineage. The role combines strong Python engineering, software architecture, data flow analysis, and hands-on Gen AI/LLM experience.

The ideal candidate should have expertise in developing reusable libraries, executable applications, event-driven frameworks, design patterns, APIs, databases, and graph-based technologies.

Required Technical Skills:

• Strong Python development skills with expertise in object-oriented and functional programming.

• Ability to develop core libraries, reusable components, and executable applications using Python.

• Strong understanding of software architecture, event-driven frameworks, and design patterns.

• Proficiency in data structures, algorithms, and complexity analysis.

• Experience with Oracle Database, SQL, API development, and backend services.

• Knowledge of Graph APIs, Graph Databases, graph algorithms, and traversal techniques.

• Experience with data lineage, data flow analysis, AST-based parsing, and static code analysis.

• Ability to parse and analyze source code across multiple programming and query languages.

• Hands-on Gen AI/LLM experience, including prompt engineering, tool/function calling, and agent orchestration.

• Understanding of Retrieval-Augmented Generation (RAG), vector databases, and semantic search.

• Experience designing APIs, backend services, and basic front-end interfaces.

• Knowledge of CI/CD, build automation, testing, deployment, and production support.

• Strong data manipulation and transformation skills.

Key Responsibilities:

• Design and develop Python-based engines to parse multiple programming and query languages and generate accurate, column-level data lineage.

• Build reusable Python libraries and scalable components for code parsing, analysis, and dependency tracking.

• Develop Gen AI/LLM-powered retrieval and assistant capabilities using lineage and metadata.

• Build backend services, APIs, and interfaces to expose data processing and lineage insights.

• Extend parsing and analysis capabilities to support new languages and frameworks.

• Design and implement graph-based dependency and lineage tracing solutions.

• Own build, testing, deployment, CI/CD, and production support across environments.

• Write automated tests and maintain software quality throughout the development lifecycle.

• Collaborate on architecture and design reviews and translate complex requirements into maintainable solutions.

Engineering Expectations:

• Follow clean architecture, separation of concerns, and reusable design principles.

• Build deterministic, testable solutions with AI outputs grounded in verifiable data.

• Optimize performance, memory usage, and algorithmic efficiency.

• Design extensible systems that support new languages, data sources, and capabilities.

• Implement robust error handling, fault isolation, and maintainable code.

Nice to Have:

• Knowledge of data governance, metadata management, and data cataloging.

• Experience with long-running or asynchronous workloads.

• Familiarity with infrastructure automation and deployment tools.