Back to results

Closed listing

Senior Python Developer - Data Lineage & Gen AI - 8+ Years

  • Mississauga, ON, Canada

Full-time

This opening has closed.

The original listing is kept below for reference.

Open jobs at J2B Global LLC

See all jobs at J2B Global LLC

Similar jobs hiring now

Search current openings

Job details

Job type
Full-time
Closing date
Posting language
English
Posted

Original job description

Archived listing. The details below describe a past opening.

Role: Senior Python Developer - Data Lineage & Gen AI

Location: Mississauga, Canada

Visa

Salary Expectation

Job Summary: We are seeking a hands-on Python Developer to design and build scalable data lineage solutions that parse and analyze large, multi-language codebases to generate accurate, column-level data lineage. The role combines strong Python engineering, software architecture, data flow analysis, and hands-on Gen AI/LLM experience.

The ideal candidate should have expertise in developing reusable libraries, executable applications, event-driven frameworks, design patterns, APIs, databases, and graph-based technologies.

Required Technical Skills:

  • Strong Python development skills with expertise in object-oriented and functional programming.
  • Ability to develop core libraries, reusable components, and executable applications using Python.
  • Strong understanding of software architecture, event-driven frameworks, and design patterns.
  • Proficiency in data structures, algorithms, and complexity analysis.
  • Experience with Oracle Database, SQL, API development, and backend services.
  • Knowledge of Graph APIs, Graph Databases, graph algorithms, and traversal techniques.
  • Experience with data lineage, data flow analysis, AST-based parsing, and static code analysis.
  • Ability to parse and analyze source code across multiple programming and query languages.
  • Hands-on Gen AI/LLM experience, including prompt engineering, tool/function calling, and agent orchestration.
  • Understanding of Retrieval-Augmented Generation (RAG), vector databases, and semantic search.
  • Experience designing APIs, backend services, and basic front-end interfaces.
  • Knowledge of CI/CD, build automation, testing, deployment, and production support.
  • Strong data manipulation and transformation skills.

Key Responsibilities:

  • Design and develop Python-based engines to parse multiple programming and query languages and generate accurate, column-level data lineage.
  • Build reusable Python libraries and scalable components for code parsing, analysis, and dependency tracking.
  • Develop Gen AI/LLM-powered retrieval and assistant capabilities using lineage and metadata.
  • Build backend services, APIs, and interfaces to expose data processing and lineage insights.
  • Extend parsing and analysis capabilities to support new languages and frameworks.
  • Design and implement graph-based dependency and lineage tracing solutions.
  • Own build, testing, deployment, CI/CD, and production support across environments.
  • Write automated tests and maintain software quality throughout the development lifecycle.
  • Collaborate on architecture and design reviews and translate complex requirements into maintainable solutions.

Engineering Expectations:

  • Follow clean architecture, separation of concerns, and reusable design principles.
  • Build deterministic, testable solutions with AI outputs grounded in verifiable data.
  • Optimize performance, memory usage, and algorithmic efficiency.
  • Design extensible systems that support new languages, data sources, and capabilities.
  • Implement robust error handling, fault isolation, and maintainable code.

Nice to Have:

  • Knowledge of data governance, metadata management, and data cataloging.
  • Experience with long-running or asynchronous workloads.
  • Familiarity with infrastructure automation and deployment tools.
More about this job

Responsibilities

Develop Python-based engines and reusable components to parse multiple programming and query languages, analyze dependencies, and produce accurate column-level data lineage. Build AI-powered retrieval capabilities, APIs, and graph-based lineage solutions, while owning testing, deployment, CI/CD, and production support.

Requirements

Requires 8+ years of experience and strong Python engineering skills, including software architecture, algorithms, APIs, databases, graph technologies, and code analysis. Candidates should also have hands-on Gen AI/LLM experience, including prompt engineering and agent orchestration, and knowledge of RAG, vector databases, testing, and deployment.

Skills

  • Python
  • Object-Oriented Programming
  • Functional Programming
  • Data Lineage
  • AST-Based Parsing
  • Static Code Analysis
  • Data Flow Analysis
  • Oracle Database
  • SQL
  • API Development
  • Graph Databases
  • Graph Algorithms
  • Generative AI
  • Large Language Models
  • Retrieval-Augmented Generation
  • CI/CD

Visa sponsorship

Not detected in the job text

Categories

  • Software
  • Technology
  • Data & Analytics
  • Engineering

Keywords

  • Python
  • Data Lineage
  • Column-Level Lineage
  • Data Flow Analysis
  • AST-Based Parsing
  • Static Code Analysis
  • Oracle Database
  • SQL
  • API Development
  • Backend Services
  • Graph APIs
  • Graph Databases
  • Graph Algorithms
  • Generative AI
  • Large Language Models
  • Prompt Engineering
  • Tool Calling
  • Agent Orchestration
  • Retrieval-Augmented Generation
  • Vector Databases
  • Semantic Search
  • Event-Driven Frameworks
  • Object-Oriented Programming
  • Functional Programming
  • CI/CD
  • Build Automation
  • Automated Testing
  • Data Governance
  • Metadata Management
  • Data Cataloging

Report this job

Get in touch
MovoJobs

How can we help?