Senior AI Engineer Java
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Experience
- 6-10 years of experience building production software, including recent hands-on delivery of AI or large language model (LLM) systems beyond prototype stage.
- Posting language
- English
- Posted
Original job description
Position Summary
We are seeking an experienced and highly motivated Senior AI Engineer to join the Canada Segments Technology Strategy team. This role will accelerate business and technology transformation initiatives by designing, building, and operating AI systems that enable end-to-end customer experiences, increase straight-through processing, and optimize the overall technology portfolio. The successful candidate will work closely with engineering and business partners to deliver AI systems that are accurate, explainable, safe to operate, and business-ready.
Required Experience & Skills
6-10 years of experience building production software, including recent hands-on delivery of AI or large language model (LLM) systems beyond prototype stage.
Strong JVM engineering experience with Java (Kotlin or Scala preferred).
Solid Software Engineering Practices Including
Agentic systems
Knowledge graphs
AI-enabled document generation and rendering
Cloud infrastructure
AI service stack
CI/CD
Observability
Key Responsibilities
Orchestrate LLMs and tools including retrieval, calculations, rules, and structured extraction into reliable and traceable workflows.
Engineer prompts and structured-output contracts to ensure validated, machine-usable outputs.
Build on event-sourced service frameworks (e.g., Akka SDK) where state, decisions, and evidence are persisted throughout the workflow.
Build ingestion and extraction pipelines that transform raw documents into validated, queryable graph structures.
Ensure every fact is traceable to its source.
Implement graph-based and vector retrieval techniques, including GraphRAG and embeddings, to provide grounded responses.
Integrate with MCP-compatible clients and low-code agent platforms, including Microsoft Copilot Studio agents.
Build conversational interfaces that answer questions strictly from grounded knowledge graph data.
Build Automated Evaluation Frameworks, Including
Section-level scoring
Regression testing
Edge-case coverage
Human-review rubrics
Implement guardrails for prompt injection, data minimization, and safe output generation.
Incorporate human-in-the-loop checkpoints and governance evidence required for AI reviews.
Build and maintain CI/CD pipelines, environment configurations, secrets management, and access controls.
Work With Enterprise AI Platform Services, Including
Managed model endpoints
Search and retrieval services
Document storage
OCR/document intelligence solutions
Graph databases
Implement logging, metrics, tracing, monitoring, and alerting to support production operations.
Preferred Background
Experience delivering enterprise-scale AI systems in production environments.
Experience integrating AI capabilities into business workflows and customer-facing experiences.
Strong collaboration skills with both technical and business stakeholders.
Passion for innovation, continuous improvement, and responsible AI practices.
We are seeking an experienced and highly motivated Senior AI Engineer to join the Canada Segments Technology Strategy team. This role will accelerate business and technology transformation initiatives by designing, building, and operating AI systems that enable end-to-end customer experiences, increase straight-through processing, and optimize the overall technology portfolio. The successful candidate will work closely with engineering and business partners to deliver AI systems that are accurate, explainable, safe to operate, and business-ready.
Required Experience & Skills
6-10 years of experience building production software, including recent hands-on delivery of AI or large language model (LLM) systems beyond prototype stage.
Strong JVM engineering experience with Java (Kotlin or Scala preferred).
Solid Software Engineering Practices Including
- Git workflows
- Code reviews
- Automated testing
- Structured logging
- Clean design principles
- Prompt engineering
- Structured/JSON outputs
- Tool and function calling
- Retrieval-Augmented Generation (RAG)
- Agentic workflows
- Neo4j and Cypher, and/or
- MongoDB Atlas
- Experience with vector search and embeddings for semantic retrieval.
Agentic systems
Knowledge graphs
AI-enabled document generation and rendering
Cloud infrastructure
AI service stack
CI/CD
Observability
Key Responsibilities
- Design and Build Agentic Analysis Workflows
Orchestrate LLMs and tools including retrieval, calculations, rules, and structured extraction into reliable and traceable workflows.
Engineer prompts and structured-output contracts to ensure validated, machine-usable outputs.
Build on event-sourced service frameworks (e.g., Akka SDK) where state, decisions, and evidence are persisted throughout the workflow.
- Build and Operate the Knowledge Graph
Build ingestion and extraction pipelines that transform raw documents into validated, queryable graph structures.
Ensure every fact is traceable to its source.
Implement graph-based and vector retrieval techniques, including GraphRAG and embeddings, to provide grounded responses.
- Expose Capabilities Through Open Agent Interfaces
Integrate with MCP-compatible clients and low-code agent platforms, including Microsoft Copilot Studio agents.
Build conversational interfaces that answer questions strictly from grounded knowledge graph data.
- Establish Grounding, Evaluation, and Safety Standards
Build Automated Evaluation Frameworks, Including
Section-level scoring
Regression testing
Edge-case coverage
Human-review rubrics
Implement guardrails for prompt injection, data minimization, and safe output generation.
Incorporate human-in-the-loop checkpoints and governance evidence required for AI reviews.
- Production Deployment and Operations
Build and maintain CI/CD pipelines, environment configurations, secrets management, and access controls.
Work With Enterprise AI Platform Services, Including
Managed model endpoints
Search and retrieval services
Document storage
OCR/document intelligence solutions
Graph databases
Implement logging, metrics, tracing, monitoring, and alerting to support production operations.
Preferred Background
Experience delivering enterprise-scale AI systems in production environments.
Experience integrating AI capabilities into business workflows and customer-facing experiences.
Strong collaboration skills with both technical and business stakeholders.
Passion for innovation, continuous improvement, and responsible AI practices.
More about this job
Responsibilities
Design and build agentic AI analysis workflows and maintain a knowledge graph for grounded data retrieval. Develop agent interfaces and implement safety standards to ensure accurate, traceable, and hallucination-free AI outputs.
Requirements
Requires 6-10 years of production software experience with a strong background in JVM languages and hands-on delivery of LLM systems. Expertise in GenAI patterns, graph databases, and cloud infrastructure is essential.
Skills
- Java
- Kotlin
- Scala
- Large Language Models
- Prompt Engineering
- Retrieval-Augmented Generation
- Agentic Workflows
- Neo4j
- Cypher
- MongoDB Atlas
- Vector Search
- Knowledge Graphs
- CI/CD
- Git
- Model Context Protocol
- Automated Testing
Visa sponsorship
Not detected in the job text
Categories
- Software
- Technology
- Engineering
- Data & Analytics
- Consulting
Keywords
- AI Engineer
- Java
- Kotlin
- Scala
- LLM
- GenAI
- RAG
- Agentic Systems
- Neo4j
- Cypher
- MongoDB Atlas
- Vector Search
- Embeddings
- Knowledge Graph
- GraphRAG
- MCP
- Microsoft Copilot Studio
- Akka SDK
- CI/CD
- Observability
- Prompt Injection
- Data Minimization
- OCR
- Document Intelligence
- Git
- Automated Testing
- Clean Design
- Event-Sourcing
- Enterprise AI
- Software Engineering