Lead AI Engineer
- Montréal, QC, Canada
On-site
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Workplace
- On-site
- Posting language
- English
- Posted
Original job description
About Axya
Axya is building AI-powered technology that's transforming how the manufacturing industry sources and procures parts. Our platform connects manufacturers with suppliers and automates the entire source-to-pay process - from sourcing and quoting to procurement - making it faster, simpler, and more cost-effective for companies sourcing custom parts. By digitizing traditionally manual workflows, Axya enables manufacturers to operate with greater efficiency and competitiveness.
We are proud to cultivate an inclusive and collaborative work environment that fosters innovation, growth, and professional development. As a member of our team, you'll collaborate with passionate, forward-thinking professionals and contribute directly to transforming procurement in the manufacturing sector.
Role Overview
Our product is only as good as the AI behind it. As Lead AI Engineer, you will own the technical direction and quality of Axya's AI systems: how they reason over messy enterprise data, how we measure whether they are right, and how we ship improvements safely to production.
You will report to the CTO and work closely with Product, Customer Success and the engineers who build our platform and integrations. You will be hands-on in the code, and you will also raise the technical bar for the team through architecture, evaluation, code review and mentorship. As the team grows, your scope can grow with it.
What You'll Own
- The architecture of Axya's AI layer: agent and LLM workflows, retrieval, tool use, and how they connect to customer ERP and procurement data.
- Evaluation and quality: build the eval frameworks, test sets and monitoring that tell us whether the copilot is accurate, reliable and improving. Be the person who can say "this is ready" and prove it.
- Production delivery: take AI features from prototype to dependable, observable, cost-aware production systems.
- Model and tooling decisions: choose, benchmark and evolve models, vendors and frameworks, balancing quality, latency, cost and customer data constraints.
- Customer-grade reliability and security: work with the CTO and security lead to meet enterprise expectations on data handling, access control, privacy and auditability.
- Technical standards and mentorship: set engineering practices for AI development and coach other engineers in applied AI.
- Closing the loop with customers: turn real customer usage and failure cases into the next round of improvements.
What We’re Looking For
Must Have
- Experience shipping LLM-based or ML-powered systems to production, with real users and real consequences, not only prototypes.
- Strong software engineering fundamentals: fluency in Python and comfort building and operating backend services.
- Hands-on experience with the core building blocks of applied AI: prompting and tool use, retrieval, agent and workflow orchestration, and evaluation.
- Sound technical judgment: you can make architecture tradeoffs, explain them clearly and own the outcome.
- Technical leadership: setting direction, reviewing others' work, mentoring or leading projects, even without formal reports.
- Clear communication with both engineers and non-technical stakeholders.
Strongly Preferred
- Experience with enterprise or B2B products where reliability, security and customer trust are non-negotiable.
- Experience with messy structured data from ERP, supply chain, procurement, finance or operations systems.
- Experience building evaluation and observability tooling for non-deterministic systems.
- Experience in an early-stage or high-growth environment, or evidence of building something from a blank page.
- Experience managing cost, latency and model-selection tradeoffs at scale.
Nice to Have
- Fine-tuning or model adaptation experience.
- Experience in manufacturing, procurement or supply-chain domains.
- Familiarity with enterprise security and compliance expectations (SOC 2, data residency, etc.).
- Fluency in French.
We do not require a specific number of years, a degree, or a particular employer background. We care about what you have built and what it achieved.
AI & Technology Expectations
You will use AI to build AI. We expect you to use coding assistants, automated evaluation, synthetic test generation and agentic workflows to move faster and raise quality, while applying your own judgment on what to trust. We care about how you multiply your own output and the team's, not which specific tools you favor. We also expect you to keep a clear view of the risks: hallucination, data leakage, drift and cost.
What Success Looks Like
After 30 days
- You understand the current architecture, the main customer use cases and where the AI fails today.
- You have shipped at least one meaningful improvement or fix.
- You have a written assessment of the biggest technical risks and opportunities.
After 90 days
- A baseline evaluation framework is in place and used in release decisions.
- You have led delivery of one major AI feature or re-architecture to production.
- Quality, latency and cost are measured and visible to the team.
After 6 to 12 months
- Accuracy and reliability on core customer workflows have improved by a measurable margin.
- An AI engineering roadmap is co-owned with Product and the CTO.
- Repeatable practices (evals, release process, observability) are followed by other engineers.
- If hiring begins, you have shaped the profile and bar for the next AI and ML hires.
Why Join Axya
- 🏖 Unlimited vacation policy: because we believe in balance.
- 🏥 Comprehensive health insurance: your well-being matters.
- 🕒 Flexible work schedule: results matter more than hours.
- 🏡 100% remote: get the job done wherever you prefer.
- 🚀 Be part of a high-impact, collaborative team making real change in a traditional industry.
More about this job
Responsibilities
The Lead AI Engineer at Axya Inc. will design the architecture of the AI layer, build evaluation and monitoring to prove accuracy, and take AI features into reliable production. The role also sets engineering standards and mentors the team while turning customer usage into improvements.
Requirements
Candidates need experience shipping LLM or ML systems to real users, strong Python and backend skills, and hands-on work with prompting, retrieval, agents and evaluation. Technical leadership, sound architecture judgment and clear communication with non-technical stakeholders are essential.
Skills
- Python
- LLM applications
- Prompt engineering
- Tool use
- Retrieval-augmented generation
- Agent and workflow orchestration
- Evaluation frameworks
- Test set design
- Production monitoring
- Observability
- Backend services
- Model selection and benchmarking
- Cost and latency optimization
- Architecture design
- Code review
- Mentorship
- Data privacy and access control
- Enterprise ERP data
- Procurement data
- Fine-tuning
- Synthetic test generation
- Coding assistants
Benefits
- Unlimited vacation
- Comprehensive health insurance
- Flexible work schedule
- 100% remote work
Categories
- Technology
- Software
- Data & Analytics
- Manufacturing
Keywords
- Lead AI Engineer
- LLM
- large language model
- AI agents
- agent orchestration
- retrieval-augmented generation
- RAG
- prompt engineering
- tool use
- evaluation
- LLM evals
- Python
- backend engineering
- machine learning
- MLOps
- observability
- procurement
- source-to-pay
- supply chain
- manufacturing
Seniority
Lead
Perks
- Generous paid time off
- Flexible hours
- Wellness program
Tools
- Python
Languages
- English