AI Architect

Enterprises are past the point of asking whether AI belongs in their systems. The question now is which AI capabilities should exist, how much autonomy each one earns, how they integrate with systems of record and real business processes, and how anyone will know they are working. Answering those questions well, and writing the answers down so that engineering teams and coding agents can build against them, is the AI Architect's job.

You will design the target architecture of AI-native applications, Enterprise AI and Applied AI solutions for large clients across industries, from assistants and RAG systems to agents, agentic workflows and autonomous components. You will decide what the system should do and, just as importantly, what it should not. You will define the evaluations, guardrails, and constraints that shape what gets built, whether the builder is an engineer or an AI coding agent.

This is an architecture role. The output is decisions, structure, and the reasoning behind them- AI, not code volume. You will still prototype when a decision needs evidence, but most of your time goes to framing problems, resolving conflicting requirements, making trade-offs explicit, and getting the right people to own them.

Req# 1090267686

The recruiting efforts for this position are intended to fill an existing vacancy for a new position.

Responsibilities

• Design end-to-end architectures for AI-native solutions: orchestration, retrieval, tool and system integration, agent autonomy and guardrails, identity and authorization, evaluation, observability, and cost model
• Fit each solution exactly to the business scope AI no more, no less AI and be able to explain what you deliberately left out and why
• Turn incoherent or contradictory requirements into explicit business decisions: surface them, reframe them in business terms, price the options, and get a named owner to decide
• Make and document architectural trade-offs (build vs. buy, model selection, retrieval strategy, autonomy level, cost vs. quality) in a form that stakeholders can challenge and future teams can trust
• Define the evaluation strategy for each system: how we will know that an assistant or agent fits the business scope, not just that it produces fluent output
• Author the constraints, guidelines, and architectural fitness functions that engineering teams and coding agents build within, and revise them as the organization learns what generation gets wrong
• Decide where humans must stay in the loop AI regulated decisions, data of record, security boundaries, anything with legal or contractual consequence
• Work within EPAM delivery teams and in presales: shape proposals, present options and costs to client executives, and review designs across teams
• Build proofs of concept and reference implementations when, and only when, a decision needs evidence or a team needs an example of "good"
• Contribute to EPAM's AI architecture practice: reference architectures, reusable patterns, and mentoring architects who are transitioning into AI-native design
  
  

Requirements

• You have architected AI-native systems in production AI RAG, assistants, agents or agentic workflows with real users or real business processes behind them AI and you held architect-level responsibility for the system around the model
• You are a proven solution or software architect with a strong production track record who has started building with AI on your own initiative in the last year or so AI a side project, a proof of concept, an internal tool, published writing AI and wants to make AI-native design the center of your work
• Solid experience as a solution, software, or enterprise architect with delivery accountability: systems you designed that shipped, ran, and were maintained over time
• Depth in distributed systems, integration, cloud, and data-flow architecture at enterprise scale
• Demonstrated ability to work with ambiguous, conflicting requirements and to make trade-offs explicit rather than resolving them silently
• Experience presenting options, costs, and risks to non-technical decision makers and getting decisions made
• A habit of writing things down: architecture decision records, design documents, reference architectures that other teams built from
• Recent hands-on coding ability, enough to prototype and to keep your constraints honest
• Understanding of how AI-assisted development changes the architect's role: what to specify, what to evaluate, and where to keep human judgment
  
  

Nice to have

• Experience in regulated industries AI financial services, healthcare and life sciences, insurance
• Agent frameworks, tool and function calling, MCP, orchestration patterns, LLM observability
• Identity and authorization for agentic systems (OAuth 2.1, SPIFFE, AuthZEN, DPoP)
• Ownership of cost and token economics for a production AI system
• Consulting or pre-sales experience
• Published writing, talks, or open-source contributions on AI architecture
  
  

We offer

• Extended Healthcare with Prescription Drugs, Dental and Vision, and Healthcare Spending Account (Company Paid)
• Life and AD&D Insurance (Company Paid)
• Employee Assistance Program (Company Paid)
• Telehealth (Company Paid)
• Short-term Disability (Company Paid)
• Long-Term Disability
• Paid Time Off (including vacation and sick days)
• Registered Retirement Savings Plan (RRSP) with Company match
• Maternity/Parental/Adoption Leave Top-up
• Employee Stock Purchase Program
• Critical Illness Insurance
• Employee Discounts
• Unlimited access to LinkedIn learning solutions
  
  

An artificial intelligence system is software that is developed with one or more techniques that can, for a given set of human-defined objectives, using algorithmic information processing, generate outputs such as content, predictions, recommendations, or decisions with varying levels of autonomy (“AI”). Tasks that humans have traditionally done by thinking and reasoning are increasingly being done by, or with the help of, AI to help create efficiencies.EPAM may use AI during the recruitment process, in connection with collecting or processing your personal data. Some (non-exhaustive) examples of tasks that EPAM may use AI for include conducting initial screening, creating transcripts of interviews, and assessing applications/CVs against defined job description criteria to make suggestions to the individuals evaluating your candidacy.Your personal data and the results of any processing are not shared with AI applications outside of EPAM infrastructure. While EPAM may use AI to help create efficiencies during the recruitment process, EPAM does not use AI to make hiring decisions, which is done by EPAM Talent Acquisition and management.

EPAM Canada welcomes and encourages applications from candidates with disabilities. Please contact WFA Human Resource CA WFAHRCA@epam.com if you have questions in this regard, or if you require an accommodation to complete the application process. Click here to review EPAM’s Accessibility for Ontarians with Disabilities Accessibility Policies and Multi-Year Access.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our clients, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

Engineer the Future with a Career at EPAM