Research Engineer – Multimodal AI & Interaction
- Markham, ON, Canada
On-site
The total target annual compensation for this position ranges from $106,000 - $156,000 depending on education, experience, and demonstrated expertise. · Full-time
Applications open in a new tab.
Job details
- Pay
- The total target annual compensation for this position ranges from $106,000 - $156,000 depending on education, experience, and demonstrated expertise.
- Job type
- Full-time
- Workplace
- On-site
- Experience
- 3+ years relevant research or industry experience (including graduate research), with strong Python (Typescript / Kotlin, C++/Java a plus) and collaboration skills across teams
- Posting language
- English
- Posted
Original job description
Huawei Canada has an immediate permanent opening for a Researcher.
About the team:
The Huawei Human-Machine Interaction Lab unites global researchers, engineers, and designers to redefine human technology relationships through user centered, hands on research. We focus on agentic AI and multimodal interaction (voice, touch, vision, gesture) across smartphones, wearables, and emerging devices - advancing agentic workflows, multi-agent orchestration, and intuitive human-AI interfaces. By tightly integrating sensing, algorithms, and systems, our prototype driven work ships directly to products, enabling seamless task delegation and human AI collaboration at scale.
About the job:
Research, design, and build next-generation multimodal AI capabilities for intelligent consumer devices, spanning speech/audio, vision, language, touch, gesture, motion, and contextual sensing
Identify high-impact research problems and own projects from early exploration through model development, evaluation, and product-oriented validation
Design, train, fine-tune, and evaluate deep learning and foundation models for multimodal perception, reasoning, interaction, and generation
Develop new approaches for reasoning across modalities to enable more natural, adaptive human-machine interaction
Rapidly prototype research ideas, reproduce state-of-the-art methods, and evolve promising concepts into robust demonstrations
Build datasets and evaluation methodologies, run rigorous experiments, and establish metrics reflecting both model performance and real interaction quality
Optimize models for real-world constraints (latency, memory, power, privacy, robustness, on-device vs. cloud) and collaborate across research, engineering, and product teams
Contribute reproducible code, documentation, and IP through publications, patents, or open-source projects when appropriate
The total target annual compensation for this position ranges from $106,000 - $156,000 depending on education, experience, and demonstrated expertise.
About the ideal candidate:
Master's or PhD in CS, EE/CE, AI, ML, Statistics, Math, HCI, or related field (exceptional Bachelor's candidates considered)
Strong foundation in ML/deep learning with hands-on experience in PyTorch, TensorFlow, JAX, or similar
Technical depth in multimodal learning, speech/audio, computer vision, NLP, generative AI, or foundation models
Experience with LLMs/VLMs, agentic AI, multi-agent systems, or context-aware intelligent systems is a strong asset
Track record turning research into working systems: prototypes, open-source, patents, publications, or shipped products
End-to-end ML development experience: data prep, training, evaluation, debugging, optimization, deployment
Understanding of practical AI trade-offs (quality, latency, compute, memory, robustness) and on-device/resource-constrained deployment
3+ years relevant research or industry experience (including graduate research), with strong Python (Typescript / Kotlin, C++/Java a plus) and collaboration skills across teams
Additional Information:
Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.
All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.
More about this job
Responsibilities
The Research Engineer at Huawei will design, train and evaluate multimodal AI models, prototype research ideas, and take projects from early exploration to working demonstrations. The role also covers building datasets, running experiments and optimizing models for real devices.
Requirements
Candidates need a Master's or PhD in a related field (strong Bachelor's considered), 3+ years of research or industry experience, and hands-on deep learning skills in PyTorch, TensorFlow or JAX. Experience with multimodal learning, LLMs or on-device deployment is a strong asset.
Skills
- Python
- PyTorch
- TensorFlow
- JAX
- Deep learning
- Multimodal learning
- Speech and audio processing
- Computer vision
- Natural language processing
- Generative AI
- Foundation models
- Large language models
- Vision-language models
- Agentic AI
- Multi-agent systems
- Model evaluation
- Dataset construction
- Prototyping
- Model optimization
- On-device deployment
- Human-computer interaction
- Research reproduction
- Scientific writing
- Typescript
- Kotlin
Categories
- Technology
- Software
- Data & Analytics
Keywords
- multimodal AI
- deep learning
- machine learning
- PyTorch
- TensorFlow
- JAX
- foundation models
- LLM
- VLM
- agentic AI
- multi-agent systems
- computer vision
- speech
- audio
- NLP
- generative AI
- on-device AI
- Python
- human-computer interaction
Seniority
Mid level
Tools
- PyTorch
- TensorFlow
- JAX
- Python
Languages
- English
Fields of study
- Computer Science
- Electrical Engineering
- Artificial Intelligence
- Machine Learning
- Statistics