Robotics Perception Engineer, Vision Models & Mapping
- Toronto, ON, Canada
- Greater Toronto Area, Canada, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Full time position
At Ndimensions, we're inventing the infrastructure for next-generation robotics AI systems. Almost everything our robots know about the world starts as pixels from a camera, and so do most of the hard problems we have left.
We're looking for a Robotics Perception Engineer to own that layer. This role sits between our AI and navigation teams, working on the vision problems both depend on: whether the robot is really picking up the object it was asked to, whether it can find an object described in plain language, whether perception is fast enough to run on the robot itself, and whether the cameras are calibrated well enough to trust. It is a hands-on role on real hardware in real homes.
What You'll Do
We're looking for engineers who want robots to see reliably in real homes, not just on benchmarks.
Please include links to relevant work (papers, repos, demos) in your application.
← Back to All Positions
- Boston, MA or Toronto, ON
At Ndimensions, we're inventing the infrastructure for next-generation robotics AI systems. Almost everything our robots know about the world starts as pixels from a camera, and so do most of the hard problems we have left.
We're looking for a Robotics Perception Engineer to own that layer. This role sits between our AI and navigation teams, working on the vision problems both depend on: whether the robot is really picking up the object it was asked to, whether it can find an object described in plain language, whether perception is fast enough to run on the robot itself, and whether the cameras are calibrated well enough to trust. It is a hands-on role on real hardware in real homes.
What You'll Do
- Close the loop between language and pixels: verify that the object the robot grasps is the object it was commanded to grasp, both in recorded training data and live at inference time.
- Ground language in the scene, turning a text query and an RGB-D frame into a pick target or a navigation goal.
- Take our maps from geometric to semantic: build a persistent, object-level representation of a home that the robot can query in language, so a named object resolves to a place it can drive to.
- Give the map a sense of what moves. Classify people, pets, and movable furniture as dynamic or semi-static, so the robot knows which parts of a map to trust and which to expect to have changed.
- Evaluate, optimize, and deploy detection and segmentation models on-robot within a real-time latency budget on embedded GPUs.
- Build vision-based quality checks over our training data: pre-verify episodes, catch mis-routed or dropped camera streams, and redact faces and personal information from what we keep.
- Own camera calibration and rectification across the robot, and the metrics that show depth and localization are good enough to trust.
- Strong background in computer vision for robotics, with real experience on physical systems rather than datasets and simulation alone.
- Experience with vision-language models: grounding text to pixels, and judging whether a model's output actually matches the instruction it was given.
- Experience with semantic or open-vocabulary 3D scene representations: fusing 2D detections into a persistent map and keeping object identity stable across viewpoints and sessions.
- Experience training, fine-tuning, and deploying detection and segmentation models, and optimizing them for real-time inference on embedded hardware.
- Deep hands-on calibration experience and command of the underlying geometry: intrinsics, stereo and multi-camera extrinsics, rectification, hand-eye calibration, projection and back-projection, and frame conventions.
- Practical experience with depth from cameras, classical or learned, and a feel for how depth error propagates downstream.
- Strong Python and working C++, with ROS2 experience on real robots.
- A measurement-first instinct: you define the metric and build the rig before claiming an improvement, and you can design a credible evaluation when no ground truth exists.
- Master's or PhD in Computer Vision, Robotics, Computer Science, or a related field (or equivalent industry experience).
- Publications in vision or robotics venues (CVPR, ICRA, IROS, CoRL), or open-source contributions to vision and calibration tooling.
- Work on vision-language-action policies or other multimodal models for manipulation.
- Experience with visual or visual-inertial odometry and SLAM, or with scene graphs and other queryable map representations.
- Experience building or evaluating multimodal perception for vision-language-action (VLA) policies, including grounding observations and instructions into objects, locations, or manipulation targets.
We're looking for engineers who want robots to see reliably in real homes, not just on benchmarks.
Please include links to relevant work (papers, repos, demos) in your application.
← Back to All Positions
More about this job
Responsibilities
Develop and deploy robotic perception capabilities that ground language in camera data, verify grasped objects, and create persistent semantic maps with dynamic-object awareness. Optimize and evaluate detection and segmentation models on embedded hardware, while owning camera calibration, depth and localization quality checks, and vision-based training-data validation.
Requirements
Candidates should have substantial hands-on computer vision experience on physical robots, including vision-language grounding, persistent 3D scene representations, real-time model deployment, camera geometry and calibration, and camera-based depth estimation. Strong Python, working C++, ROS2 experience, a measurement-first approach, and a master's or PhD in a relevant field or equivalent industry experience are sought.
Skills
- Computer Vision
- Robotics Perception
- Vision-Language Models
- Language Grounding
- 3D Scene Representation
- Object Detection
- Image Segmentation
- Embedded GPU Optimization
- Camera Calibration
- Depth Estimation
- ROS2
- Python
- C++
- Visual Odometry
- SLAM
- Evaluation Metrics
Visa sponsorship
Not detected in the job text
Categories
- Engineering
- Technology
- Software
- Science & Research
Keywords
- Computer Vision
- Robotics
- Robotics Perception
- Vision-Language Models
- Language Grounding
- RGB-D
- Semantic Mapping
- Open-Vocabulary 3D Scene Representations
- Object Detection
- Image Segmentation
- Embedded GPUs
- Real-Time Inference
- Camera Calibration
- Camera Rectification
- Stereo Calibration
- Multi-Camera Extrinsics
- Hand-Eye Calibration
- Depth Estimation
- ROS2
- Python
- C++
- Visual Odometry
- Visual-Inertial Odometry
- SLAM
- Scene Graphs
- Data Quality Checks
- Privacy Redaction
- Model Evaluation
- Robot Manipulation