RQ11828 - Software Developer - Intermediate
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
The Government of Ontario is embarking on a large Data & AI transformation initiative. Core to the transformation is the enablement of the Ontario Data Platform (ODP), which is being developed as the enterprise technology ecosystem for everything Data & AI. ODP is a modern ecosystem of data solution consisting of data ingestion technologies, storage, processing and visualization as well as solutions related to data governance, quality, marketplace, etc. ODP will initially serve all internal government clusters, ministries and program areas, but also external agencies in the future. We are looking for a data scientist to support various initiatives related to the platform as well as the execution of use cases to support the needs of various businesses within the government.
Key Responsibilities
· Run and Monitor Inferences
o Execute batch inference jobs on Databricks and other environments.
o Troubleshoot inference issues, log results, and escalate model anomalies.
· Pipeline & Evaluation Support
o Assist with running DSPy pipelines and loading custom models/configs.
o Support evaluation runs using internal metrics
o Track and summarize performance metrics for inference experiments.
· Data Handling & Experimentation
o Help prepare and clean legal text datasets for inference and evaluation.
o Annotate outputs to support error analysis and benchmarking.
o Maintain reproducible scripts/notebooks for inference runs.
Qualifications
· Background in Computer Science, Data Science, or AI/ML (student or recent grad is good).
· Familiarity with Python and libraries like pandas, scikit-learn, or PyTorch.
· Exposure to LLM frameworks (DSPy, LangChain, Hugging Face, or equivalent).
· Comfortable working with Databricks / MLflow or other cloud ML environments.
· Detail-oriented with strong organizational skills for tracking experiments.
REQUIREMENTS-Must Have:
· Background in Computer Science, Data Science, or AI/ML (student or recent grad is good).
· Familiarity with Python and libraries like pandas, scikit-learn, or PyTorch.
· Exposure to LLM frameworks (DSPy, LangChain, Hugging Face, or equivalent).
· Comfortable working with Databricks / MLflow or other cloud ML environments.
· Detail-oriented with strong organizational skills for tracking experiments.
More about this job
Responsibilities
Run and monitor batch inference jobs, troubleshoot issues, support DSPy pipelines and model evaluations, and track experiment performance. Prepare and clean legal text datasets, annotate outputs for error analysis, and maintain reproducible scripts and notebooks.
Requirements
Candidates must have a background in computer science, data science, or AI/ML, and familiarity with Python and libraries such as pandas, scikit-learn, or PyTorch. They must have exposure to LLM frameworks and cloud ML environments such as Databricks or MLflow, along with strong attention to detail and experiment-tracking organization.
Skills
- Python
- Pandas
- Scikit-Learn
- PyTorch
- DSPy
- LangChain
- Hugging Face
- Databricks
- MLflow
- Batch Inference
- Machine Learning
- Large Language Models
- Data Cleaning
- Experiment Tracking
- Model Evaluation
- Legal Text Data
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Government & Public Sector
- Science & Research
Keywords
- Ontario Data Platform
- Data And AI Transformation
- Data Science
- Artificial Intelligence
- Machine Learning
- Python
- Pandas
- Scikit-Learn
- PyTorch
- DSPy
- LangChain
- Hugging Face
- Databricks
- MLflow
- Batch Inference
- Inference Monitoring
- Model Anomalies
- Pipeline Evaluation
- Performance Metrics
- Legal Text Datasets
- Data Cleaning
- Output Annotation
- Error Analysis
- Benchmarking
- Reproducible Notebooks
- Data Ingestion
- Data Governance
- Data Quality
- Data Visualization