Back to results

Python /Pyspark Developer

  • Toronto, ON, Canada

Full-time

Applications open in a new tab.

Job details

Job type
Full-time
Apply by
Posting language
English
Posted

Original job description

Position - Python /Pyspark Developer

Work Mode - Fulltime

Location - Toronto, ON

Required Skills:

  • Good years of experience in Data Engineering, AI Application Development, Cloud Data Platforms, and Production-grade Software Engineering.
  • Strong hands-on expertise in Python, PySpark, SQL, REST APIs, FastAPI, and enterprise application integration.
  • Experience designing and building AI-powered applications using Claude, Prompt Engineering, Retrieval-Augmented Generation (RAG), Vector Databases, Semantic Search, and Agentic AI patterns.
  • Deep understanding of Data Engineering frameworks, including ETL/ELT, batch and streaming pipelines, data quality, metadata management, lineage, observability, and DataOps practices.
  • Experience implementing and operationalizing MLOps / LLMOps capabilities including model lifecycle management, CI/CD pipelines, MLflow, monitoring, deployment automation, rollback, and production support.
  • Strong knowledge of cloud and modern data platforms, including compute, storage, integration, orchestration, security, networking, monitoring, and cost optimization services.
  • Hands-on experience with Git, Docker, Kubernetes, Airflow, MLflow, CI/CD, and distributed data processing frameworks.
  • Strong understanding of enterprise security and governance principles, including IAM/RBAC, encryption, secrets management, privacy controls, auditability, compliance, and secure data access.
  • Bachelor's degree in computer science, Engineering, Information Systems, Data Management, or a related discipline.
  • Preferred certifications in Cloud Platforms, Kubernetes, AI Engineering, MLOps, Data Engineering, Enterprise Architecture, Security, or Program Delivery
  • Strong hands-on data discovery skills, including profiling unfamiliar client data with Python, pandas, PySpark, and SQL; assessing coverage and quality; and quantifying volumes, distributions, edge cases, and business-process gaps before development.
  • Ability to rapidly build thin working solutions using real client data and APIs, validate them with users, and iteratively harden them with automated tests, security controls, error handling, observability, and production support procedures.
  • Experience creating business-relevant evaluation datasets with client SMEs, measuring ML or LLM quality, performing structured error analysis, grouping failures by root cause, and prioritizing improvements across releases.
  • Ability to measure user adoption and business impact after launch using usage data and agreed KPIs such as time saved, error reduction, straight-through processing, quality improvement, or productivity gains
More about this job

Responsibilities

Design and build data engineering pipelines and AI-powered applications, then operationalize them with production-grade deployment, monitoring, security, and support practices. Evaluate solution quality and user adoption using client data, structured error analysis, and agreed business-impact metrics.

Requirements

Requires strong hands-on experience in Python, PySpark, SQL, cloud data platforms, production software engineering, and AI application development, including RAG and agentic AI patterns. A bachelor's degree in a related discipline is required; preferred certifications include cloud platforms, Kubernetes, AI engineering, MLOps, data engineering, enterprise architecture, security, or program delivery.

Skills

  • Python
  • PySpark
  • SQL
  • Data Engineering
  • AI Application Development
  • REST APIs
  • FastAPI
  • Retrieval-Augmented Generation
  • Vector Databases
  • ETL/ELT
  • MLOps/LLMOps
  • Cloud Data Platforms
  • Kubernetes
  • Airflow
  • Data Quality
  • Enterprise Security

Visa sponsorship

Not detected in the job text

Categories

  • Technology
  • Software
  • Data & Analytics
  • Engineering
  • Consulting

Keywords

  • Python
  • PySpark
  • SQL
  • REST APIs
  • FastAPI
  • Claude
  • Prompt Engineering
  • Retrieval-Augmented Generation
  • Vector Databases
  • Semantic Search
  • Agentic AI
  • ETL/ELT
  • Batch Processing
  • Streaming Pipelines
  • DataOps
  • MLOps
  • LLMOps
  • MLflow
  • CI/CD
  • Git
  • Docker
  • Kubernetes
  • Airflow
  • Pandas
  • Data Quality
  • Metadata Management
  • Data Lineage
  • Observability
  • IAM/RBAC
  • Data Governance

Report this job