Python /Pyspark Developer
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Position - Python /Pyspark Developer
Work Mode - Fulltime
Location - Toronto, ON
Required Skills:
- Good years of experience in Data Engineering, AI Application Development, Cloud Data Platforms, and Production-grade Software Engineering.
- Strong hands-on expertise in Python, PySpark, SQL, REST APIs, FastAPI, and enterprise application integration.
- Experience designing and building AI-powered applications using Claude, Prompt Engineering, Retrieval-Augmented Generation (RAG), Vector Databases, Semantic Search, and Agentic AI patterns.
- Deep understanding of Data Engineering frameworks, including ETL/ELT, batch and streaming pipelines, data quality, metadata management, lineage, observability, and DataOps practices.
- Experience implementing and operationalizing MLOps / LLMOps capabilities including model lifecycle management, CI/CD pipelines, MLflow, monitoring, deployment automation, rollback, and production support.
- Strong knowledge of cloud and modern data platforms, including compute, storage, integration, orchestration, security, networking, monitoring, and cost optimization services.
- Hands-on experience with Git, Docker, Kubernetes, Airflow, MLflow, CI/CD, and distributed data processing frameworks.
- Strong understanding of enterprise security and governance principles, including IAM/RBAC, encryption, secrets management, privacy controls, auditability, compliance, and secure data access.
- Bachelor's degree in computer science, Engineering, Information Systems, Data Management, or a related discipline.
- Preferred certifications in Cloud Platforms, Kubernetes, AI Engineering, MLOps, Data Engineering, Enterprise Architecture, Security, or Program Delivery
- Strong hands-on data discovery skills, including profiling unfamiliar client data with Python, pandas, PySpark, and SQL; assessing coverage and quality; and quantifying volumes, distributions, edge cases, and business-process gaps before development.
- Ability to rapidly build thin working solutions using real client data and APIs, validate them with users, and iteratively harden them with automated tests, security controls, error handling, observability, and production support procedures.
- Experience creating business-relevant evaluation datasets with client SMEs, measuring ML or LLM quality, performing structured error analysis, grouping failures by root cause, and prioritizing improvements across releases.
- Ability to measure user adoption and business impact after launch using usage data and agreed KPIs such as time saved, error reduction, straight-through processing, quality improvement, or productivity gains
More about this job
Responsibilities
Design and build data engineering pipelines and AI-powered applications, then operationalize them with production-grade deployment, monitoring, security, and support practices. Evaluate solution quality and user adoption using client data, structured error analysis, and agreed business-impact metrics.
Requirements
Requires strong hands-on experience in Python, PySpark, SQL, cloud data platforms, production software engineering, and AI application development, including RAG and agentic AI patterns. A bachelor's degree in a related discipline is required; preferred certifications include cloud platforms, Kubernetes, AI engineering, MLOps, data engineering, enterprise architecture, security, or program delivery.
Skills
- Python
- PySpark
- SQL
- Data Engineering
- AI Application Development
- REST APIs
- FastAPI
- Retrieval-Augmented Generation
- Vector Databases
- ETL/ELT
- MLOps/LLMOps
- Cloud Data Platforms
- Kubernetes
- Airflow
- Data Quality
- Enterprise Security
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Data & Analytics
- Engineering
- Consulting
Keywords
- Python
- PySpark
- SQL
- REST APIs
- FastAPI
- Claude
- Prompt Engineering
- Retrieval-Augmented Generation
- Vector Databases
- Semantic Search
- Agentic AI
- ETL/ELT
- Batch Processing
- Streaming Pipelines
- DataOps
- MLOps
- LLMOps
- MLflow
- CI/CD
- Git
- Docker
- Kubernetes
- Airflow
- Pandas
- Data Quality
- Metadata Management
- Data Lineage
- Observability
- IAM/RBAC
- Data Governance