Job Description:
Python/Spark Developer
Location: Mississauga, ON
Contract to Full time
Seeking a Core Python Engineer with an expertise in big data processing, particularly within the TechFin industry. Candidate should have experience working with financial enterprise technologies and large-scale distributed computing systems. This role involves developing and optimizing data pipelines for credit risk calculations and regulatory reporting.
Key Responsibilities:
- Design, develop, optimize, and maintain scalable data pipelines for processing and analyzing large scale financial data
- Lead projects for developing batch pipeline processes for credit risk analytics including, but not limited to, stress loss (GSST, CCAR) and expected credit loss (CECL, IFRS9, ICAAP)
- Ensure the efficient storage of and retrieval of all risk data in our big data platform systems (Hadoop, Hive, Impala, Spark, etc.)
- Implement best practices for spark performance tuning including, but not limited to, partitioning, caching, and memory management.
- Maintain code quality through high-efficiency testing, CI/CD pipelines (Tekton, Harness), and version control (GitHub).
Qualification Skills:
7+ years of software development experience with at least 5 years of hands-on Python and Apache Spark development in enterprise environments.
- Must have experience building backend applications and services using Python, not solely data engineering or analytics solutions.
- Must have: OOP, OOD, exception handling, concurrency, functional programming concepts.
- 5+ years of experience in Strong SQL skills with enterprise databases such as Oracle, PostgreSQL, SQL Server, or MySQL. Experience with NoSQL platforms is a plus.
- 3+ years of experience leading/owning software development projects from beginning to end with multiple team members.
- Experience working in financial market and credit risk enterprise software systems including, but not limited to, scenario analysis and stress testing.
- Experience with GitHub, Tekton, Harness, and other CI/CD pipeline technologies.
- Ability to work in a fast-paced TechFin environment.
- Experience leveraging AI-assisted development tools such as GitHub Copilot, Claude, Devin, or similar technologies to improve engineering productivity.
