Archived listing. The details below describe a past opening.
Role: GenAI and BigData Developer
Location: Halifax
Type: Contract (Hybrid)
Role Overview:
We are seeking a highly skilled GenAI & Big Data developer to design, build, and deploy scalable data and AI solutions. This role combines expertise in big data engineering, agentic AI, machine learning operations, and cloud-native technologies to deliver enterprise-grade AI applications and data platforms.
Key Responsibilities
- Build and maintain scalable batch and real-time data pipelines for ingestion, transformation, and curation.
- Design and optimize data models, feature stores, and storage architectures for AI/ML workloads.
- Develop and operationalize Agentic AI and LLM-powered applications, including RAG pipelines and agent orchestration frameworks.
- Implement DataOps and MLOps automation, including CI/CD pipelines, model deployment, monitoring, data validation, and drift detection.
- Design, deploy, and optimize AI platforms and distributed systems across cloud and on-premises environments.
- Integrate AI services into secure, production-grade environments while ensuring reliability, scalability, and observability.
- Establish AI architecture standards, best practices, and governance across the organization.
- Collaborate with cross-functional teams to translate business requirements into scalable technical solutions.
Required Skills
- Strong experience with Agentic AI, Large Language Models (LLMs), RAG pipelines, and agent orchestration frameworks (LangChain/LangGraph preferred).
- Expertise in MLOps automation, including CI/CD, model deployment, monitoring, data validation, feature management, and drift detection.
- Proficiency with GitHub, GitHub Actions, Docker, and Kubernetes for DevOps and deployment automation.
- Advanced programming skills in Python with strong software engineering fundamentals, including version control, testing, and code reviews.
- Strong proficiency in SQL and distributed computing technologies such as Apache Spark, Hadoop, Scala, and Java.
- Experience with data modeling, feature engineering, and feature stores across the machine learning lifecycle.
- Hands-on experience with Kafka or similar event-streaming platforms.
- Expertise in designing and deploying enterprise-scale distributed systems.
- Experience building and supporting hybrid cloud and on-premises environments using AWS and/or Azure.
- Strong analytical, problem-solving, collaboration, and communication skills.
Preferred Qualifications
- Master's degree in computer science, Software Engineering, Data Science, or a related field.
- 5+ years of experience in Data Engineering, Software Engineering, ML Engineering, AI Engineering, or related disciplines.
- Experience with React and JavaScript for UI development is a plus.