Azure Data Engineer
- Toronto, ON, Canada
$100,000 to $120,000 CAD / year · Full-time
Applications open in a new tab.
Job details
- Pay
- $100,000 to $120,000 CAD / year
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Inclusion without Exception
Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.
TCS has been serving the Canadian marketplace for more than 35 years and today is the technology partner of choice for many of the country's leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence.
Rooted in the heritage and values of the Tata Group, TCS is focused on creating long-term value for its clients, investors, employees, and the communities it serves. With a highly skilled workforce supporting customers from coast to coast, TCS has consistently been recognized as a Top Employer by the Top Employers Institute, including a recent top ranking at the country level.
TCS also sponsors 14 of the world's most prestigious marathons and endurance events, including the TCS Toronto Waterfront Marathon, reflecting its commitment to health, sustainability, and community empowerment.
Skills and Responsibilities:
•Experience working as a Data Engineer with focus on big data processing and/or relational databases with good understanding of SQL
•Experienced with working on Structured and Semi-Structured datasets.
•Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps
•Experienced in creating data pipelines & developing complex and optimized queries.
•Experienced with Workflow Management Tools: Airflow, Crontab, CA Workload Automation Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP.
•Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments
•Experience with integrating into back-end/legacy environments
•Experience integrating business and technology teams
•Experienced in any of the following programming/scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities
•Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
•Collaborating with Stakeholders, Business Analysts and Data Architects to assist with and translate business requirements to technical solutions
•Develop big data and analytic solutions leveraging new or existing technology to advance all lines of business
•Exploratory data analysis by querying and processing data stores and databases and generating reports. 5 Design, upgrade and implement new data workflows.
•Write and maintain technical documentation
•Execute updates, patches, and other activities required to maintain and enhance the operations of on-premises or cloud-based environments.
Good to have:
- Good Knowledge and hands on experience in Azure Databricks, Data Factory, Synapse Analytics or SQL DB, ADLS Gen 2.
- Knowledge in any Python or object-oriented programming language.
- Implement ETL/ELT flows via Big Data Solutions i.e., Spark, Python, Azure Data Factory, Azure Synapse, Azure, Databricks, etc.
- Write and maintain technical documentation.
- Good knowledge in Data warehousing concepts.
- Experience with data engineering projects, i.e., integration of data from multiple data sources to a target system.
Salary Range - CA$ 100,000 - CA$ 120,000 Per Year
Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodation during the recruitment and selection process, please inform Human Resources.
Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.
More about this job
Responsibilities
Design, build, and maintain cloud-based data pipelines and workflows, integrating data from multiple sources and developing optimized SQL and big data solutions. Collaborate with stakeholders, business analysts, and data architects to translate business requirements into technical solutions, analyze data, document systems, and maintain data environments.
Requirements
The role calls for data engineering experience with structured and semi-structured data, strong SQL skills, and hands-on experience with Azure data services such as Data Factory, Databricks, Azure SQL, and ADLS. Experience with programming or scripting languages, workflow orchestration, CI/CD, legacy-system integration, and data warehousing is also relevant; no education requirement is stated.
Skills
- Data Engineering
- Big Data Processing
- SQL
- Azure Data Factory
- Azure SQL Database
- Azure Databricks
- Azure Data Lake Storage
- Azure DevOps
- Data Pipeline Development
- ETL/ELT
- Python
- Apache Spark
- Apache Airflow
- CI/CD
- Data Warehousing
- Data Integration
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Consulting
Keywords
- Azure
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure SQL Database
- Azure Data Lake Storage Gen 2
- Azure DevOps
- SQL
- NoSQL
- Python
- Shell
- Scala
- Apache Spark
- Apache Airflow
- Crontab
- CA Workload Automation
- GitHub
- Jenkins
- CI/CD
- ETL/ELT
- Data Pipelines
- Big Data
- Data Warehousing
- Data Integration
- Structured Data
- Semi-Structured Data
- Exploratory Data Analysis
- Legacy Systems
- Relational Databases
- Technical Documentation