DataStage Developer
- Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Posting language
- English
- Posted
Original job description
Job title- Datastage Developer
Description
- ETL Design & Development
- Design, build, and modify parallel jobs, sequence jobs, and custom routines in IBM InfoSphere DataStage (Designer client). -- Must have
- Implement complex business logic using transformer stages, lookups, joins, aggregations, and sorting mechanisms.
- Translate business requirements and source-to-target mapping documents (STDs) into scalable technical solutions.
- Database & SQL Optimization
- Write, tune, and optimize advanced SQL and PL/SQL queries for relational databases like Oracle, DB2, or SQL Server.
- Perform data profiling, analyze source data nuances, and prevent data redundancy across data warehouses (EDW, ODS, and Data Marts).
- Scripting & Automation
- Develop and maintain UNIX/Linux shell scripts to automate file handling, job triggers, and operational pipelines.
- Schedule, execute, and monitor jobs using DataStageDirector or enterprise schedulers.
- Troubleshooting & Production Support
- Provide ongoing support for daily, weekly, and monthly data processing cycles.
- Monitor job execution logs, perform root-cause analysis on failed loads, and implement preventive performance fixes.
- Debug and tune slow-running jobs using partitioning strategies, stage optimizations, and performance monitors.
- Testing & Documentation
- Create and execute comprehensive unit, integration, and regression test plans.
- Participate in code reviews and support User Acceptance Testing (UAT).
- Maintain technical documentation, data lineage, and operational runbooks.
- Collaboration & Upgrades
Work closely with data architects, business analysts, QA teams, and infrastructure engineers across the Software Development Life Cycle (SDLC).
More about this job
Responsibilities
Design, develop, optimize, and support DataStage ETL jobs and related SQL, PL/SQL, and shell-script workflows for enterprise data warehouses, operational data stores, and data marts. Troubleshoot production loads, improve job performance, conduct testing, maintain technical documentation, and collaborate with cross-functional teams throughout the SDLC.
Requirements
The role requires hands-on experience building complex DataStage jobs and implementing business logic with transformations, lookups, joins, aggregations, and sorting. It also calls for advanced SQL and PL/SQL, UNIX/Linux scripting, job scheduling and monitoring, performance tuning, testing, documentation, and production support; no education requirement is stated.
Skills
- IBM InfoSphere DataStage
- ETL Design And Development
- Parallel Jobs
- Sequence Jobs
- Transformer Stages
- SQL
- PL/SQL
- Oracle
- DB2
- SQL Server
- UNIX/Linux Shell Scripting
- Data Profiling
- Performance Tuning
- Production Support
- Testing
- Data Lineage
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
Keywords
- IBM InfoSphere DataStage
- ETL
- Parallel Jobs
- Sequence Jobs
- Custom Routines
- Transformer Stages
- Lookups
- Joins
- Aggregations
- Sorting
- Source-To-Target Mapping
- SQL
- PL/SQL
- Oracle
- DB2
- SQL Server
- Data Profiling
- Enterprise Data Warehouse
- Operational Data Store
- Data Marts
- UNIX/Linux
- Shell Scripting
- DataStage Director
- Job Scheduling
- Root-Cause Analysis
- Partitioning
- Unit Testing
- Integration Testing
- Regression Testing
- User Acceptance Testing