Data Engineer / Python Developer
- Mississauga, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
URGENT HIRING DATA ENGINEER / PYTHON DEVELOPER
Client: Altimetrik / Citi Bank
Job Title: Data Engineer / Python Developer
Location: Mississauga, ON, Canada
Employment Type: Full-Time
Mandatory Skills: Python, Apache Spark, PySpark
Responsibilities
Design, develop, and maintain software solutions using Python.
Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
Develop back-end services, APIs, and integrate databases.
Optimize applications for performance, security, and maintainability.
Troubleshoot and resolve software defects and issues.
Required Skills
Strong proficiency in Python and Spark.
Rachael
IT Services | Development | Staffing
Email: rachael@sidramtech.com
Client: Altimetrik / Citi Bank
Job Title: Data Engineer / Python Developer
Location: Mississauga, ON, Canada
Employment Type: Full-Time
Mandatory Skills: Python, Apache Spark, PySpark
Responsibilities
Design, develop, and maintain software solutions using Python.
Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
Develop back-end services, APIs, and integrate databases.
Optimize applications for performance, security, and maintainability.
Troubleshoot and resolve software defects and issues.
Required Skills
Strong proficiency in Python and Spark.
Rachael
IT Services | Development | Staffing
Email: rachael@sidramtech.com
More about this job
Responsibilities
Design, develop, and maintain Python and PySpark solutions for data analysis, including custom rules frameworks and data retrieval from HBase. Apply business transformations with Spark DataFrames and RDDs, perform Hive read/write operations, and develop and optimize backend services and APIs.
Requirements
Strong proficiency in Python and Spark is required, with PySpark listed as a mandatory skill. The role also involves working with HBase, Hive, data transformations, backend services, APIs, and database integration.
Skills
- Python
- Apache Spark
- PySpark
- Data Analysis
- HBase
- Apache Hive
- DataFrames
- RDDs
- Backend Development
- API Development
- Database Integration
- Performance Optimization
- Application Security
- Troubleshooting
Visa sponsorship
Not detected in the job text
Hiring contact email
rachael@sidramtech.com
Categories
- Technology
- Data & Analytics
- Software
Keywords
- Python
- Apache Spark
- PySpark
- Data Engineering
- Data Analysis
- Custom Framework
- Rules Engine
- HBase
- Apache Hive
- Hive Context
- DataFrames
- RDDs
- Business Transformations
- Backend Services
- APIs
- Database Integration
- Performance Optimization
- Application Security
- Maintainability
- Software Defects
- Troubleshooting
- Citi Bank
- Altimetrik