Data Engineer / Python Developer
- Lasalle, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
URGENT HIRING DATA ENGINEER / PYTHON DEVELOPER
Client: Altimetrik / Citi Bank
Job Title: Data Engineer / Python Developer
Location: Mississauga, ON, Canada
Employment Type: Full-Time
Mandatory Skills: Python, Apache Spark, PySpark
Responsibilities
Design, develop, and maintain software solutions using Python.
Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
Develop back-end services, APIs, and integrate databases.
Optimize applications for performance, security, and maintainability.
Troubleshoot and resolve software defects and issues.
Required Skills
Strong proficiency in Python and Spark.
Client: Altimetrik / Citi Bank
Job Title: Data Engineer / Python Developer
Location: Mississauga, ON, Canada
Employment Type: Full-Time
Mandatory Skills: Python, Apache Spark, PySpark
Responsibilities
Design, develop, and maintain software solutions using Python.
Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
Develop back-end services, APIs, and integrate databases.
Optimize applications for performance, security, and maintainability.
Troubleshoot and resolve software defects and issues.
Required Skills
Strong proficiency in Python and Spark.
More about this job
Responsibilities
Design, develop, and maintain Python and PySpark solutions, including data analysis programs and a custom rules-generation framework. Gather data from HBase, apply business transformations with Spark DataFrames and RDDs, perform Hive read/write operations, and develop and optimize back-end services and APIs.
Requirements
The posting requires strong proficiency in Python and Spark, with PySpark listed as a mandatory skill. It also describes experience developing Python and PySpark programs, building a custom rules framework, and working with HBase, Spark DataFrames or RDDs, and Hive.
Skills
- Python
- Apache Spark
- PySpark
- Data Analysis
- HBase
- Hive
- DataFrames
- RDDs
- Business Transformations
- Rules Engine Development
- Back-End Services
- API Development
- Database Integration
- Performance Optimization
- Troubleshooting
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
Keywords
- Python
- Apache Spark
- PySpark
- Data Engineering
- Data Analysis
- HBase
- Hive
- Spark DataFrames
- RDDs
- Business Transformations
- Rules Engine
- Custom Framework
- Back-End Services
- APIs
- Database Integration
- Performance Optimization
- Security
- Maintainability
- Troubleshooting
- Technology
- Information and Internet