Python Developer
- Mississauga, ON, Canada
$100,000 to $120,000 CAD / year · Full-time
Applications open in a new tab.
Job details
- Pay
- $100,000 to $120,000 CAD / year
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Job Title: Python Developer / Data Engineer
Location: Mississauga, ON, Canada (Onsite)
Duration: Fulltime
Mandatory Skills: Python, Spark, PySpark
Responsibilities:
· Design, develop, and maintain software solutions using Python.
· Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
· Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
· Develop back-end services, APIs, and integrate databases.
· Optimize applications for performance, security, and maintainability.
· Troubleshoot and resolve software defects and issues.
Required Skills:
· Strong proficiency in Python and Spark.
More about this job
Responsibilities
Design, develop, and maintain Python software, including custom rules-generation frameworks and data solutions that gather data from HBase and process it with PySpark, Spark DataFrames or RDDs, and Hive. Develop back-end services and APIs, integrate databases, optimize applications for performance, security, and maintainability, and troubleshoot defects.
Requirements
Strong proficiency in Python and Spark is required. The role involves practical experience with PySpark, data analysis, HBase, Spark DataFrames or RDDs, and Hive.
Skills
- Python
- Apache Spark
- PySpark
- Data Analysis
- Rules Engine Development
- HBase
- Spark DataFrames
- Spark RDDs
- Hive
- Business Transformations
- Back-End Services
- API Development
- Database Integration
- Performance Optimization
- Security
- Troubleshooting
Visa sponsorship
Not detected in the job text
Categories
- Software
- Technology
- Data & Analytics
Keywords
- Python
- Apache Spark
- PySpark
- Data Engineering
- Data Analysis
- Rules Engine
- HBase
- Spark DataFrames
- Spark RDDs
- Hive Context
- Business Transformations
- Back-End Services
- APIs
- Database Integration
- Performance Optimization
- Application Security
- Software Maintainability
- Troubleshooting
- IT Services
- IT Consulting