HTG is hiring a Backend Engineer, Data Engineering for an opportunity with one of our technology clients.
The engineer will join a backend-focused data engineering team responsible for processing large volumes of field and system data and transforming it into useful, reliable data that can be consumed by other systems and engineering teams.
A key focus of the team is cost reduction and processing efficiency - improving how data is collected, processed, transformed, and delivered while maintaining system performance, reliability, and scalability.
The ideal candidate will have strong backend and data-processing experience, with Scala and Javaas core technologies. Experience with Ruby or Go is considered an asset.
Key Responsibilities
- Design, develop, and maintain backend services and data-processing systems.
- Build and optimize data pipelines that process field and system-generated data.
- Transform raw data into reliable, structured, and useful datasets for downstream systems and applications.
- Develop scalable solutions for processing and managing large volumes of data.
- Identify opportunities to reduce data-processing and infrastructure costs through improved architecture, algorithms, automation, and system efficiency.
- Optimize data-processing workflows for performance, scalability, reliability, and cost efficiency.
- Develop and maintain services and APIs that support data ingestion, processing, transformation, and delivery.
- Troubleshoot data-processing and backend issues across development and production environments.
- Implement monitoring, logging, testing, and diagnostics to maintain data quality and system reliability.
- Collaborate with other engineering teams to understand downstream data requirements and deliver reliable data products.
- Participate in code reviews, technical design discussions, testing, debugging, and Agile development practices.
- Contribute to improvements in engineering processes, automation, and overall platform efficiency.
Required Qualifications
- Strong professional experience in backend software engineering and/or data engineering.
- Strong hands-on experience with Scala.
- Strong professional experience with Java.
- Experience designing and developing backend services and data-processing applications.
- Experience working with data pipelines, data transformation, or large-scale data processing.
- Strong understanding of software engineering fundamentals, including object-oriented and/or functional programming concepts.
- Experience working with APIs, backend services, and distributed application environments.
- Experience troubleshooting and optimizing backend applications and data-processing workflows.
- Understanding of performance, scalability, reliability, and resource utilization.
- Strong analytical, debugging, and problem-solving skills.
- Ability to work effectively with cross-functional engineering teams.
Technical Environment
Experience with several of the following technologies and concepts is valuable:
- Programming Languages: Scala, Java
- Additional Languages: Ruby, Go
- Data Engineering: Data processing, ETL/ELT, data transformation, data pipelines, batch and/or streaming processing
- Backend Development: APIs, backend services, service-oriented architectures
- Distributed Systems: Distributed data processing and scalable backend architectures
- Databases: Relational and NoSQL databases
- Data Storage: Experience working with large-scale data storage systems
- Messaging & Streaming: Kafka or similar messaging and streaming technologies
- Cloud & Infrastructure: AWS, Azure, GCP, or comparable cloud environments
- Automation & CI/CD: Automated testing, CI/CD pipelines, deployment and operational automation
- Observability: Logging, monitoring, metrics, diagnostics, and system observability
- Version Control: Git
Preferred Qualifications
- Experience working with Scala-based data processing systems.
- Experience developing backend systems using Java.
- Experience with Ruby and/or Go.
- Experience processing large volumes of operational, device, field, or system-generated data.
- Experience optimizing data pipelines for cost, performance, and scalability.
- Experience with distributed data-processing frameworks.
- Experience with batch and streaming data-processing architectures.
- Experience with Kafka or comparable messaging/streaming platforms.
- Experience with cloud-based data and backend infrastructure.
- Experience with data quality, validation, monitoring, and observability.
- Experience developing automation for data-processing workflows.
- Experience working in an Agile software development environment.
What You'll Bring
We are looking for a backend engineer who enjoys working with data at scale and solving complex engineering problems involving data processing, system efficiency, and cost optimization.
The ideal candidate will combine strong Scala and Java development skills with practical experience building backend services and processing pipelines. You should be comfortable working with large volumes of data, optimizing processing workflows, troubleshooting complex issues, and delivering reliable data that downstream systems can use effectively.
Experience with Ruby or Go will be considered an asset.
