Role Overview
We are looking for a Senior Data Engineer to join a small international team and take ownership of complex data engineering challenges involving large-scale data processing, standardization, matching, and data quality.
About Onhires
Our client is a growing technology company developing market intelligence and software solutions.
Key Responsibilities
- Design, build, and maintain scalable production data pipelines
- Ingest, process, and transform large volumes of data from multiple sources
- Develop solutions for data standardization, normalization, matching, and validation
- Build data quality controls and monitoring to identify malformed, inconsistent, or incorrect data
- Design reliable approaches to data corrections, updates, reprocessing, and backfills
- Improve the architecture, scalability, reliability, and performance of the data platform
Requirements & Eligibility
- 4+ years of hands-on Data Engineering experience with production data systems
- Strong Python skills
- Hands-on experience with PySpark / Apache Spark and distributed data processing
- Strong experience building and maintaining ETL/ELT and data ingestion pipelines
- Experience working with large, complex datasets and multiple data sources
- Strong SQL and data modeling skills
Required Skills & Tech
PythonPySparkApache SparkETLELT