Quantiphi
Senior Data Engineer
Overview
We are looking for a Senior Data Engineer with expertise in DBT, AWS, and large-scale data engineering solutions to build scalable batch and streaming data pipelines.
About Quantiphi
Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of business. We solve the toughest and most complex business problems with the latest and cutting-edge technologies and to make this happen, we have a vibrant, diverse and talented set of profe
Requirements & Eligibility
- 3+ years of hands-on experience building large-scale AWS data engineering solutions
- Strong hands-on experience with DBT(Cloud+Core)
- Hands-on expertise into Redshift warehouse and Analytics
- Strong hands-on expertise in SQL, Spark/PySpark, Python
- Hands-on experience designing and implementing Lakehouse solutions using Apache Iceberg
- Strong knowledge of AWS services including SMUS, EC2, DynamoDB, API Gateway, MWAA, EMR, S3, Athena, Glue Catalog, Aurora PostgreSQL, Lambda, CloudWatch, SQS, SNS, EventBridge, Secrets Manager, and IAM
- Experience building scalable batch and streaming data pipelines on AWS
- Strong experience in Spark/PySpark performance tuning and optimization
Key Responsibilities
- Design and implement Lakehouse solutions using Apache Iceberg
- Build scalable batch and streaming data pipelines on AWS
- Optimize Apache Iceberg and Aurora PostgreSQL for performance and scalability
- Implement monitoring, logging, alerting, and observability for production data pipelines
- Ensure data quality, troubleshooting, debugging, and production support
Disclaimer: Trace Hiring is an independent job board. We are not directly affiliated with Quantiphi. Please verify all details on the official company application portal.