About Me
5 years of data engineering experience focused on big data platform development and data governance. Expert in ETL pipeline design, having led the rebuild of a pipeline processing 10TB daily. Bridges data teams and business stakeholders effectively.
Work Experience
Senior Data Engineer
2022.03 - Present
An e-commerce platform · Data Platform
Led the data warehouse migration from Redshift to Snowflake, improving query performance 4x.
Designed and built a real-time pipeline (Kafka + Spark Streaming) with sub-minute latency.
Built data quality monitoring with automated alerting and under 2% false positive rate.
Data Engineer
2019.07 - 2022.02
A fintech company
Built an ETL framework supporting 200+ scheduled data jobs.
Optimized Spark job performance, cutting average runtime from 40 minutes to 8.
Wrote data platform documentation reaching 95% coverage and reducing onboarding time by 60%.
Education
Computer Science · Bachelor's
2015.09 - 2019.06
Huazhong University of Science and Technology