Ben Taylor
ben.taylor@example.com+44 20 7946 0106linkedin.com/in/bentaylorgithub.com/bentaylor
Summary
Data engineer with 7 years building reliable batch and streaming pipelines for analytics and ML consumers.
Experienced in Spark, Airflow, Kafka, Snowflake, BigQuery, dbt, data quality, schema evolution, and cost-aware warehouse design.
Experience
Senior Data Engineer
TravelNest | London, UK | February 2022 - Present
- Lead data platform work for booking, pricing, and marketing datasets totalling 9TB of new data per day.
- Built Spark and Airflow pipelines that reduced nightly warehouse refresh time from 6 hours to 90 minutes.
- Implemented schema registry and contract checks that cut downstream breaking changes by 68%.
- Designed Snowflake cost controls and clustering strategy, reducing monthly compute spend by 24%.
- Mentor analysts and engineers on dbt modelling, data quality tests, and pipeline ownership.
Data Engineer
ShopMetric | Leeds, UK | May 2018 - January 2022
- Built Kafka ingestion for clickstream events serving product analytics and recommendation features.
- Developed dbt marts for orders, customers, and campaigns used by 120 weekly active BI users.
- Reduced late-arriving event defects by 43% through partitioning, backfill tooling, and freshness checks.
- Migrated 1.2B rows from Redshift to BigQuery with zero dashboard downtime.
BI Developer
GreenEnergy UK | Newcastle, UK | September 2015 - April 2018
- Created SQL models and Power BI dashboards for revenue, churn, and field operations.
- Automated CSV ingestion from 18 vendor systems, saving analysts 16 hours per week.
- Improved data accuracy for meter readings by 22% through validation and deduplication rules.
- Documented metric definitions and trained 40 business users on trusted reporting tables.
Skills
Languages
Python, SQL, Scala, Bash
Pipelines
Spark, Airflow, Kafka, Fivetran, dbt
Warehouses
Snowflake, BigQuery, Redshift, Postgres
Quality
Great Expectations, Schema registry, Lineage, Data contracts
Education
- MSc Data Science, University of Edinburgh
- BSc Mathematics, University of Leeds