Suffyan Asad - Data Architect & Engineering Lead

Impact

Built products trusted by Hulu/Disney, Roblox, Zoom, Klarna, Compass, Okta
For infrastructure cost visibility and optimization, across $1B+ in annualized cloud spend.
500%
Increase in scale of data processing pipelines to 2.5 billion rows per source, 30% faster and at 15% lower cost.
$600K saved
Built outlier detection to detect cost spikes, consuming billions of data points. Saved $600K for Zoom in one detected incident.
79% reduction in latency
Rearchitected the data processing system to achieve 79% lower latency and an 80% processing speed-up.

What I Do

Data Engineering and Architecture

I design and engineer scalable and reliable data platforms end to end. I have extensive experience and expertise with Databricks, Snowflake, AWS and Azure.

Data Science and AI

I turn data into decisions. I have built time-series forecasting with high accuracy, anomaly detection, infrastructure optimization recommendations, and Generative AI (RAG and ReAct).

Featured Work

Multi-cloud Cost Platform

Architected the AWS cost pipelines that became the core of the platform, then extended them to Azure, Google Cloud, Kubernetes container costs and rule-based business hierarchies, at up to 2.5 billion rows per run. Added container rightsizing from actual versus allocated resources, and tuned Spark to cut runtime 30% and cost 15%.

Apache Spark
Amazon EMR
Kubernetes
Airflow
ClickHouse
Terraform

Machine Learning, Forecasting, Generative AI

Built and scaled anomaly detection over 6–8 billion rows of cost data, catching $600K of runaway spend for Zoom. Engineered an ensemble forecasting service that produces 24-month forecasts at every level of the business hierarchy, tuned with cross-validation and back-testing. A Generative AI assistant built on ReAct agents answers questions about financial data in plain language.

Python
facebook-prophet
Kubeflow
OpenAI
ReAct
Apache Spark

Processing and Warehouse Upgrade

Scaled the data processing pipelines to 50% more processing capacity and over 1 billion rows per run. Led the architecture, benchmarks and proof of concept to replace MongoDB with a sharded ClickHouse warehouse: 79% lower median query latency, and data loads cut from five days to one. Run with Claude Code, Skills and hooks for reproducible, evidence-backed decisions.

ClickHouse
PySpark
Ray
Kubernetes
Python
DuckDB
Claude
Claude Code
AI-Assisted Development

Reserved Instance Optimization

Simulated AWS's Reserved Instance application algorithm on hourly EC2 inventory and optimized convertible RI exchanges with a mixed-integer linear program, plus near-real-time cost estimates that bridge the 2–3 day billing lag. A key capability in closing Intuit as a customer.

Python
PuLP
pandas
Amazon EC2

Migration to Databricks

Led the architecture evaluation, cost and resourcing estimates, and a production pilot that ran one customer's cost pipeline end to end on Databricks.

Databricks
Lakeflow Pipelines
Unity Catalog
Apache Spark

Career Highlights

CoreStack
- Senior Data Software EngineerHalifax, Canada·Jul 2025 – Present
Leading the ClickHouse analytics warehouse modernization, and directed the customer migration from the legacy platform with 100% retention.
Yotascale
- Senior Data Engineer - Architect and LeadHalifax, NS, Canada·Mar 2025 – Jun 2025
- Senior Data Engineer - Architect and LeadLahore, Pakistan·Nov 2021 – Mar 2025
- Data Engineer, Founding Team MemberLahore, Pakistan·Oct 2016 – Oct 2021
Joined as a founding team member and grew into architect and lead of the data platform behind FinOps products used by Hulu/Disney, Intuit, Roblox, Okta and Zoom, leading a pod of up to five engineers.
The George Washington University
- MS in Business AnalyticsWashington DC, USA·Aug 2015 – Aug 2016
Fulbright Scholar: graduate study in the United States under the Fulbright Program.
Strategic Systems International
- Senior Software EngineerLahore, Pakistan·Jul 2014 – Jul 2015
- Software EngineerLahore, Pakistan·May 2013 – Jun 2014
Built business intelligence: SSAS cubes and MDX, SSRS reporting tools, Master Data Services customization, and reporting queries tuned to respond in under a second.
GenITeam Solutions
- Software EngineerLahore, Pakistan·Jul 2012 – May 2013
iOS application and game development for iPhone and iPad; received the Rising Star award.