Topic

#cost

Databricks

May 13, 202611 min read

Cutting a Databricks Bill: Job Clusters, Spot, Photon, and Finding the Top Offenders in System Tables

How I take 30 percent off a Databricks bill in a week: kill all-purpose clusters for jobs, price spot properly, test Photon per workload, and rank spend with system.billing.

databricks
cost

Illustrated overview of Making Athena Fast and Cheap: Partition Projection, Parquet Layout, CTAS, and Workgroup Byte Limits

AWS

May 5, 202614 min read

Making Athena Fast and Cheap: Partition Projection, Parquet Layout, CTAS, and Workgroup Byte Limits

Athena bills you for bytes scanned. Here is the partition projection, Parquet layout, CTAS compaction, and workgroup guardrails I use to cut that number by 90 percent.

aws
cost

BigQuery

May 5, 202613 min read

Cutting a BigQuery Bill: Partitioning, Byte Limits, Materialized Views, and On-Demand vs Editions

How I take a runaway BigQuery invoice apart: find the top jobs, fix pruning, cap bytes billed, use materialized views honestly, and decide when Editions beats on-demand.

bigquery
cost