Husky: Efficient compaction at Datadog scale

Husky: Efficient compaction at Datadog scale

• Husky layers over object storage, using fragments to batch trillions of daily events. • Metadata per fragment lets queries locate relevant data without scanning entire store. • D

Leveraging Spark 3 and NVIDIA's GPUs to Reduce Cloud Cost by up to 70% for Big Data Pipelines

• PayPal runs hundreds of thousands of Spark jobs hourly, processing petabytes of data. • Upgrading to Spark 3 and adopting NVIDIA RAPIDS GPUs cuts cloud costs up to 70%. • GPUs of

Engineering Blogs · February 21, 2024 (updated February 24, 2026) · 1 min · 178 words