• Authors: Junkai Xue | Sr Staff Software Engineer, Big Data Processing Platform; Zheyu Zha | Staff Software Engineer, Big Data Processing Platform; Jia Zhan | Principal Engineer, Online Systems; Alberto Ordonez Pereira | Sr Staff Software Engineer, Online Systems Overview A quota is an official limit on the usage or production of a specific resource. • At Pinterest, we are developing a robust, generic quota management platform (Piqama) designed to manage a wide range of resources - including physical resources like memory and CPU, service resources such as QPS (queries per second) and network bandwidth, as well as application-specific quota units. • Our ecosystem provides seamless quota lifecycle management, a user-friendly management portal, low-latency quota value broadcasting, quota updates, prediction, and rightsizing capabilities. • In this blog, we illustrate how the quota management platform enables both capacity quota management for the Pinterest BigData Platform and rate-limiting quotas for Pinterest Online Services, showcasing its flexibility and impact. • Platform Architecture Piqama is Pinterest’s Quota Management Ecosystem, created to oversee quotas across diverse systems and quota types, while accommodating multiple platforms and scenarios. • Each application either utilizes its own specific quota enforcement logic or leverages the simple, default enforcement mechanisms provided by Piqama.The following section details its architecture: Piqama Architecture The Piqama ecosys

Article Summaries:

  • Pinterest has announced the launch of Piqama, a unified quota‑management platform designed to oversee a broad spectrum of resources-from physical assets like CPU and memory to service metrics such as QPS and bandwidth, as well as application‑specific limits. The system offers a centralized portal, REST and Thrift APIs, and low‑latency quota broadcasting, enabling end‑to‑end lifecycle management, including schema definition, validation, authorization, and update dispatch. Piqama also incorporates offline analytics for prediction and rightsizing, and can integrate with Pinterest’s existing configuration distribution system. The platform aims to streamline quota enforcement across Pinterest’s Big Data and online services, improving capacity planning and rate‑limiting efficiency.

Sources: