https://cluster-site.onrender.com/tags/benchmarking/ Recent content in Benchmarking on Tenu Tech Brief Hugo -- 0.146.0 en-us Wed, 25 Feb 2026 07:59:13 +0000 https://cluster-site.onrender.com/posts/benchmarking-distilled-language-models-performance-and-efficiency-in-resource-constrained-settings/ Wed, 25 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/benchmarking-distilled-language-models-performance-and-efficiency-in-resource-constrained-settings/ • Computer Science > Computation and Language [Submitted on 28 Jan 2026] Title:Benchmarking Distilled Language Models: Performance and Efficiency in Resource-Constrained Settings V https://cluster-site.onrender.com/posts/benchmarking-early-deterioration-prediction-across-hospital-rich-and-mci-like-emergency-triage-under-constrained-sensing/ Wed, 25 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/benchmarking-early-deterioration-prediction-across-hospital-rich-and-mci-like-emergency-triage-under-constrained-sensing/ • Computer Science > Computers and Society [Submitted on 9 Feb 2026] Title:Benchmarking Early Deterioration Prediction Across Hospital-Rich and MCI-Like Emergency Triage Under Cons https://cluster-site.onrender.com/posts/beyond-single-channel-agentic-benchmarking/ Tue, 24 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/beyond-single-channel-agentic-benchmarking/ • Current AI safety benchmarks assess agents in isolation, ignoring human‑AI interaction dynamics. • Single‑channel evaluation misrepresents operational safety, unlike redundancy‑b https://cluster-site.onrender.com/posts/dream-deep-research-evaluation-with-agentic-metrics/ Tue, 24 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/dream-deep-research-evaluation-with-agentic-metrics/ • DREAM introduces agentic evaluation for AI research agents, addressing lack of ground truth. • Highlights Mirage of Synthesis: surface fluency can mask factual and reasoning flaw https://cluster-site.onrender.com/posts/agentlab-benchmarking-llm-agents-against-long-horizon-attacks/ Fri, 20 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/agentlab-benchmarking-llm-agents-against-long-horizon-attacks/ • Computer Science > Artificial Intelligence [Submitted on 18 Feb 2026] Title:AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks View PDF HTML (experimental)Abstract:LL https://cluster-site.onrender.com/posts/llm-wikirace-benchmarking-long-term-planning-and-reasoning-over-real-world-knowledge-graphs/ Fri, 20 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/llm-wikirace-benchmarking-long-term-planning-and-reasoning-over-real-world-knowledge-graphs/ • Computer Science > Artificial Intelligence [Submitted on 18 Feb 2026] Title:LLM-WikiRace: Benchmarking Long-term Planning and Reasoning over Real-World Knowledge Graphs View PDF https://cluster-site.onrender.com/posts/linux-7.0-showing-some-early-performance-regressions-on-intel-panther-lake/ Wed, 18 Feb 2026 21:00:00 +0000 https://cluster-site.onrender.com/posts/linux-7.0-showing-some-early-performance-regressions-on-intel-panther-lake/ • Linux 7.0 kernel introduces regressions on Intel Panther Lake, reducing CPU and iGPU performance. • Benchmarks on MSI Prestige 14 with Core Ultra X7 358H show slower results than https://cluster-site.onrender.com/posts/quantifying-construct-validity-in-large-language-model-evaluations/ Wed, 18 Feb 2026 05:00:00 +0000 https://cluster-site.onrender.com/posts/quantifying-construct-validity-in-large-language-model-evaluations/ • LLM benchmarks often misrepresent true model capabilities due to contamination and annotator errors. • Construct validity is essential to ensure benchmarks truly measure desired https://cluster-site.onrender.com/posts/llm-inference-benchmarking-measure-what-matters/ Fri, 06 Feb 2026 14:46:06 +0000 https://cluster-site.onrender.com/posts/llm-inference-benchmarking-measure-what-matters/ • By Piyush Srivastava, Karnik Modi, Stephen Varela, and Rithish Ramesh Production-grade LLM inference is a complex systems challenge, requiring deep co-designs - from hardware pri https://cluster-site.onrender.com/posts/advancing-ai-benchmarking-with-game-arena/ Mon, 02 Feb 2026 17:00:00 +0000 https://cluster-site.onrender.com/posts/advancing-ai-benchmarking-with-game-arena/ • DeepMind expands Game Arena, adding Werewolf and poker to benchmark AI beyond perfect-information games. • Werewolf tests social deduction, communication, and deception handling https://cluster-site.onrender.com/posts/ceilometer-ubers-adaptive-benchmarking-framework/ Thu, 20 Nov 2025 14:00:00 +0000 https://cluster-site.onrender.com/posts/ceilometer-ubers-adaptive-benchmarking-framework/ • Introduction At Uber, scale and reliability define our infrastructure. • Every new server type, kernel upgrade, and configuration change must be rigorously vetted before it touch