Evaluate on Tenu Tech Brief https://cluster-site.onrender.com/tags/evaluate/ Recent content in Evaluate on Tenu Tech Brief Hugo -- 0.146.0 en-us Wed, 25 Feb 2026 07:59:04 +0000 Why we no longer evaluate SWE-bench Verified https://cluster-site.onrender.com/posts/why-we-no-longer-evaluate-swe-bench-verified/ Mon, 23 Feb 2026 11:00:00 +0000 https://cluster-site.onrender.com/posts/why-we-no-longer-evaluate-swe-bench-verified/ • SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. • Our analysis shows flawed tests and training leakage. • We recommend SWE-bench Pro. • The Peace-Athabasca Delta is at risk. Here's what we can do to evaluate the threats https://cluster-site.onrender.com/posts/the-peace-athabasca-delta-is-at-risk.-heres-what-we-can-do-to-evaluate-the-threats/ Wed, 18 Feb 2026 17:26:25 +0000 https://cluster-site.onrender.com/posts/the-peace-athabasca-delta-is-at-risk.-heres-what-we-can-do-to-evaluate-the-threats/ • River deltas are among the most complex and productive environments on Earth. • Yet, they face serious threats from upstream industrialization and climate change, which alter sup How to Evaluate Jailbreak Methods: A Case Study with the StrongREJECT Benchmark https://cluster-site.onrender.com/posts/how-to-evaluate-jailbreak-methods-a-case-study-with-the-strongreject-benchmark/ Wed, 28 Aug 2024 15:30:00 +0000 https://cluster-site.onrender.com/posts/how-to-evaluate-jailbreak-methods-a-case-study-with-the-strongreject-benchmark/ • When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could jailbreak frontier LLMs simply by translating forbidden prompts into obscure la