Irregular (formerly Pattern Labs) researchers' paper, "What Makes an Evaluation Useful? Key Guidelines and Best Practices," was accepted to the Frontier AI Safety Frameworks conference.
This paper is a synthesis and update on parts of the blog posts series we published in the autumn of 2024, and published with its proceedings.
Our researchers also took part in the conference workshop discussing the most pressing challenges in the design and implementation of frontier AI safety frameworks.