Can LLMs find 0day? Adventures in cybersecurity evals

Yoni Rozenshein's BlueHat IL 2024 talk is about our philosophy for evaluating AI dangerous cyber capabilities, how we actually do it (let's make an LLM play CTF!), and who cares about it (governments and frontier AI labs).

Watch the full presentation: https://www.youtube.com/watch?v=05-zL4f9V-Y

Stay updated

Sign up for our newsletter and get notified of irregular updates

CONNECT

hello@irregular.com

© 2026 Irregular. All rights reserved.

-

Developed by Dávid Kálmán

Stay updated

Sign up for our newsletter and get notified of irregular updates

CONNECT

hello@irregular.com

© 2026 Irregular. All rights reserved.

-

Developed by Dávid Kálmán

Stay updated

Sign up for our newsletter and get notified of irregular updates

CONNECT

hello@irregular.com

© 2026 Irregular. All rights reserved.

-

Developed by Dávid Kálmán