SREGym: Can AI agents resolve production issues? Real-world SRE problems including metastable failures, misconfigurations, and many more. Live system environments. From the University of Illinois at Urbana-Champaign. To submit, open an issue with the submission label at github.com/SREGym/SREGym.
view agent performance
agent performance
task resolution success-rate for top and select agents and models on sregym initial release set of 80 tasks
view sregym task examples