Killed by LLM is a project that documents public AI benchmarks that LLM-based AI systems have largely solved since 2018.  Getting killed means that a benchmark no longer measures the frontier of AI technology as a challenge asking "Can AI do X?", but might still be a useful tool. Links to papers documenting fallen benchmarks are provided.