🏆 ColliderML Benchmark Leaderboard
Beat any metric → earn credits. Reproduce someone's result → earn credits. All scoring is server-side against held-out truth.
tracking — Track reconstruction on ttbar pu200 — TrackML weighted efficiency, fake/dup rates
Top submissions — tracking
HTTPSConnectionPool(host='api.colliderml.com', port=443): Max retries exceeded with url: /v1/leaderboard/tracking?limit=100 (Caused by NameResolutionError("HTTPSConnection(host='api.colliderml.com', port=443): Failed to resolve 'api.colliderml.com' ([Errno -2] Name or service not known)")) |
jets — Jet flavour classification on ttbar pu0 — b-tag AUC, rejection rates
Top submissions — jets
HTTPSConnectionPool(host='api.colliderml.com', port=443): Max retries exceeded with url: /v1/leaderboard/jets?limit=100 (Caused by NameResolutionError("HTTPSConnection(host='api.colliderml.com', port=443): Failed to resolve 'api.colliderml.com' ([Errno -2] Name or service not known)")) |
anomaly — BSM anomaly detection — AUROC, signal efficiency @ 1% FPR
Top submissions — anomaly
HTTPSConnectionPool(host='api.colliderml.com', port=443): Max retries exceeded with url: /v1/leaderboard/anomaly?limit=100 (Caused by NameResolutionError("HTTPSConnection(host='api.colliderml.com', port=443): Failed to resolve 'api.colliderml.com' ([Errno -2] Name or service not known)")) |
tracking_latency — Wall-clock time on 1000 eval events
Top submissions — tracking_latency
HTTPSConnectionPool(host='api.colliderml.com', port=443): Max retries exceeded with url: /v1/leaderboard/tracking_latency?limit=100 (Caused by NameResolutionError("HTTPSConnection(host='api.colliderml.com', port=443): Failed to resolve 'api.colliderml.com' ([Errno -2] Name or service not known)")) |
tracking_small — Best efficiency under a parameter budget
Top submissions — tracking_small
HTTPSConnectionPool(host='api.colliderml.com', port=443): Max retries exceeded with url: /v1/leaderboard/tracking_small?limit=100 (Caused by NameResolutionError("HTTPSConnection(host='api.colliderml.com', port=443): Failed to resolve 'api.colliderml.com' ([Errno -2] Name or service not known)")) |
data_loading — Throughput of data loading pipelines
Top submissions — data_loading
HTTPSConnectionPool(host='api.colliderml.com', port=443): Max retries exceeded with url: /v1/leaderboard/data_loading?limit=100 (Caused by NameResolutionError("HTTPSConnection(host='api.colliderml.com', port=443): Failed to resolve 'api.colliderml.com' ([Errno -2] Name or service not known)")) |