Skip to content

Fix duplicate leaderboard entries and clipped display names - #266

Merged
msaroufim merged 1 commit into
mainfrom
agent/leaderboard-deduplicate-ties
Oct 29, 2026
Merged

msaroufim merged 1 commit into
mainfrom
agent/leaderboard-deduplicate-ties

Conversation

@alexzhang13

@alexzhang13 alexzhang13 commented Oct 29, 2026 •

Copy link
Copy Markdown
Collaborator

Users with several submissions tied for their best score appeared multiple times per GPU. On matmul_v2/A100, zjsxply appeared three times and Fridolin Haugg twice.

Select one best run per account and GPU with ROW_NUMBER, breaking ties by earliest submission time, submission ID, and run ID. Apply this rule to API rankings, legacy pages, summaries, and the ranking worker. Bump the ended-summary cache namespace so cached duplicates are recomputed. Score ties between different accounts remain intact.

Validation: 15 targeted tests passed using local PostgreSQL and an in-memory Redis substitute (Docker unavailable). Coverage includes tied submissions, repeated runs, different accounts sharing a name, submission counts, and hacked/failed-secret filtering. Ruff and git diff --check passed. A read-only run of the corrected production query for leaderboard 540 returned one entry each for zjsxply and Fridolin with unchanged scores.

No database migration or submission changes are needed.

Long display names also clipped in narrow browser panes. Give names a full row on small screens and allow wrapping, keeping the exact requested name “Nebius Applied AI Team” readable. Verified in a local browser preview using public production API data; frontend lint and production build passed. This adds a frontend change, so CI reruns on the new commit.

@msaroufim
msaroufim merged commit 6e7fee2 into main Oct 29, 2026
1 check passed
@alexzhang13 alexzhang13 changed the title Fix duplicate leaderboard entries for tied personal bests Fix duplicate leaderboard entries and clipped display names Oct 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants