Source symbols: tasks/mmlu.py

Deterministic, value-free symbol metadata extracted from public source. Implementations and literal values are not copied into this page.

• Revision: master@92d63d4e8bb4df75c3b71618f31ddde2378b2bcd · 2026-07-04T18:18:25Z
• Declarations: 6
• Referenced calls: 6

Declared symbols

• MMLU — class at line 8; references super, __init__, load_hub_dataset, shuffle, len, render_mc
• __init__ — def at line 13; references super, load_hub_dataset, shuffle, len, render_mc
• eval_type — def at line 22; references len, render_mc
• num_examples — def at line 25; references len, render_mc
• get_example — def at line 28; references len, render_mc
• evaluate — def at line 49

File-level call references

• super — line 14
• __init__ — line 14
• load_hub_dataset — line 19
• shuffle — line 19
• len — line 26
• render_mc — line 36

Source: tasks/mmlu.py