Source symbols: evals/old/hotpot_qa_24_2025/src/analysis/analyze_single_benchmark.py

Deterministic, value-free symbol metadata extracted from public source. Implementations and literal values are not copied into this page.

• Revision: main@90b4acaac937dc1c0aeffaead8b707c896ebf3db · 2026-07-22T09:03:55Z
• Declarations: 5
• Referenced calls: 21

Declared symbols

• create_project_structure — def at line 15; references Path, mkdir, print, str
• process_and_validate_data — def at line 29; references print, process_results, transform_results, validate_question_consistency, ValueError
• create_all_dataframes — def at line 47; references print, create_answers_df, create_all_metrics_df, create_aggregate_metrics_df, cumulative_all_metrics_analysis, mean
• analyze_single_benchmark_folder — def at line 87; references print, create_project_structure, exists, FileNotFoundError, process_and_validate_data, create_all_dataframes
• main — def at line 120; references analyze_single_benchmark_folder

File-level call references

• import — line 5
• Path — line 17
• mkdir — line 21
• print — line 23
• str — line 26
• process_results — line 34
• transform_results — line 37
• validate_question_consistency — line 40
• ValueError — line 41
• create_answers_df — line 52
• create_all_metrics_df — line 56
• create_aggregate_metrics_df — line 62
• cumulative_all_metrics_analysis — line 71
• mean — line 83
• create_project_structure — line 97
• exists — line 102
• FileNotFoundError — line 103
• process_and_validate_data — line 106
• create_all_dataframes — line 109
• analyze_single_benchmark_folder — line 122
• main — line 130

Source: evals/old/hotpot_qa_24_2025/src/analysis/analyze_single_benchmark.py