AIcrowd | Meta KDD Cup 24 - CRAG - End-to-End Retrieval-Augmented Generation

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #knowledge_graph #llm #knowledge_retrieval #question_answering_systems #retrieval_summarization Weight: 1.0

Submission #267159

graded

Submitted by

Score

0.044

Secondary Score

0.000

Message

View your submission at git@gitlab.aicrowd.com:HiImRyo/meta-kdd-cup-24-crag-retrieval-summarization@refs/tags/submission-task3-pipeline-v3.61/issues/117

Additional Information

repo_url

https://gitlab.aicrowd.com/HiImRyo/meta-kdd-cup-24-crag-retrieval-summarization

gitlab_project_id

12207

gitlab_note_id

213891

gitlab_issue_iid

117

original_submission_id

266410

exact_accuracy

0.08807985907222549

accuracy

0.17498532002348796

hallucination

0.13094539048737522

missing

0.6940692894891368

n_miss

1182

n_correct

298

n_correct_exact

150

total

1703

sample_prediction_time_mean

10.586625647401991