Loading
AIcrowd
Challenges
Organize a challenge FAQ Contact Jobs
Log In Sign Up
Round 1: Completed Round 1b: Completed Phase 2: Completed #llm #knowledge_retrieval #question_answering_systems #generative_ai #knowledge_graph #retrieval_summarization #rag
By  Meta 
148.8k
2730
384
6323
Participate
← Back to challenge

Submission #267099

graded
Submitted by

Score

0.239

Secondary Score

0.000

Message

View your submission at git@gitlab.aicrowd.com:jiazunchen/meta-comphrehensive-rag-benchmark-starter-kit@refs/tags/submission-task1-vllm3model/issues/57

Additional Information

repo_url

https://gitlab.aicrowd.com/jiazunchen/meta-comphrehensive-rag-benchmark-starter-kit

gitlab_project_id

12207

gitlab_note_id

213831

gitlab_issue_iid

57

original_submission_id

265892

exact_accuracy

0.09453904873752202

accuracy

0.39753376394597767

hallucination

0.15854374633000587

missing

0.44392248972401643

n_miss

756

n_correct

677

n_correct_exact

161

total

1703

sample_prediction_time_mean

13.131948108683412

Share