Round 1: Completed
Round 1b: Completed
Phase 2: Completed
#llm
#knowledge_retrieval
#question_answering_systems
#generative_ai
#knowledge_graph
#retrieval_summarization
#rag
154k
2790
384
6323
This challenge is not accepting submissions anymore.
| Δ | # | Participants | Score | Submission Trend |
Meta KDD Cup 24 - CRAG - Retrieval Summarization Weight: 1.0 |
Meta KDD Cup 24 - CRAG - Knowledge Graph and Web Retrieval Weight: 1.0 |
Meta KDD Cup 24 - CRAG - End-to-End Retrieval-Augmented Generation Weight: 1.0 |
|---|---|---|---|---|---|---|---|
|
01 |
|
4.000 |
Loading...
|
2 0.279 |
0.321
|
0.294
|
|
|
02 |
TieMoJi
|
11.000 |
Loading...
|
4 0.225 | 3 0.234 | 4 0.201 |
|
|
02 |
|
11.000 |
Loading...
|
7 0.162 | 2 0.318 | 2 0.251 |
|
|
03 |
|
12.000 |
Loading...
|
3 0.231 | 4 0.228 | 5 0.18 |
|
|
04 |
|
13.000 |
Loading...
|
6 0.174 | 4 0.228 | 3 0.211 |
|
|
05 |
|
24.000 |
Loading...
|
10 0.129 | 8 0.135 | 6 0.115 |
|
|
06 |
|
25.000 |
Loading...
|
10 0.129 | 9 0.123 | 6 0.115 |
|
|
07 |
ruleisallyouneed
|
30.000 |
Loading...
|
10 0.129 | 7 0.147 | 13 0.059 |
|
|
08 |
|
44.000 |
Loading...
|
15 0.108 | 13 0.075 | 16 0.025 |
|
|
09 |
|
47.000 |
Loading...
|
21 0.072 | 15 0.072 | 11 0.08 |
|
|
10 |
jax_yu
|
50.000 |
Loading...
|
17 0.096 | 12 0.081 | 21 0.003 |
|
|
11 |
|
51.000 |
Loading...
|
19 0.075 | 17 0.057 | 15 0.037 |
|
|
12 |
|
52.000 |
Loading...
|
19 0.075 | 13 0.075 | 20 0.009 |
|
|
13 |
|
60.000 |
Loading...
|
29 0.042 | 21 0.051 | 10 0.087 |
|
|
14 |
|
63.000 |
Loading...
|
15 0.108 | 17 0.057 | 31 -0.043 |
|
|
14 |
|
63.000 |
Loading...
|
26 0.057 | 16 0.063 | 21 0.003 |
|
|
15 |
li_mark
|
69.000 |
Loading...
|
23 0.069 | 27 0.0 | 19 0.015 |
|
|
15 |
|
69.000 |
Loading...
|
33 0.033 | 20 0.054 | 16 0.025 |
|
|
16 |
|
73.000 |
Loading...
|
33 0.033 | 27 0.0 | 13 0.059 |
|
|
17 |
|
81.000 |
Loading...
|
5 0.186 | 6 0.183 | - |
|
|
18 |
|
86.000 |
Loading...
|
40 0.0 | 23 0.021 | 23 0.0 |
|
|
18 |
crag
|
86.000 |
Loading...
|
40 0.0 | 17 0.057 | 29 -0.028 |
|
|
19 |
|
87.000 |
Loading...
|
9 0.144 | - | 8 0.105 |
|
|
20 |
|
89.000 |
Loading...
|
7 0.162 | - | 12 0.071 |
|
|
20 |
|
89.000 |
Loading...
|
- | 10 0.099 | 9 0.093 |
|
|
21 |
|
90.000 |
Loading...
|
40 0.0 | 27 0.0 | 23 0.0 |
|
|
21 |
|
90.000 |
Loading...
|
40 0.0 | 27 0.0 | 23 0.0 |
|
|
21 |
minhnp2306
|
90.000 |
Loading...
|
40 0.0 | 27 0.0 | 23 0.0 |
|
|
21 |
|
90.000 |
Loading...
|
40 0.0 | 27 0.0 | 23 0.0 |
|
|
22 |
|
94.000 |
Loading...
|
13 0.117 | 11 0.096 | - |
|
|
23 |
|
106.000 |
Loading...
|
52 -0.027 | 38 -0.03 | 16 0.025 |
|
|
24 |
|
112.000 |
Loading...
|
38 0.015 | 42 -0.075 | 32 -0.053 |
|
|
25 |
|
113.000 |
Loading...
|
61 -0.066 | 24 0.018 | 28 -0.006 |
|
|
26 |
|
125.000 |
Loading...
|
21 0.072 | 34 -0.003 | - |
|
|
26 |
|
125.000 |
Loading...
|
25 0.06 | - | 30 -0.031 |
|
|
26 |
|
125.000 |
Loading...
|
54 -0.033 | 36 -0.021 | 35 -0.096 |
|
|
27 |
|
128.000 |
Loading...
|
33 0.033 | 25 0.003 | - |
|
|
28 |
|
131.000 |
Loading...
|
39 0.003 | 22 0.03 | - |
|
|
29 |
|
136.000 |
Loading...
|
31 0.036 | 35 -0.018 | - |
|
|
30 |
|
139.000 |
Loading...
|
36 0.018 | - | 33 -0.062 |
|
|
30 |
|
139.000 |
Loading...
|
62 -0.069 | 41 -0.072 | 36 -0.133 |
|
|
31 |
|
141.000 |
Loading...
|
0.459
|
- | - |
|
|
32 |
yong_deng4
|
154.000 |
Loading...
|
14 0.114 | - | - |
|
|
33 |
|
156.000 |
Loading...
|
50 -0.021 | 36 -0.021 | - |
|
|
34 |
|
158.000 |
Loading...
|
18 0.078 | - | - |
|
|
35 |
|
162.000 |
Loading...
|
53 -0.03 | 39 -0.033 | - |
|
|
36 |
|
164.000 |
Loading...
|
24 0.063 | - | - |
|
|
36 |
|
164.000 |
Loading...
|
60 -0.057 | - | 34 -0.093 |
|
|
37 |
|
165.000 |
Loading...
|
- | 25 0.003 | - |
|
|
38 |
|
166.000 |
Loading...
|
26 0.057 | - | - |