
Location
Badges
Activity
Challenge Categories
Challenges Entered
Revolutionise E-Commerce with LLM!
Latest submissions
See Allgraded | 270835 | ||
graded | 270834 | ||
failed | 270279 |
Amazon KDD Cup 2023
Latest submissions
Participant | Rating |
---|
Participant | Rating |
---|
-
AML_LabCityU Amazon KDD Cup 2024: Multi-Task Online Shopping Challenge for LLMsView
Amazon KDD Cup 2024: Multi-Task Online Shopping Ch


Note for our final evaluation
7 months agoHi, @yilun_jin thanks a lot for organizing this amazing competition. We really appreciate this chance and the wonderful journey you provide. However, we have a concern regarding the rerun in the final evaluation.
In this discussion page: Note for our final evaluation, we notice that rerun behavior may potentially cause unfairness.
First, all teams experienced submission failures before the end, and network issues were the same for all teams. Participants should consider the impact of network issues in advance because the competition has already provided ample time for participants to experiment to mitigate the impact of network issues.
Second, most of the teams followed the regulations and filled in the IDs for final scoring before the deadline, which means their score was fixed. In contrast, the teams requesting reruns did not submit their IDs, giving them ample room for improvement.
Based on this, we hope the organizers will carefully consider the rerun measure and inform all participants through an official announcement. If reruns are allowed, all participating teams should be notified that they can rerun failed submissions and be given additional time to reorganize their sheets. If reruns are not allowed, we suggest clarifying the current situation in discussions and all reruns after 10th July, 2024 23:55 UTC should not be considered for the final evaluation.
Note for our final evaluation
7 months agoThank you for your detailed explanation. We fully understand the difficulties in hosting such an international competition, and sincerely hope the competition will continue to improve going forward.