Location
VN
Badges
Activity
Challenge Categories
Challenges Entered
Completed
Meta
Improve RAG with Real-World Benchmarks
Latest submissions
See All| graded | 266335 | ||
| graded | 266193 | ||
| graded | 266168 |
Seerave Foundation
A benchmark for image-based food recognition
Latest submissions
Institute of Global Health
LifeCLEF
Classify images of snake species from around the world
Latest submissions
See All| graded | 10024 | ||
| graded | 6995 | ||
| failed | 6992 |
AIcrowd
5 Problems 15 Days. Can you solve it all?
Latest submissions
See All| graded | 74031 | ||
| graded | 73938 | ||
| graded | 73831 |
Max Planck Institute for Intelligent Systems
Disentanglement: from simulation to real-world
Latest submissions
Unity Technologies
A new benchmark for Artificial Intelligence (AI) research in Reinforcement Learning
Latest submissions
Latest submissions
See All| graded | 73807 | ||
| graded | 73198 | ||
| graded | 72790 |
Testing RAG Systems with Limited Web Pages
Latest submissions
See All| graded | 266167 | ||
| failed | 266122 | ||
| failed | 265909 |
Evaluating RAG Systems With Mock KGs and APIs
Latest submissions
See All| graded | 266168 | ||
| failed | 266069 | ||
| graded | 266068 |
Enhance RAG systems With Multiple Web Sources & Mock API
Latest submissions
See All| graded | 266335 | ||
| graded | 266193 | ||
| failed | 266166 |
Sony Group Corporation
Create Videos with Spatially Aligned Stereo Audio
Latest submissions
| Participant | Rating |
|---|---|
alchemi01
|
235 |
| Participant | Rating |
|---|
Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937
Did somebody try deploy three llama3-8b on four T4?
10 months agoHow large is each llama3-8b model? If it is 16GB each, itβs possible.
Whether the task test phase can link to the Internet
10 months agoThere is the Internet when building the Docker image. But no internet when they run submissions.
The CRAG-Mock-API should move to the Meta Comphrehensive RAG Benchmark starter kit project?
10 months agoThe docker file can be customized. It is the environment to run the code in gitlab.
The CRAG-Mock-API should move to the Meta Comphrehensive RAG Benchmark starter kit project?
11 months agoLook at crag_mock_api/apiwrapper/pycragapi.py to see how to use its functions.
The openai interface cannot be used during evaluation? Why?
11 months agoYou need to pass API key. There is also no internet in the submission.
Added tag with "submission-v" prefix but no evaluation issue created
11 months agoGot this issue again.
When will the submission limit be reset?
11 months agoIn the Submission tab of the main challenge page, we can see how many submissions are left this week.
Is anyone using Colab for this competition?
11 months agoYou can use Colab, but having a local GPU is more convenient for debugging and checking submission
Meta KDD Cup 24 - CRAG - Retrieval Summarization
Failed to communicate with the grader
10 months agoI had the same issue. Is it fixed now? @aicrowd_team
Couldn't instantiate the backend tokenizer
11 months agoHave you tried installing the transformer package?
About Test Set Leakage in Round 1
11 months ago@aicrowd_team I suggest that the Round 2 test set should be truly private and not share any similarity or distribution with the data in Round 1.
Why am I not eligible to participate?
11 months agoI have tried again and still failed with the same reason
Can we use huggingface to upload our model weightοΌ
11 months agoI have the same question @mohanty
MASKD
MMdetection unable to form final test file
Over 4 years agoLooking at the starter/baseline code. Thereβs the example for preparing the submission.
CHESS
About the dataset
Over 4 years agoThanks for the reply.
I make another submission without external data. However, the leaderboard doesnβt seem to be updated:
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73348
Is it ok to make submission now? @ashivani
Did somebody try deploy three llama3-8b on four T4?
10 months agoThere are 4 T4 cards. But I see that the total GPU memory is < 60GB.