Evaluation timed out

@yilun_jin
@aicrowd_team

View post 0

Evaluation timed out

I encountered errors when submitting results for Track 2 and Track 4 during the validation phase. The error message was “Evaluation timed out.” However, using the same configuration, I successfully submitted results for Track 1 and Track 5. Here are the links for reference:

When I checked the [debug logs], there were no indications of errors during the validation phase, which is quite confusing. Could you please check if there is an issue with the submission system? Or is there something incorrect in my submission process?

View post 0

Phase 2 launching!

Thank you for answering my previous question.

By the way, does the inference time per sample need to be determined based on the maximum length of the answer? For example, the official test shows an average inference time per sample of less than 0.2 seconds. However, if an answer contains more than 50 tokens, it is very likely to cause a timeout and result in a submission failure. This seems to be an issue that cannot be optimized.

View post 0

Phase 2 launching!

I noticed that the competition guidelines mention that Phase 2 will feature “more and harder tasks.” However, I recently checked the leaderboard and saw that one of the teams has submitted their results for Phase 2, and their score is exactly the same as their Phase 1 score.

Could you please clarify if the data has not been changed between phases, or if there might be an error in the task description? Is it normal to see identical scores across both phases?

image1015×118 17.2 KB

View post 0

Gitlab could not log in

@aicrowd_team need help

View post 0

Push gitlab and cannot find issue

@yilun_jin This seems like a bug on the AIcrowd platform. After today’s deadline, could the platform provide some additional time for teams that were unable to submit successfully?

View post 0

Push gitlab and cannot find issue

Have you solved the same problem?

View post 0

Gitlab could not log in

image1064×830 38.6 KB

View post 0

A few questions regarding my Docker image construction

Thank you for your response. I have one more question regarding the server environment used by the official setup. I’ve encountered issues during Docker builds in an offline environment, where if the CUDA version of the Docker image is higher than that of the host machine, it might lead to build failures. Could you please provide details on the Nvidia Driver Version used on the online server and any other configurations that might have an impact?

View post 0

A few questions regarding my Docker image construction

1. I noticed that in the start-kit, the Dockerfile imports the base image FROM nvidia/cuda:11.8.0-cudnn8-runtime-ubuntu20.04. However, I require a higher version of CUDA and also need components like NCCL from the CUDA toolkit. Can I replace the base image source with FROM nvidia/cuda:12.1.0-cudnn8-devel-ubuntu20.04 and expect it to run smoothly?
2. Does the official server environment support CUDA versions 12.1 and above? If not, how can we work around this issue?

View post 0

How to understand the input_field and out_field in this sample?

I have the same question. Our doubt is not about the meaning of ‘the matching weights,’ but rather how they are generated. Is this related to Amazon’s business system? At first, we thought the weights were obtained by smoothing the CTR of the items corresponding to the query. However, we have observed that the output values are only 1, 0.01, 0.1, and 0, which is not quite consistent with our assumption. We hope you can help clarify this issue.

View post 0

The prediction progress for item 1490/1576 has failed, and there is no corresponding error message recorded in the log

@aicrowd_team Could you help me take a look at it?

View post 0

The prediction progress for item 1490/1576 has failed, and there is no corresponding error message recorded in the log

(post deleted by author)

View post 0

The prediction progress for item 1490/1576 has failed, and there is no corresponding error message recorded in the log

As title

bug1438×665 50.1 KB

View post 0

Post-Competition Inquiries: Workshop Paper Opportunities?

@snehananavati
@dipam

View post 0

Post-Competition Inquiries: Workshop Paper Opportunities?

I just wanted to start off by saying congratulations on the awesome completion of the KDD Cup competition! It was such a thrilling experience, and I want to give a shout-out to the organizers for putting on such an amazing event.

Now that the competition is over, I’ve got a burning question about what happens next. I’m curious to know if there’s a chance for us to submit workshop papers based on our work. It would be fantastic to have an avenue to share our findings and possibly collaborate with fellow participants.

View post 4

When is the deadline of team up

@snehananavati This problem is important to us. Please help us clarify this rule.

View post 0

When is the deadline of team up

@dipam I have the same question.

View post 0

🚨 Phase 2 Is Now Live

I wanted to bring to your attention an issue regarding the Phase 2 leaderboard. While it is currently possible to submit prediction results, the leaderboard for Phase 2 is not displaying correctly. I am curious to know what might be the cause of this problem.

View post 0

Clarification and More Information for Phase 2

I wanted to bring to your attention an issue regarding the Phase 2 leaderboard. While it is currently possible to submit prediction results, the leaderboard for Phase 2 is not displaying correctly. I am curious to know what might be the cause of this problem.

View post 0