Potential bug with the evaluation metrics for Track 1

@snehananavati We sincerely request additional time to further improve our solutions.

View post 0

Potential bug with the evaluation metrics for Track 1

@OwO Yes, this problem still exists.

@aicrowd_team Please check this again

View post 0

Potential bug with the evaluation metrics for Track 1

@snehananavati @aicrowd_team Any plans to extend the deadline? We request for more time to enjoy this challenge.

View post 0

Potential bug with the evaluation metrics for Track 1

@snehananavati Anything new? The deadline is coming

View post 0

Potential bug with the evaluation metrics for Track 1

Thanks for your attention.

View post 0

Potential bug with the evaluation metrics for Track 1

@snehananavati @aicrowd_team

Hi,

We have identified a potential issue with the evaluation metrics for Track 1.

According to the official rules, the primary evaluation metric for Track 1 is AV_ALIGN. However, the AV_ALIGN score displayed on the leaderboard appears to be inconsistent with the score shown on the submission page. For instance:

The current top-ranked AV_ALIGN score on the leaderboard is 0.418.

image2886×278 60.3 KB

However, on the submission page here, the AV_ALIGN score is 0.357.

image1426×1710 190 KB

We suspect that the scores for AV_ALIGN and TA may have been inadvertently swapped, which could lead to confusion among participants.

Could you please look into this issue?

Thank you for your time and assistance.

Best regards

View post 0

💬 Feedback & Suggestions

@snehananavati @aicrowd_team Hello, for Track 2, would it be possible to first generate a video using an unconditional video generation model and then synthesize the corresponding audio using a video-to-audio model?

View post 0

⏰ Challenge Breakdown and Q&A: Live with the Organisers | 23rd January, 10 AM CET

Looking forward to

View post 0

💬 Feedback & Suggestions

@aicrowd_team My submission has been evaluated sucessfully, however, it has not shown in the leaderboard of phrase2.

View post 0

💬 Feedback & Suggestions

@aicrowd_team Yes, however, it has not shown in the leaderload of phrase2

View post 0

💬 Feedback & Suggestions

@aicrowd_team Hello, I have submitted in phase 2, but the leaderboard hasn’t updated yet. Could you please to check this?

View post 0

💬 Feedback & Suggestions

I submitted my baseline but the progress is stuck in the validation phase. Can you help me check this?

View post 0

About the Temporal Alignment Track category

I submitted my baseline but the progress is stuck in the validation phase. Can you help me check this?

View post 0

Which Leaderboard Determines the Final Prize?

Hello, we’ve observed that the competition consists of three rounds: the warm-up round, round 1, and round 2. We would like to clarify which leaderboard from these rounds will be used to determine the final prize.

View post 0

Prize of Task1

Hi,

We have observed that the prizes for Task 1 are as follows: First place receives 15,000 USD, second place receives 7,000 USD, and third place receives 3,000 USD. However, Task 1 comprises two tracks, namely the GPU and Prompt Engineering Tracks. We are curious to know if the prizes are separate for each track. For instance, if an individual secures the first place in both tracks, would they receive a total of 30,000 USD?

View post 0