Submission Times

We also investigated our submissions again, I have two more findings

1. we seemed to only have tested debug=True once on Mar 30th and left it to debug=False since then. We didn’t notice it back then but we can confirm that we got 6 submissions through on that day. As I remember, the reasons for enabling it, was to check weather we get more accurate readings on the runtime duration (not the case ) Here is the blame log for aicrowd.json.
   

   

   image2392×1132 335 KB

2. The listing that @JusperLee posted above, showing that we got 7 submissions on May 8th UTC. seems not related to the debug issue. In fact, there seem to be two other reasons for it:

• AIcrowd | Cinematic Sound Demixing Track - CDX'23 | Submissions #220227 was not a May 8th UTC submission since the 24h fixed window was applied for the CDX task as explained above by @dipam.
• AIcrowd | Cinematic Sound Demixing Track - CDX'23 | Submissions #220233 submission 1
• AIcrowd | Cinematic Sound Demixing Track - CDX'23 | Submissions #220258 submission 2
• AIcrowd | Cinematic Sound Demixing Track - CDX'23 | Submissions #220278 submission 3
• AIcrowd | Cinematic Sound Demixing Track - CDX'23 | Submissions #220392 submission 4
• AIcrowd | Cinematic Sound Demixing Track - CDX'23 | Submissions #220397 submission 5
• AIcrowd | Cinematic Sound Demixing Track - CDX'23 | Submissions #220402 this submission is identical to 220307. In fact we accidentially created a new tag for the exact same git commit. Funnily, it seems the submission system created identical timestamps and logs for both, so it might be the same submission and we accidentially discovered that you can do unlimited submission (when they are all the same)… I don’t think there is any way to benefit from this issue, right?

update: @dipam already mentioned the second issue in his post above

View post 0

Post-challenge discussion

(post deleted by author)

View post 0

Submission Times

Hi,

first, congrats to your great scores!

I didn’t get any extra submissions and, to be honest, had a hard time understanding how the submission quota actually works, myself. As I didn’t team up with individual accounts, the max submission count was likely different. I can’t say if aicrowd has some rounding issues when it comes to team submissions vs individual submission so maybe they can improve their docs on this part.

View post 1

No submission remaining

Hi wondering how the submission are counted. If it’s by local time zone, then my account should have 7 left, if by a rolling window counting backwards 24 hours ago, my account still should have 3. Any explain nations? thank you.

View post 0