Seems like EVERYONE's submission is getting 'FAILED'

Yes, a review / feedback on the issue would be great.

View post 0

Submission failure - pod deleted during operation

Hi team,

My last two submissions for Task 2 failed with a “Build Packages And Env: pod deleted during operation” error. Could someone look into it? It seems like an infrastructure issue.

View post 1

Updates to Task 1 Metrics

Thank you for the update @dipam, the new metrics seem more reasonable indeed. I have a few questions regarding the human evaluation though.

Me and my teammate are creating a new persona based chat dataset that is more diverse in terms of conversation settings and the number of persona facts, and will likely result in diverse and factually sensible responses that are a bit further away from the ground truth. Our questions are:

1. Is there a ranking cutoff for submissions selected for human evaluation?
2. What does the human evaluation metrics / rubric consists of?
3. Do we need to include the dataset during gitlab submission or will we be contacted for the dataset, documentation, etc. if our submission is selected for human evaluation?

View post 1

Can't download the public test dataset

@dipam could I get an update on this?

View post 1

Can't download the public test dataset

Hi @dipam, thanks for the quick reply. I get a This site can’t be reached error on all browsers (Brave, Chrome, Safari), and I’m based in Turkey.

View post 1

Can't download the public test dataset

Hi,

The download link for the public dataset under the resources tab is not working. Could you check and fix it?

Thanks in advance!

View post 0

Explained by the Community | 200 CHF Cash Prize X 5

Hi everyone,

I wrote a tutorial on how to build a baseline logistic regression model, hope you find it useful. Some of the topics I covered are:

• Basics of the SMILES format
• Data exploration - frequency of the odors
• Converting the data into a format that can be used as input to the model
• Building / training a logistic regression model with Keras
• Making and formatting predictions for submission
• Evaluating the model on the training set with Jaccard Index / Tanimoto Similarity Score

Here is the Colab notebook:
https://colab.research.google.com/drive/143hNxXLAje5_HvbEPnt4N6l7ZHcv9yWY?usp=sharing

View post 4