AGREE
[Getting Started Notebook] AGREE Challange
This is a Baseline Code to get you started with the challenge.
gauransh_k
You can use this code to start understanding the data and create a baseline model for further imporvments.
Starter Code for AGREE Practice Challange
Note : Create a copy of the notebook and use the copy for submission. Go to File > Save a Copy in Drive to create a new copy
Downloading Dataset¶
Installing aicrowd-cli
In [1]:
!pip install aicrowd-cli
%load_ext aicrowd.magic
In [2]:
%aicrowd login
In [2]:
!rm -rf data
!mkdir data
%aicrowd ds dl -c agree -o data
In [3]:
# removing extra blank line at the end from the dataset
!sed -i '$ d' data/train.csv
!sed -i '$ d' data/test.csv
Importing Libraries¶
In this baseline, we will be using skleanr library to train the model and generate the predictions
In [4]:
import pandas as pd
import numpy as np
from sklearn.model_selection import train_test_split
from sklearn.ensemble import GradientBoostingRegressor
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.preprocessing import normalize
from scipy.sparse import hstack
import os
from IPython.display import display
Reading the dataset¶
Here, we will read the train.csv which contains both training samples & labels, and test.csv which contains testing samples.
In [5]:
# Reading the CSV
name=["unit_id", "golden_or_not", "unit_state", "trusted_judgments", "last_judgment_at", "agree_or_not_variance", "sentence", "agree_or_not"]
train_data_df = pd.read_csv("data/train.csv",names=name , encoding='ISO-8859–1')
test_data_df = pd.read_csv("data/test.csv",names=name[:-1], encoding='ISO-8859–1')
# train_data.shape, test_data.shape
display(train_data_df.head())
display(test_data_df.head())
print(train_data_df.shape, test_data_df.shape)
Data Preprocessing¶
In the preprocessing we have a lot of textual data so we will first One-Hot Encode the Possible Features and use TF IDF Tokens to convert the sentence to a possible feature and use it in the regression.
In [6]:
# utility function to one hot encode the dataset
def one_hot_df(df):
df = pd.concat([df, pd.get_dummies(df["golden_or_not"])],axis=1)
df.drop("golden_or_not",axis=1, inplace=True)
df = pd.concat([df, pd.get_dummies(df["unit_state"])],axis=1)
df.drop("unit_state",axis=1, inplace=True)
return df
In [7]:
train_data_df = one_hot_df(train_data_df)
test_data_df = one_hot_df(test_data_df)
display(train_data_df)
display(test_data_df)
Transfroming Train Data for Submission¶
In [8]:
# For beginning, transform train_data_df['sentence'] to lowercase using text.lower()
train_data_df['sentence'].str.lower()
# Then replace everything except the letters and numbers in the spaces.
# it will facilitate the further division of the text into words.
train_data_df['sentence'].replace('[^a-zA-Z0-9]', ' ', regex = True)
# Convert a collection of raw documents to a matrix of TF-IDF features with TfidfVectorizer
vectorizer = TfidfVectorizer(min_df=5)
X_tfidf = vectorizer.fit_transform(train_data_df['sentence'])
# merging final features to the Dataframe and removing the redundent colums
train_data_df = pd.concat([train_data_df,pd.DataFrame(X_tfidf.toarray())], axis=1)
train_data_df.drop("sentence", axis=1, inplace=True)
display(train_data_df)
In [9]:
# Separating data from the dataframe for final training
X = normalize(train_data_df.drop(["unit_id", "last_judgment_at", "agree_or_not"], axis=1).to_numpy())
y = train_data_df["agree_or_not"].to_numpy()
print(X.shape, y.shape)
Transfroming Test Data for Submission¶
In [10]:
# For beginning, transform test_data_df['sentence'] to lowercase using text.lower()
test_data_df['sentence'].str.lower()
# Then replace everything except the letters and numbers in the spaces.
# it will facilitate the further division of the text into words.
test_data_df['sentence'].replace('[^a-zA-Z0-9]', ' ', regex = True)
# Convert a collection of raw documents to a matrix of TF-IDF features with TfidfVectorizer
X_tfidf_test = vectorizer.transform(test_data_df['sentence'])
# merging final features to the Dataframe and removing the redundent colums
test_data_df = pd.concat([test_data_df,pd.DataFrame(X_tfidf_test.toarray())], axis=1)
test_data_df.drop("sentence", axis=1, inplace=True)
display(test_data_df)
Splitting the data¶
In [11]:
# Splitting the training set, and training & validation
X_train, X_val, y_train, y_val = train_test_split(X, y, test_size=0.2)
print(X_train.shape)
print(y_train.shape)
In [12]:
X_train[0], y_train[0]
Out[12]:
Training the Model¶
In [13]:
model = GradientBoostingRegressor()
model.fit(X_train, y_train)
Out[13]:
Validation¶
In [14]:
model.score(X_val, y_val)
Out[14]:
So, we are done with the baseline let's test with real testing data and see how we submit it to challange.
Predictions¶
In [15]:
# Separating data from the dataframe for final testing
X_test = normalize(test_data_df.drop(["unit_id", "last_judgment_at"], axis=1).to_numpy())
print(X_test.shape)
In [16]:
# Predicting the labels
predictions = model.predict(X_test)
predictions.shape
Out[16]:
In [17]:
# Converting the predictions array into pandas dataset
submission = pd.DataFrame({"agree_or_not":predictions})
submission
Out[17]:
In [18]:
# Saving the pandas dataframe
!rm -rf assets
!mkdir assets
submission.to_csv(os.path.join("assets", "submission.csv"), index=False)
Submitting our Predictions¶
Note : Please save the notebook before submitting it (Ctrl + S)
In [19]:
!!aicrowd submission create -c agree -f assets/submission.csv
Out[19]:
In [ ]:
Content
Comments
You must login before you can post a comment.