Semaine 10 mercredi - Les Résultats!

~ mercredi ~

I think it works!!!!!

Hold on.

Layer 1: SVM, RBF kernel
Layer 2: SVM, 3rd degree Polynomial

Final result (i.e. layer 2 cuisine classification) with cross validation:
Fold    Accuracy
0       60.000000
1       86.666664
2       95.555557
3       86.666664
4       85.416664
mean     82.8611010
var     143.854935
stdev   11.993954

Q1: How do I know whether it's overfitting? Can I check somehow? If I do 5th degree polynomial, then it's lower:
Layer 2: SVM, 5th degree Polynomial
Fold       Accuracy
0               51.111111%
1               77.777779%
2               84.444443%
3               77.777779%
4               83.333336%
mean             74.888890%
var             148.938279
std dev         12.204027
When I used RBF kernel, it just didn't work at all, almost everything gets classified as a single class, so the accuracy is around 33.33%.

Q2: The variance looks really large. Fold 0 for some reason doesn't work well.