Loss function
loss function is set to a default value currently based on the output layer Please add a loss parameter to training language.
therefore, create a table with
- default loss functions for different output layers (e.g. softmax -> cross entropy, fc -> mse, etc.)
- forbidden (or allowed) combinations (xentropy cannnot be used if the output is not a valid probability, etc)
extend the generator
lets support the loss functions listed here: https://heartbeat.fritz.ai/5-regression-loss-functions-all-machine-learners-should-know-4fb140e9d4b0
@sebastian.nickels do you need any other loss definitions?