Activation Layer
/ˌæktɪˈveɪʃən ˈleɪər/
Activation Layer: A layer that applies a non-linear activation function element-wise to its input. Activation layers introduce non-linearity, enabling networks to learn complex patterns. Often placed after linear transformations (convolution, dense layers). Common: ReLU, sigmoid, tanh layers. Examples include ReLU activation layer, Sigmoid output layer, Tanh hidden layer.
In italiano: Layer di AttivazioneLegge III · Come una rete impara dai datiActivation layers introduce non-linearity, enabling networks to learn complex patterns. Often placed after linear transformations (convolution, dense layers). Common: ReLU, sigmoid, tanh layers.
Examples
- ReLU activation layer
- Sigmoid output layer
- Tanh hidden layer