Activation Layer

/ˌæktɪˈveɪʃən ˈleɪər/

Activation Layer: A layer that applies a non-linear activation function element-wise to its input. Activation layers introduce non-linearity, enabling networks to learn complex patterns. Often placed after linear transformations (convolution, dense layers). Common: ReLU, sigmoid, tanh layers. Examples include ReLU activation layer, Sigmoid output layer, Tanh hidden layer.

In italiano: Layer di AttivazioneLegge III · Come una rete impara dai dati

Activation layers introduce non-linearity, enabling networks to learn complex patterns. Often placed after linear transformations (convolution, dense layers). Common: ReLU, sigmoid, tanh layers.

Examples

  • ReLU activation layer
  • Sigmoid output layer
  • Tanh hidden layer