Bias Term

/ˈbaɪəs tɜːrm/

Bias Term: An additional learnable parameter in neural networks that allows shifting the activation function. Bias terms enable neurons to activate even when all inputs are zero. Each neuron typically has one bias. They increase model flexibility and are crucial for fitting non-zero-centered data.

In italiano: Termine di BiasLegge III · Come una rete impara dai dati

Bias terms enable neurons to activate even when all inputs are zero. Each neuron typically has one bias. They increase model flexibility and are crucial for fitting non-zero-centered data.

Examples

  • Linear transformation: y = Wx + b
  • Bias in each layer
  • Offset parameter