Each unit computes a weighted sum of its inputs and applies a simple non-linear function. Stacking many layers lets networks represent very complex relationships, from recognizing faces to generating language.
Despite the biological name, artificial neural networks work very differently from brains.