Phrase guide
Definitions and examples are grouped by meaning. Pronunciation, history, word forms, translations, descendants, synonyms, antonyms, derived terms, and related words appear whenever the source provides them.
Sound
Each Play button uses your device's default local English voice, or a natural local fallback. The selected voice name appears after playback. This is synthesized speech, not a source recording.
No pronunciation record was provided for this word.
noun
A variation of the rectified linear unit, defined as f(x)=x when x≥0 and f(x)=αx for some small α, e.g. 0.01, when x<0.
Definition source: English Wiktionary via Wiktextract
Qualifier: artificial intelligence; neural computing; artificial intelligence; neural computing
No example sentence was provided for this meaning.
Synonyms: none provided
Antonyms: none provided
History
Named after the rectified linear unit, where “leaky” denotes how the negative half of the function becomes slightly negative, being “leaky” in comparison to the default ReLU, which is zero.
