{"record":{"id":"84a03a7e076d9b73","repo":"huggingface/transformers","slug":"invalid-distribution-distribution","errorCode":null,"errorMessage":"invalid distribution {distribution}","messagePattern":"invalid distribution (.+?)","errorType":"validation","errorClass":"ValueError","httpStatus":null,"severity":"error","filePath":"src/transformers/initialization.py","lineNumber":192,"sourceCode":"    fan_in, fan_out = torch.nn.init._calculate_fan_in_and_fan_out(tensor)\n    if mode == \"fan_in\":\n        denom = fan_in\n    elif mode == \"fan_out\":\n        denom = fan_out\n    elif mode == \"fan_avg\":\n        denom = (fan_in + fan_out) / 2\n\n    variance = 1.0 / denom\n\n    if distribution == \"truncated_normal\":\n        trunc_normal_(tensor, std=math.sqrt(variance) / 0.87962566103423978)\n    elif distribution == \"normal\":\n        normal_(tensor, std=math.sqrt(variance))\n    elif distribution == \"uniform\":\n        bound = math.sqrt(3 * variance)\n        uniform_(tensor, -bound, bound)\n    else:\n        raise ValueError(f\"invalid distribution {distribution}\")\n\n\ndef lecun_normal_(tensor):\n    if not getattr(tensor, \"_is_hf_initialized\", False):\n        _variance_scaling(tensor, mode=\"fan_in\", distribution=\"truncated_normal\")\n    return tensor\n\n\ndef default_flax_embed_init_(tensor):\n    if not getattr(tensor, \"_is_hf_initialized\", False):\n        _variance_scaling(tensor, mode=\"fan_in\", distribution=\"normal\")\n    return tensor\n\n\n# Here, we need to check several modules imported, and hot patch all of them, as sometimes torch does\n# something like `from torch.nn.init import xavier_uniform_` in their internals (e.g in torch.nn.modules.activations,\n# where MultiHeadAttention lives), so the function name is binded at import time and just doing\n# `setattr(torch.nn.init, name, globals()[name])` is thus not enough","sourceCodeStart":174,"sourceCodeEnd":210,"githubUrl":"https://github.com/huggingface/transformers/blob/a597f974857b3d92939971296bc0deb93d33d780/src/transformers/initialization.py#L174-L210","documentation":"Error \"invalid distribution {distribution}\" thrown in huggingface/transformers.","triggerScenarios":"Raised in initialization utilities when an unsupported weight distribution name is requested.","commonSituations":"Typo or unknown value passed as the distribution argument of an init helper (expected normal/uniform/etc.).","solutions":["Use a supported distribution name (e.g. 'normal', 'uniform').","Check the initializer's allowed distribution list."],"exampleFix":null,"handlingStrategy":null,"validationCode":null,"typeGuard":null,"tryCatchPattern":null,"preventionTips":[],"tags":[],"backgroundTag":null,"analyzedSha":"a597f974857b3d92939971296bc0deb93d33d780","analyzedAt":"2026-08-14T18:24:08.354Z","schemaVersion":2},"datasetVersion":"2026-08-15T17:31:12.345Z"}