{"record":{"id":"866ce2530fd6f367","repo":"tensorflow/models","slug":"sigmoid-attn-bias-must-be-specified-for-sigmoid-at","errorCode":null,"errorMessage":"sigmoid_attn_bias must be specified for sigmoid attn.","messagePattern":"sigmoid_attn_bias must be specified for sigmoid attn\\.","errorType":"exception","errorClass":"ValueError","httpStatus":null,"severity":"error","filePath":"official/nlp/modeling/layers/block_sparse_attention.py","lineNumber":83,"sourceCode":"      num_kv_heads: Number of key/value heads in the multi-head self attention.\n        Refer to multi_query_attention.py for more details.\n      **kwargs: Args passed to the base class.\n    \"\"\"\n    super().__init__(**kwargs)\n    if src_block_size is None or src_block_size <= 0:\n      raise ValueError(\"src_block_size must be specified.\")\n    self._src_block_size = src_block_size\n    self._tgt_block_size = tgt_block_size or self._src_block_size\n    self._num_kv_heads = num_kv_heads\n    if num_kv_heads is not None and num_kv_heads != 1:\n      raise ValueError(\n          \"num_kv_heads must be 1. Grouped-query attention is not supported.\"\n      )\n    self._use_sigmoid_attn = use_sigmoid_attn\n    self._sigmoid_attn_bias = sigmoid_attn_bias\n    if self._use_sigmoid_attn:\n      if self._sigmoid_attn_bias is None:\n        raise ValueError(\n            \"sigmoid_attn_bias must be specified for sigmoid attn.\"\n        )\n\n  def get_config(self):\n    config = super().get_config()\n    config.update({\n        \"src_block_size\": self._src_block_size,\n        \"tgt_block_size\": self._tgt_block_size,\n        \"use_sigmoid_attn\": self._use_sigmoid_attn,\n        \"sigmoid_attn_bias\": self._sigmoid_attn_bias,\n        \"num_kv_heads\": self._num_kv_heads,\n    })\n    return config\n\n  def _build_from_signature(self, query, value, key=None):\n    # pytype: disable=attribute-error\n    super()._build_from_signature(query, value, key)\n    # pytype: enable=attribute-error","sourceCodeStart":65,"sourceCodeEnd":101,"githubUrl":"https://github.com/tensorflow/models/blob/e006f5f0d534913e49c1f1dae87364039fa607e2/official/nlp/modeling/layers/block_sparse_attention.py#L65-L101","documentation":"Error \"sigmoid_attn_bias must be specified for sigmoid attn.\" thrown in tensorflow/models.","triggerScenarios":"Thrown at official/nlp/modeling/layers/block_sparse_attention.py:83 when the library encounters an invalid state.","commonSituations":"See trigger scenarios.","solutions":[],"exampleFix":null,"handlingStrategy":null,"validationCode":null,"typeGuard":null,"tryCatchPattern":null,"preventionTips":[],"tags":[],"backgroundTag":null,"analyzedSha":"e006f5f0d534913e49c1f1dae87364039fa607e2","analyzedAt":"2026-08-24T14:09:15.576Z","schemaVersion":2},"datasetVersion":"2026-08-24T17:17:21.512Z"}