Skip to content

Commit

Permalink
Fixing float infinity in attention-center GPU. (#1386)
Browse files Browse the repository at this point in the history
Run inference-precision fp32.
Overflow because of huge FC feature depths.

Signed-off-by: hyunback <[email protected]>
  • Loading branch information
hyunback authored Oct 18, 2023
1 parent 702417e commit 677c677
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions notebooks/216-attention-center/216-attention-center.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -184,6 +184,8 @@
"metadata": {},
"outputs": [],
"source": [
"if \"GPU\" in device.value:\n",
" core.set_property(device_name=device.value, properties={'INFERENCE_PRECISION_HINT': ov.Type.f32})\n",
"compiled_model = core.compile_model(model=model, device_name=device.value)"
]
},
Expand Down

0 comments on commit 677c677

Please sign in to comment.