Settings

Theme

Where did my 128GB of video RAM go? AMD GPU BIOS gotcha for LLM builders

patrickmccanna.net

2 points by 0o_MrPatrick_o0 2 months ago · 2 comments

Reader

theChaparral 2 months ago

Adding amdgpu.gttsize=126976 and ttm.pages_limit=32505856 to the kernel parameters, while setting the VRAM in the BIOS to the minimum value, enables unified memory to work as expected on AMD Strix Halo running Linux.

The https://strixhalo.wiki has most of the info you need to get LLMs running on these machines.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection