Why the heavy RAM usage for GPU tasks?


Message boards : Number crunching : Why the heavy RAM usage for GPU tasks?

Message board moderation

To post messages, you must log in.
AuthorMessage
Lamberto Vitali

Send message
Joined: 14 Jun 23
Posts: 85
Credit: 5,914
RAC: 0
Message 8471 - Posted: 3 Jul 2024, 22:01:09 UTC
Is a GPU doing the same size task as a CPU? If so, why does the GPU need 2GB, 200 times more than the CPU's 10MB?
ID: 8471 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ahorek's team
Volunteer developer
Volunteer tester

Send message
Joined: 1 Jan 13
Posts: 82
Credit: 10,162,383
RAC: 21,414
Message 8531 - Posted: 15 Aug 2024, 23:01:36 UTC - in response to Message 8471.  
VRAM is VERY slow compared to CPU caches, which is why GPU apps are designed differently to make the most of the hardware. While it's possible to reduce the memory requirements, doing so would negatively impact performance. Given that all modern GPUs come with more than 2GB of VRAM, optimizing the app simply for minimal VRAM usage isn't practical.
ID: 8531 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Why the heavy RAM usage for GPU tasks?