Spaces:
Running on CPU Upgrade
Running on CPU Upgrade
Question about Gradient calculation
#30
by Infinity4B - opened
Hi, i am wondering why Gradient calculation in float16/bfloat16 costs more vram than float32? I searched on the Internet, but i cant find a explanation about this.
marcsun13 changed discussion status to closed