Nick Mermiges upgraded a private server consisting of 8 second-hand Nvidia V100 GPUs, enabling about 80% of the DeepSeek V4.1 Flash workload to run at 2-bit precision upgraded to near-NVFP4 precision. He also added 1TB RAM and an RTX 3090, with support for 524K context.
Source:Tom’s Hardware · Read original
Leave a Reply