Thread | Brutkey

@jpm@aus.social i hope this is true and the hardware isn't over-specialized on matrix multiplication of 8-bit floats at this point

Joel Michael
@jpm@aus.social

@jamie@social.memes.nz it appears the spicy autocarrot folks are still in the GPU to FPGA migration that the cryptobros went through a few years ago (and fuck AMD/Xilinx in particular for leaning into that bullshit). Once they hit the FPGA to ASIC migration, the ASICs are usually completely and utterly useless for anything else.

Demi Marie Obenour
@alwayscurious@infosec.exchange

@jpm@aus.social @jamie@social.memes.nz Machine learning skipped the FPGA step and went straight to ASICs. The good news is that the ASICs still have other good uses beyond LLMs, notably in the medical field.