inari@piefed.zip to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 3 days agoPirate Face - a Pirate Bay for LLMspirateface.coexternal-linkmessage-square57linkfedilinkarrow-up1205arrow-down120
arrow-up1185arrow-down1external-linkPirate Face - a Pirate Bay for LLMspirateface.coinari@piefed.zip to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 3 days agomessage-square57linkfedilink
minus-squareCethin@lemmy.ziplinkfedilinkEnglisharrow-up3arrow-down1·1 day agoMost consumers are not purchasing a GPU to run an LLM. They may choose to run one if they own a GPU. This does next to nothing for their demand. I don’t mean a subscription to Hugging Face. I mean a subscription to an LLM service. They don’t want you owning. They want you renting.
minus-squarenilloc@discuss.tchncs.delinkfedilinkEnglisharrow-up1arrow-down1·1 day agoI could see nvidia de-porting the hugging face models and making them harder to run on anything but their chips.
Most consumers are not purchasing a GPU to run an LLM. They may choose to run one if they own a GPU. This does next to nothing for their demand.
I don’t mean a subscription to Hugging Face. I mean a subscription to an LLM service. They don’t want you owning. They want you renting.
I could see nvidia de-porting the hugging face models and making them harder to run on anything but their chips.