I also recently got into selfhosting LLM. Having an AMD card meant I had to scourge for solutions since everything expects to have CUDA suppport which means having Nvidia cards. Koboldcpp has a fork with ROCM support which works on my machine, so I’m content with that for now.

There has to be a cultural shift as well. It’s not the early 2000s anymore where a substantial portion of internet users could tinker around their desktop computers. I recently got fiber at home and we’re locked behind CGNAT. I could look for a solution for myself since I grew up opening ports on my router, but imagine someone who grew up with bubble-wrapped smartphones trying to navigate their way through that bs.

So that explains why it’s so cheap.

Porkbun has been fair to me. Recommended.

Absolutely. I love paper books and physical collectibles. The problem I was talking about is being forced to the old methods instead of using modern technologies, like only being able to send an application form by physical mail instead of online.

It’s probably old farts making decisions based what they learned from “the good old days”. For many Japanese, that was the 80s. This means over-attachment to analog methods and physical objects. It’s cultural inertia that won’t phase out quickly.