The problem is that NVIDIA is consistently gimping the mid range making it a very unattractive proposition.

That’s a very toxic attitude.

Inference is in principle the process of generation of the AI response. So when you run locally and LLM you are using your GPU only for inference.

The whole startup industry rely on investors to cover for their costs for years, while they work on a loss, in order to obtain a bigger market share. Look at Netflix, Facebook, WhatsApp, etc.

So buying an account you are increasing their market share.

But feel free to use Mistral, Deepseek, etc. that would be better

Please show me an LLM model that is really open source. My understanding is that most of the open models are open weights. For the record Mistral is also releasing Open weights models.

What is amazing in this case is that they achieved spending a fraction of the inference cost that OpenAI is paying.

Plus they are a lot cheaper too. But I am pretty sure that the American government will ban them in no time, citing national security concerns, etc.

Nevertheless, I think we need more open source models.

Not to mention that NVIDIA also needs to be brought to earth.

You are missing the elephant in the room here that this format isn’t royalty free and requires a license and is patented.

Same story with H.265 and AV1 in the video. AV1 is royalty free video codec while H.265 is patented so every device that transcodes or encodes to it should pay royalty fee to the patent holder, but due to the fact that H.265 predates AV1, a lot of devices still don’t fully support AV1.

Also Apple are always supporting not open standards in their device making the whole interoperability a big mess. For example HLS vs Dash or Fair Play vs Widevine and the refusal of Apple to adopt AES-128 CTR to alleviate the problem with interoperability between devices. All of this because they want to extract the maximum profit from their users and lock their users.

The lightning cable was a prime example, where Apple put a small DRM chip that needs to authorize that the cable is authentic otherwise your phone won’t charge. And all of this so that they can charge third party vendors royalty fees on their cables and their long standing refusal to adopt USB-C on the iPhone.