I made a comment to a beehaw post about something similar, I should make it a post so the .world can see it.

I’ve been running the 14B distilled model, based on Ali Baba’s Qwen2 model, but distilled by R1 and given it’s chain of thought ability. You can run it locally with Ollama and download it from their site.

That version has a couple of odd quirks, like the first interaction in a new session seems much more prone triggering a generic brush-off response. But subsequent responses I’ve noticed very few guardrails.

I got it to write a very harsh essay on Tiananmen Square, tell me how to make gunpowder (very generally, the 14B model doesn’t appear to have as much data available in some fields, like chemistry), offer very balanced views on Isreal and Palestine, and a few other spicy responses.

At one point though I did get a very odd and suspicious message out of it regarding the “Realis” group within China and how the government always treats them very fairly. It misread “Isrealis” and apparently got defensive about something else entirely.

In a rich man’s house, there’s no where to spit except for his face.

Seems like the cross post isn’t displaying quoted content (for me on Voyager mobile anyway) so I just wanted to add that in the original post, there is a long discussion I wrote highlighting some interesting aspects of this output. Please click through if you’d like to know more!

It’s already happening. This article takes a long look at many of the rising threats to nvidia. Some highlights:

• Google has been running on their own homemade TPUs (tensor processing units) for years, and say they on the 6th generation of those.

• Some AI researchers are building an entirely AMD based stack from scratch, essentially writing their own drivers and utilities to make it happen.

• Cerebras.ai is creating their own AI chips using a unique whole-die system. They make an AI chip the size of entire silicon wafer (30cm square) with 900,000 micro-cores.

So yeah, it’s not just “China AI bad” but that the entire market is catching up and innovating around nvidia’s monopoly.