Of course, I’m not in favor of this “AI slop” that we’re having in this century (although I admit that it has some good legitimate uses but greed always speaks louder) but I wonder if it will suffer some kind of piracy, if it is already suffering or people simple are not interested in “pirated AI”
The very newly released Deepseek R1 “reasoning model” from China beats OpenAI’s o1 model on multiple areas, it seems – and you can even see all the steps of the pre-answering “thinking” that’s hidden from the user in o1. It’s a huge model, but it (and the paper about it) will probably positively impact future “open source” models in general, now the “thinking” cat’s outta the bag. Though, it can’t think about Tiananmen Square or Taiwan’s autonomy – but many derivative models will probably be modified to effectively remove such Chinese censorship.
Just gave Deepseek R1 (32b) a try. Except for the censorship probably the closest to GPT-4 so far. The chain-of-thought output is pretty interesting, sometimes even more useful than the actual response.