This article is reprinted from Tencent's "Useful Reviews"
Speaking of2025, the event that stunned the tech world, it has to beDeepSeek, this homegrownAI bursting onto the scene. To put it in novelistic terms: while all the big shots were busy bragging about how powerful theirAI was, this homegrown underdog leapt over the dragon gate and swept everything away. It turns outAI isn't that expensive after all. DeepSeek caused NVIDIA's stock to plunge 17% on January 28, wiping out 589 billion dollars in one go. Finally someone is putting the capital markets in their place.
Today is the first day of the Lunar New Year. In the new year, let's show some support for homegrown products, and in keeping with the freeloader spirit, deploy DeepSeek to a local machine so it can be happily used even without a network connection. Of course, if you know anything about AI, the more computing power and the more parameters such a large model uses, the better the results will be. So local deployment is just a fun self-entertainment exercise; truly demonstrating the capabilities of a large AI model still requires more parameters and more computing power.
1. First install the basic environment for running the large AI model
A large model is not anexe executable program; you need to configure the runtime environment for the large model. There are many easy-to-use open-source tools of this kind, and a fairly well-known one isOllama. Its installation is fairly simple: just go to the official website, download the program for your system, and install it.https://www.ollama.com/
Ollama is only an environment for running theAI large model, so if we want to runDeepSeek, we still need to, on top of theOllama environment, additionally installDeepSeek.
Ollama's official website offers a variety of runnableAI large models. The hottest one right now isDeepSeek: r1, so there's no need to look elsewhere; just go to theOllama official website and installDeepSeek.
Here I chose the default7b-parameter version. ThroughWindows's command-line tool orPowerShell, just run the corresponding install command.
ollama run deepseek-r1
To install a version with a different number of parameters, just add a colon and the corresponding parameter count after the above command, for example:
ollama run deepseek-r1: 671b
However, you still need to do some further configuration here to makeDeepSeek work properly. In the second item,RAG settings, select theDeepSeek:R1 large model we installed; the other parameters can be left at their defaults.
At this point, the installation and configuration of running theDeepSeek:R1 large model locally is complete, and we can happily use this large model.
Enter your question in the dialog box and you'll get the corresponding result. As for the actual quality, this article won't go into too much detail—try it out for yourself first. Currently theDeepSeek version with the strongest capabilities being promoted isR3—give it a try if you have the setup?
Of course, you can also simply log intothe DeepSeek web version to try it out.
On the first day of the Lunar New Year, if you don't feel like going out to chitchat with relatives, have a chat withDeepSeek instead—you might gain something unexpected.
Or you could feed your relatives' chatter intoDeepSeek and let it do the chatting for you—not a bad idea at all. What a clever little trickster I am.