• 0 Posts
  • 3 Comments
Joined 1 year ago
cake
Cake day: October 10th, 2023

help-circle
  • I watched one video and read 2 pages of text. So take this with a mountain of salt. From that I gathered that deepseek R1 is the model you interact with when you use the app. The complexity of a model is expressed as the number of parameters (though I don’t know yet what those are) which dictate its hardware requirements. R1 contains 670 bn Parameter and requires very very beefy server hardware. A video said it would be 10th of GPUs. And it seems you want much of VRAM on you GPU(s) because that’s what AI crave. I’ve also read 1BN parameters require about 2GB of VRAM.

    Got a 6 core intel, 1060 6 GB VRAM,16 GB RAM and Endeavour OS as a home server.

    I just installed Ollama in about 1/2 an hour, using docker on above machine with no previous experience on neural nets or LLMs apart from chatting with ChatGPT. The installation contains the Open WebUI which seems better than the default you got at ChatGPT. I downloaded the qwen2.5:3bn model (see https://ollama.com/search) which contains 3 bn parameters. I was blown away by the result. It speaks multiple languages (including displaying e.g. hiragana), knows how much fingers a human has, can calculate, can write valid rust-code and explain it and it is much faster than what i get from free ChatGPT.

    The WebUI offers a nice feedback form for every answer where you can give hints to the AI via text, 10 score rating thumbs up/down. I don’t know how it incooperates that feedback, though. The WebUI seems to support speech-to-text and vice versa. I’m eager to see if this docker setup even offers APIs.

    I’ll probably won’t use the proprietary stuff anytime soon.



  • Many protests like that in Germany for a few years now. Mostly adolescent people from XR and FFF who tacked their hands to streets in neuralgic locations with superglue. They were one of the most hated groups by normies here and were compared to the 70s terror group RAF by politicians and boulevard media like BILD. Many videos in which good citizens forgot their temper and acted out in violent self justice when they feared to get late to work.

    In 2023 the country wide farmer protests started and held the republic captive. Thousands of 5-10 ton tractors drove down the whole country to Berlin. They did a lot of terroristy things like loading huge manure dumps and logs in the midst of highways and their exits, controlling the IDs of drivers to only let essential staff through, putting liable anti-constitutional placards on their tractors, purposefully obstructing traffic in the cities and some of them from east-germany wanted to storm the parliament. People died, car accidents happened, ambulances and doctors were to late for operations, huge loads of GHGs were emitted and streets were destroyed.

    All this because of the traffic light coalition wanted to cut subsidies for agrar fuels which was reverted pretty fast. Did the farmers stop then? Nope of course not. Went on for a few months. Those poor farmers couldn’t afford to live without the precious subsidies but could afford to blow heaps of fuel and not working on their farms. A young farmer tried to prove to the public that they were essentially poor by showing his tax documents on the german finance subreddit. It didn’t went well because he was rich. He deleted his post.

    Now from the sentiment on social media you could get the impression that a lot of the normies who wanted to have the “Klimakleber” (climate gluers) jailed or worse, cheered for the poor hard working farmers even when the protest really went violent. I live rurally and boy let me tell you how those poor farmers have plastered their barns and houses with solar panels because of the politics of the greens and the subsidies from the EU.