Lol, so because Anslopic train on proprietary and security sensitive data, it had to be blocked. I think that exposes the problems with how they retrieve their training material and where they get it from. Maybe the paid prompts which shouldn’t be used for training are being used after all? Who would’ve thought!

Welcome 🙂 We hope you continue enjoying it!

Pro: it’s GLOSS - Gratis Libre OSS.

Con: it’s run terribly. The Linux foundation could be doing a much better job. 1-2% of its funding go into the linux kernel.

Is Slavic Adventures a game?

Nope. There’s a forum post about it. Forgot the name of the game after reading through the pages, but the game uses many pagan runes and GoG decided to be edgy for some reason. No idea why they’d drop the ball like this. It’s not a good look and the person who made the decision to have this title and then send it out should be fired. It’s obvious what they wanted to achieve.

It is primarily sponsored by the government of Switzerland 🇨🇭 where it is currently deployed for citizens.

Now this, I like!

Github, not so much

It requires superconduction. To have something like that sitting at home, we either need to cool it down like crazy or material science has to advance to the point where we have room temperature super conductors. So, while a impressive advancement, it probably won’t be in our living rooms, in our desks, or in our pockets anytime soon.

But when we get that room temperature superconductor, at least we’ll be ready!

Is the bubble close to popping? What are these bullshit deals?

I’ll wait a few months and then check in again.

It stores all metadata in YAML frontmatter and doesn’t cache in an SQLite blob? I bet that decision will be reversed pretty quickly once people try to migrate a 10k+ note collection and want to do operations like search immediately instead of scanning every file to build an in-memory cache.

Thank you. That’s good to know.

Thanks for the response. It’s interesting to read about the experience of others.

That’s definitely not my level of disposable wealth/income. I can barely afford one card.

Oh nice. Does that depend on just the model or are there other requirements like CUDA or something?

How do you now run out of RAM? Does it offload to system RAM?

Thank you for that writeup.

Do you know how important the parameter size is? 12b, 24b, 128b, etc. Does it really improve performance or is it like megapixels in a camera: more megapixels don’t necessarily mean a better picture?

And what’s “quantisation”. Context compression or something?

I’ve been considering buying a better card to test models (also want to be personally sovereign), but NVIDIA on linux gives me the jeebies and, last i checked, AMD hasn’t released anything with more than 20GB in a while. In fact, figuring out hardware requirements has been tough and I’m considering just riding this whole thing out. Maybe the bubble will collapse and bring prices down to something reasonable.

What’s the quality of the answers though? And how much context can it hold? I imagine it’s only good for small, short questions, but have no concept of what is needed for that.

I’m assuming you’re using a 12b or 24b qwen model. The ones from deepseek go up to hundreds of billions of params and I can’t tell if bigger number is better or just meaningless posturing.

How many GPUs do you even need to have a usable, self-hosted AI? It looks like he has 6 on his rig. Probably each costs 2k or something. That’s not peanuts. I have a 12GB VRAM card. It probably can’t generate anything in any meaningful amount of time. Which brings me to the question: who is this for?

Regardless, impressive what he vibe-coded there.

I see. Yeah, that was discontinued. The maintainers didn’t have time for it.

Do you live in the basement?

3?

Looks like I’ll have to setup BasicSync. I still don’t trust Syncthing-Fork. The way things went down don’t give me any confidence it could happen again but worse e.g the dev introduces something like a “fuck zionists” patch that wipes everything if you’re on an isralean IP. Then I’d be putting myself in danger for using a VPN or TOR exit node in Israel. Not taking that risk.

Thanks for the writeup.