Just a guy shilling for gun ownership, tech privacy, and trans rights.
I’m open for chats on mastodon https://hachyderm.io/
my blog: thinkstoomuch.net
My email: nags@thinkstoomuch.net
Always looking for penpals!
Probably why they didn’t do it in the first place.
They barely pay for moderation. Who is going to pay for that survey? And also why would they? Obviously most of the people on that site are under 18. That’s when I used it.
What other demographic clicks the horny ads they run?
The classic
offers to recycle
actually installs esoteric Linux distros
Classic!
I actually don’t even care about AI Ethics here.
Fuck Academic Dishonesty!
I usually follow the craft computing video whenever I have to set it up. He has a document in the description with all the things you might need to passthrough a GPU but only like half are needed to passthrough an HBA
https://www.youtube.com/watch?v=_hOBAGKLQkI
Proxmox wiki has a more concise guide IMO
It was really simple to do in Proxmox.
You will find no name brand HBAs in IT mode on eBay for half the price of Intel, Supermicro, Dell, Etc branded ones. Do not buy the no names. I spent a week flashing and reflashing some cheap one, cycling through cables, etc. Nothing.
My supermicro branded one worked absolutely no issue. And I think it was like $40
It probably took a total of 30 minutes to pass it through and build the VM and everything. It took a couple days to rebuild my data from my previous truenas server but I had 10 TB of data on 4 drives.
The only issues I’ve had have been my own reading comprehension in setting up truenas accounts.
Are you using truenas as the entire homelab?
I also love messing with stuff until it breaks and I learn something, but I’ve decided I just want my files to be accessible.
So I actually have truenas virtualized with a passed through HBA so I can run proxmox to host all my breakable VMs while leaving truenas alone.
Apparently you can turn those off but I haven’t bothered.
A few months ago now, Arizona? Arkansas maybe? Some state legalized “AI powered” home schooling systems. But it was mostly clickbait and the system is less like ChatGPT and more like the YouTube Algorithm machine learning. It takes into account the stuff that students do well at and let’s them advance beyond “grade level” limitations while also learning how to present problem areas in ways the student responds to.
I had asked my home schooled AI researcher buddy his thoughts and he obviously liked it. I like the idea too, but my hang up was on socializing kids. That to me is the more important role of schools.
I wouldn’t trust an LLM in this set up though. A human tutor would still need to step in for questions outside of a FAQ IMO. I love working with an LLM by giving it all the manuals, guides, and config files I used then asking where I went wrong because it can usually give me a good enough interpretation to see where to go next. But that’s just a rubber duck. My mind and skills are developed. A kid learning math for Tue first time can’t do that.
As a floatplane subscriber, you’re really not missing much. I don’t even watch most of the exclusives.
Oh the rossman video.
I hate how obsessed on dumb shit he gets. The man is legitimately doing great work usually, and then he takes something minor that an otherwise ally says or does and blows it out of proportion.
This man would have made a great tankie. Unfortunately he made a whole 20 minute video on why AOC is stupid for saying unskilled labor doesn’t exist and then explaining exactly the points she was making.
I legitimately love this mans work and I wanna support him, but man is he petty.
I was SHOCKED how well Fedora and Bazzite handled my 5060 after a month of fighting to get it going on pop os.
And Ollama is free and better if you really need AI stuff.
From what I understand its not as fast as a consumer Nvdia card but but close.
And you can have much more “Vram” because they do unified memory. I think the max is 75% of total system memory goes to the GPU. So a top spec Mac mini M4 Pro with 48GB of Ram would have 32gb dedicated to GPU/NPU tasks for $2000
Compare that to JUST a 5090 32GB for $2000 MSRP and its pretty compelling.
$200 and its the 64GB model with 2x 4090’s amounts of Vram.
Its certainly better than the AMD AI experience and its the best price for getting into AI stuff so says nerds with more money and experience than me.
From what I understand its not as fast as a consumer Nvdia card but but close.
And you can have much more “Vram” because they do unified memory. I think the max is 75% of total system memory goes to the GPU. So a top spec Mac mini M4 Pro with 48GB of Ram would have 32gb dedicated to GPU/NPU tasks for $2000
Compare that to JUST a 5090 32GB for $2000 MSRP and its pretty compelling.
$200 and its the 64GB model with 2x 4090’s amounts of Vram.
Its certainly better than the AMD AI experience and its the best price for getting into AI stuff so says nerds with more money and experience than me.
Honestly if you’re not gaming or playing with new hardware, there is absolutely no point.
I’ve considered swapping this computer over to Fedora for a hot minute, but it really is a gaming PC and I should stop trying to break it.
True, but I have an addiction and that’s buying stuff to cope with all the drawbacks of late stage capitalism.
I am but a consumer who must be given reasons to consume.
The Lenovo Thinkcentre M715q were $400 total after upgrades. I fortunately had 3 32 GB kits of ram from my work’s e-waste bin but if I had to add those it would probably be $550 ish The rack was $120 from 52pi I bought 2 extra 10in shelves for $25 each the Pi cluster rack was also $50 (shit I thought it was $20. Not worth) Patch Panel was $20 There’s a UPS that was $80 And the switch was $80
So in total I spent $800 on this set up
To fully replicate from scratch you would need to spend $160 on raspberry pis and probably $20 on cables
So $1000 theoratically
The PIs were honestly because I had them.
I think I’d rather use them for something else like robotics or a Birdnet pi.
But the pi rack was like $20 and hilarious.
The objectively correct answer for more compute is more mini PCs though. And I’m really thinking about the Mac Mini option for AI.
Ollama and all that runs on it its just the firewall rules and opening it up to my network that’s the issue.
I cannot get ufw, iptables, or anything like that running on it. So I usually just ssh into the PC and do a CLI only interaction. Which is mostly fine.
I want to use OpenWebUI so I can feed it notes and books as context, but I need the API which isn’t open on my network.
I was thinking about that now that I have Mac Minis on the mind. I might even just set a mac mini on top next to the modem.
Its probably a parent company situation.
Lots of corpo structures are just large parent companies that actually just own a bunch of smaller companies so that the parent company gets the profits while the smaller companies make the risky products and can be bankrupted at any minute.
The company I work for does that. We just bought a couple companies that were competitors in a risky but profitable market. The full idea is that if one company gets sued to oblivion, we let that company die, move all the employees and customers to the backup company, and call it a day.
Capitalism baby!