Heater
Posts: 13675
Joined: Tue Jul 17, 2012 3:02 pm

Re: Raspberry Pi Cluster Computer?

Fri Oct 18, 2019 10:30 am

clicky,
That would be cool to have windows (and session) manager that can manage windows from several X servers on one X terminal.
Welcome to the 1980's!

That is exactly how X was designed to work. A dumb "terminal" with graphics that displayed on behalf of programs running else where.

You have things backwards though. The terminal/display runs the X server, the remote programs that want to display are the X clients. The programs connect to the display, not the other way around.

Last time I checked this still all worked except a lot of modern programs require direct access to hardware for rendering so they don't work over the net.
Memory in C++ is a leaky abstraction .

Heater
Posts: 13675
Joined: Tue Jul 17, 2012 3:02 pm

Re: Raspberry Pi Cluster Computer?

Fri Oct 18, 2019 10:33 am

ejolson,

Grief, if I piled my old laptops up into a "cluster" like that they would catch fire!

I'm all for welding things together.

It's just that when you hear people ask that question here on the forum you know immediately that any kind of compute cluster or distributed database etc as we know them is not what they have in mind. They just want a faster laptop.
Memory in C++ is a leaky abstraction .

fanoush
Posts: 485
Joined: Mon Feb 27, 2012 2:37 pm

Re: Raspberry Pi Cluster Computer?

Fri Oct 18, 2019 3:00 pm

clicky wrote:
Fri Oct 18, 2019 9:48 am
Actually - I was considering having two Pis (due to memory constraints of one): one connected to monitor and keyboard running X windows and another on network using first as X terminal. Also, first (with SSD) would share disk over nfs (at least /home if not more!).

That way I would be able to decide which app to start where and have ability to run two memory hungry apps at the same time. That can be scaled slightly further as well.

Downside (think I haven't sorted out, logically speaking) is how you would log in both at the same time, how to use first Pi's windows manager for both and such... That would be cool to have windows (and session) manager that can manage windows from several X servers on one X terminal.
In such special case it could be indeed usable. Especially with gigabit ethernet between two Pi4s. One could maybe even stream one Pi screen as mpeg4 to the other one ( Xvnc for the pi works like that now) so the remote pi could even run 3d or play video. However when talking about it now I wonder if it still works with the fkms driver used curently on Pi4, maybe yes? One Pi only for web browsing and one for the real work. The Chromium one could even boot over network so if it locks up and eat all memory you can just flip the switch without interrupting real work :-)

ejolson
Posts: 3723
Joined: Tue Mar 18, 2014 11:47 am

Re: Raspberry Pi Cluster Computer?

Fri Oct 18, 2019 3:47 pm

fanoush wrote:
Fri Oct 18, 2019 3:00 pm
clicky wrote:
Fri Oct 18, 2019 9:48 am
Actually - I was considering having two Pis (due to memory constraints of one): one connected to monitor and keyboard running X windows and another on network using first as X terminal. Also, first (with SSD) would share disk over nfs (at least /home if not more!).

That way I would be able to decide which app to start where and have ability to run two memory hungry apps at the same time. That can be scaled slightly further as well.

Downside (think I haven't sorted out, logically speaking) is how you would log in both at the same time, how to use first Pi's windows manager for both and such... That would be cool to have windows (and session) manager that can manage windows from several X servers on one X terminal.
In such special case it could be indeed usable. Especially with gigabit ethernet between two Pi4s. One could maybe even stream one Pi screen as mpeg4 to the other one ( Xvnc for the pi works like that now) so the remote pi could even run 3d or play video. However when talking about it now I wonder if it still works with the fkms driver used curently on Pi4, maybe yes? One Pi only for web browsing and one for the real work. The Chromium one could even boot over network so if it locks up and eat all memory you can just flip the switch without interrupting real work :-)
Over the years I've found it useful to mount home from a separate file server that doesn't crash when my mouse clicks too many things on the desktop. While not exactly a cluster, such a setup definitely avoids filesystem corruption and costly resynchronisation after a crash.

Moonmarch
Posts: 153
Joined: Thu Mar 07, 2019 1:34 am

Re: Raspberry Pi Cluster Computer?

Fri Oct 18, 2019 10:42 pm

People will purchase the RPI computer, because of the price with enough RPI computer sitting around there will be people that will have this idea that you can connect all of the RPI computers together then have a much more powerful computer, yes you can build your RPI cluster which will be the equivalent of the Intel Xeon series computer, if you are not familiar with Intel Xeon computers here is a picture of a Intel Xeon 771 socket motherboard:

https://www.amazon.com/Intel-Xeon-Dual- ... B000VS8WSS
Image

This motherboard includes 2 CPU sockets and supports 64 GB of RAM what I'm trying to say this computer is not a ordinary computer, server computers or supercomputers have a certain purpose which is the reason why businesses spend several $1000's on these computers, instead of purchasing a server computer for personal use you should instead purchase a more expensive, a more powerful PC on display at the store that will have more CPU cores which will have higher clock speeds, and PCI Express slots for video cards.

ejolson
Posts: 3723
Joined: Tue Mar 18, 2014 11:47 am

Re: Raspberry Pi Cluster Computer?

Sat Oct 19, 2019 2:55 am

Moonmarch wrote:
Fri Oct 18, 2019 10:42 pm
if you are not familiar with Intel Xeon computers here is a picture of a Intel Xeon 771 socket motherboard
It looks like your motherboard got caught in a time warp from 2004.

While it's amazing such hardware is available new for sale, current server hardware has undergone as much technical innovation as desktops and notebooks, though smartphones didn't even exist back then. How do you think the performance would compare to a Pi 4B if that motherboard were outfitted with suitable processors and memory?

User avatar
mahjongg
Forum Moderator
Forum Moderator
Posts: 12351
Joined: Sun Mar 11, 2012 12:19 am
Location: South Holland, The Netherlands

Re: Raspberry Pi Cluster Computer?

Sun Oct 20, 2019 12:31 pm

please keep on topic.

User avatar
Gavinmc42
Posts: 3918
Joined: Wed Aug 28, 2013 3:31 am

Re: Raspberry Pi Cluster Computer?

Tue Oct 22, 2019 7:06 am

What architecture could be designed so just buying another "module" and plugging it in increases the processing power?
Can we design and make them on Pi's?
What computing language is needed?

Use $1 FPGA's that just add together like LittleBits?
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

User avatar
clicky
Posts: 412
Joined: Thu Oct 25, 2012 7:34 am

Re: Raspberry Pi Cluster Computer?

Tue Oct 22, 2019 10:20 am

Gavinmc42 wrote:
Tue Oct 22, 2019 7:06 am
What architecture could be designed so just buying another "module" and plugging it in increases the processing power?
Can we design and make them on Pi's?
What computing language is needed?

Use $1 FPGA's that just add together like LittleBits?
That would be interesting project to play with: 'motherboard' (in range of 30-ish GBP) with 4 compute module slots, some kind of fast bus among them (something that would shortcut USB3 or ethernet if possible), access to USB 3 ports (even if it is only 'first' compute module), HDMI (x2 - well - why not? - maybe, just maybe configurable so each is sourced from two compute modules) and then some layer over kernel (or in kernel - what do I know) that would allow execution on 'remote' CPUs...

Of course, there'll be price to pay for very slow Pi-2-Pi bus, but side of that it would be interesting thing to play with.

Disclaimer: I like to daydream about stuff like that :roll:

User avatar
Gavinmc42
Posts: 3918
Joined: Wed Aug 28, 2013 3:31 am

Re: Raspberry Pi Cluster Computer?

Tue Oct 22, 2019 10:55 am

Disclaimer: I like to daydream about stuff like that
Guilty too, in fact notorious for brain dumping :lol: .

Just went and looked at Lattice FPGA's, Crosslinkplus = 2 x MIPI camera interface 6GBs in 3.3x3.5mm BGA package.
The ICE40UP parts are cool. FPGAs down to 16pin parts.
Time to check what FPGA tools work on Pi4.

Hmm Prop2 when it gets here could be of some use, probably easier to use.
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

ejolson
Posts: 3723
Joined: Tue Mar 18, 2014 11:47 am

Re: Raspberry Pi Cluster Computer?

Tue Oct 22, 2019 4:16 pm

Gavinmc42 wrote:
Tue Oct 22, 2019 7:06 am
What architecture could be designed so just buying another "module" and plugging it in increases the processing power?
Composability of compute hardware to expand capability by plugging another module here or a different module there is what OpenCAPI is about.

https://www.nextplatform.com/2019/08/06 ... itect/amp/

Other flavours of the same idea are called AMBA, CLX, CCIX and GenZ.

Unfortunately having five standards is a bit like having none. So the chances of really being able to stick anything you want together to make a computer with more power and capabilities is unlikely.

While the most common way to stick multiple Pi 4B computers together is using gigabit Ethernet, other options include the GPIO serial device, USB2, WiFi, USB3 with a smart cable and PCI express after some destructive soldering.

https://hackaday.com/2019/09/05/pcie-mu ... ibilities/

The fastest of these--USB3 and single-lane PCI express--are still about 100 times slower than the above-mentioned system interconnects. While this is not enough to make the Pi 4B composable, it definitely is better for clustering than any of the previous models.

User avatar
Gavinmc42
Posts: 3918
Joined: Wed Aug 28, 2013 3:31 am

Re: Raspberry Pi Cluster Computer?

Wed Oct 23, 2019 1:11 am

Cool link.
When you get into the processor that is further out, now you’re talking about taking what used to be one chip and trying to break it into pieces and aggregate components, which is one technique for overcoming Moore’s Law limitations.
The thing with Pi's is the SoC is so complex no one person can understand it entirely
So what happens when you stick a bunch together?
A simple compute core but a bunch of them which is where GPU/Cuda etc are going.
One PHY to rule them all
Puts it in a nutshell.
Those interconnects are a big issue, graphene and Terahertz a solution?
But leave that to the chip makers.

What can I do with Pi's?
Lattice UP5K have RGB PWM and a RISC-V fits?
Single pixel computing?
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

User avatar
Douglas6
Posts: 4778
Joined: Sat Mar 16, 2013 5:34 am
Location: Chicago, IL

Re: Raspberry Pi Cluster Computer?

Wed Oct 23, 2019 1:32 am

Perhaps the reason this question pops up over and over and over again, is because the answer on this forum is never simply "no", as it should be.

Heater
Posts: 13675
Joined: Tue Jul 17, 2012 3:02 pm

Re: Raspberry Pi Cluster Computer?

Wed Oct 23, 2019 4:41 am

I see "no" as the answer to this question frequently.

"No" is the first word in the first reply here for example.

It always attracts a stream of brain dump fantasies after that mind.
Memory in C++ is a leaky abstraction .

michael9000
Posts: 3
Joined: Sat Oct 26, 2019 1:04 am

Re: Raspberry Pi Cluster Computer?

Sat Oct 26, 2019 1:09 am

is crunching seti data using boinc something that can be viably sped up by using an RPi4 cluster?

michael

ejolson
Posts: 3723
Joined: Tue Mar 18, 2014 11:47 am

Re: Raspberry Pi Cluster Computer?

Sat Oct 26, 2019 2:28 am

michael9000 wrote:
Sat Oct 26, 2019 1:09 am
is crunching seti data using boinc something that can be viably sped up by using an RPi4 cluster?

michael
Seti at Home is open source as well as embarrassingly parallel. As a result, it should be possible to use on a cluster of Raspberry Pi 4B computers.

Whether that speeds anything up is dependent on whether you are currently running Seti at Home on a 15-year-old Pentium 3 or a Ryzen Threadripper with multiple GPUs.

I personally believe Seti at Home is futile because most advanced civilisations have already switched to nonradiating forms of communication based on quantum mechanics that do not show up.

User avatar
DougieLawson
Posts: 36322
Joined: Sun Jun 16, 2013 11:19 pm
Location: Basingstoke, UK
Contact: Website Twitter

Re: Raspberry Pi Cluster Computer?

Sat Oct 26, 2019 9:38 am

ejolson wrote:
Sat Oct 26, 2019 2:28 am
I personally believe Seti at Home is futile because most advanced civilisations have already switched to nonradiating forms of communication based on quantum mechanics that do not show up.
You should give the message they sent telling you that to SETI. That should fire up their tin-foil hats.

I don't think SETI is ever going to find anything they're looking for. It's like trying to listen to music on HeartFM with your receiver tuned to BBC Radio4.
Note: Having anything humorous in your signature is completely banned on this forum. Wear a tin-foil hat and you'll get a ban.

Any DMs sent on Twitter will be answered next month.

This is a doctor free zone.

michael9000
Posts: 3
Joined: Sat Oct 26, 2019 1:04 am

Re: Raspberry Pi Cluster Computer?

Sat Oct 26, 2019 8:45 pm

TThanks for the info re boinc/seti

Michael

Return to “General discussion”