What are your thoughts on decentralized GPU cloud infrastructure?

[XFinite]

I guess we all know what this is about  . Nowadays GPU isn't really cheap as it seemed before
Some articles say that GPU parts are becoming more expensive and resulting in more shortages, due to its powerful specs. And it's making it harder to get the high performance computing power we need for everything from AI research to gaming. 

Do you guys think that decentralized GPU cloud infrastructure can stop this from happening by leveraging the power of idle GPUs from every individual? Cos what I think is very effective and affordable as well since this decentralized model allows anyone to contribute their computing power and earn rewards from crypto projects that support it.

[TomPluz]

Do you guys think that decentralized GPU cloud infrastructure can stop this from happening by leveraging the power of idle GPUs from every individual? Cos what I think is very effective and affordable as well since this decentralized model allows anyone to contribute their computing power and earn rewards from crypto projects that support it.

I am not good at this new trend which is emerging in the market right now but I can see that there is a big potential awaiting for DePIN or Decentralized Physical Infrastructure Networks and right now this is fast expanding and I guess this will be gaining more and more traction as days will go on. In fact, some are saying that this could be the latest narrative in the market to capture the attention of many and I am hoping that this will not be a flash-in-the-pan type of thing and will be a big force to reckon with just like DeFi. There is no question that the potential here is staggering and one thing for sure is that this trend can be a good opportunity for many of us to participate in contributing computing power and getting some rewards in return. Right now, there are already projects along this line and I know this can be catching fire soon especially that innovations in the AI and machine learning are fast emerging before our eyes.

[joniboini]

As a consumer, I don't think I need to use my GPU for AI research unless I'm trying to convert my idle GPU to earn money. Crypto mining will probably offload some of their resources to servers since some altcoins are moving to PoS, so I guess gaming is the only market that affects me. It still depends on what resolution I'm targeting though, since my current setup with a 3060TI is capable of playing 2K gaming. I don't think using a cloud network/decentralized network will help me, not to mention the lag, latency, etc. I'm not sure if there are crypto projects that tackle this market, but Stadia or Nvidia NOW is not performing that well afaik. The network technology to reduce lag/latency was not there yet the last time I checked them.

[Faisal2202]

Do you guys think that decentralized GPU cloud infrastructure can stop this from happening by leveraging the power of idle GPUs from every individual? Cos what I think is very effective and affordable as well since this decentralized model allows anyone to contribute their computing power and earn rewards from crypto projects that support it.

TBH I am still a little unclear on how someone else paying to perform some task using my and my neighbour's computing power. First I thought it would all be virtual and remote like if I have to perform the task and each task I know is comprised of small threads and units, and each if is independent of the others and can be performed on different computers. And if a task is a bigger one that it needs this infrastructure how they will know which task is independent and which is not.

So I thought they might bring all the decentralized computing power to single centralized power source and from there they will distribute the sources. If I have allocated some memory or sources of my Laptop, or device how they would be able to use it ? I think OP you might have knowledge of it, can you shed some light please.

[laubeaud]

I know that getting a GPU is expensive for many people. Decentralized GPU cloud infrastructure can help them access a GPU by paying an affordable fee to the owners of these GPUs. I don't have a good understanding of the concept of decentralized GPU cloud, but I saw many CEXs like Bitget, Bybit, OKX, and others mentioning Aeithir, a project specializing in it. I will study this concept more.

[NotATether]

Oh, GPU cloud infrastructure already exists, that's how many otherwise idle GPUs are throwing their compute power at Folding@Home.

What doesn't exist though is *decentralized* GPU cloud infrastructure. They inherently cannot be decentralized because only a few people actually are going to join with their GPUs, so the network will be very small.

[Stompix]

I guess we all know what this is about  . Nowadays GPU isn't really cheap as it seemed before
Some articles say that GPU parts are becoming more expensive and resulting in more shortages, due to its powerful specs. And it's making it harder to get the high performance computing power we need for everything from AI research to gaming. 
Do you guys think that decentralized GPU cloud infrastructure can stop this from happening by leveraging the power of idle GPUs from every individual?

AI learning and gaming are different things.
A 4090 will outclass a H100 in gaming, if we talk FP8 the difference starts being counted in order of magnitude, if we add the existence of NVlink which is present on consumer GPU and allows insane scalability without loss it's pretty hard to compete on, even if we talk 24/7 usage but who is going to let his GPU run all day at full throttle? Not to mention that lately, fewer and fewer people use a desktop and more a laptop which adds to the problems.

[NotATether]

Not to mention that lately, fewer and fewer people use a desktop and more a laptop which adds to the problems.

Those people are probably not buying laptops with NVIDIA chips in them in that case. Because the RTX desktop GPUs are the gold standard in gaming, and all of the serious gamers buy a desktop.

So you have that, but it's nowhere near the amount of Quadro and RTX server GPUs everyone is buying up for AI training purposes. I'd actually argue that there are way more server GPUs being used out there than there are desktop GPUs for that reason.

[Stompix]

Those people are probably not buying laptops with NVIDIA chips in them in that case. Because the RTX desktop GPUs are the gold standard in gaming, and all of the serious gamers buy a desktop.

I don't know what to say about that statistically, I have a ton of friends that don't play games while still having a monster Nvidia card for their needs on that laptop, just as I know from my clan on the few games I till play most of them are on laptops not desktop (like I play). So probably a grey area there, and also impossible to quantify as you need specs and time idling for them, hard to do the math.

I'd actually argue that there are way more server GPUs being used out there than there are desktop GPUs for that reason.

Pretty close:

Nvidia supplied approximately 5.29 million discrete graphics processors for desktop computers, its worst result on the desktop market in many years.
Nvidia had an explosive 2023 in data-center GPU shipments, which totaled roughly 3.76 million units,
Nvidia sold half a million H100 AI GPUs in Q3 thanks to Meta, Facebook, says research firm Omdia, with lead times stretching up to 52 weeks.

[MCcabe Rory]

I know that getting a GPU is expensive for many people. Decentralized GPU cloud infrastructure can help them access a GPU by paying an affordable fee to the owners of these GPUs. I don't have a good understanding of the concept of decentralized GPU cloud, but I saw many CEXs like Bitget, Bybit, OKX, and others mentioning Aeithir, a project specializing in it. I will study this concept more.

Decentralized GPU. Nice concert

[Crypto Library]

Do you guys think that decentralized GPU cloud infrastructure can stop this from happening by leveraging the power of idle GPUs from every individual? Cos what I think is very effective and affordable as well since this decentralized model allows anyone to contribute their computing power and earn rewards from crypto projects that support it.

To be honest I literally hearing for the first time decentralize GPU but in the before I heard lots of time about the cloud computing and I think GPU cloud infrastructure are also included on cloud computing and it is also through that now a days that cloud computing is increasing day by day so I am also positive in this case but there will be also keep in mind that you can not take full advantage of that GPU with the cloud computing for real experience hardware is compulsory.

[Smcchamp]

I know that getting a GPU is expensive for many people. Decentralized GPU cloud infrastructure can help them access a GPU by paying an affordable fee to the owners of these GPUs. I don't have a good understanding of the concept of decentralized GPU cloud, but I saw many CEXs like Bitget, Bybit, OKX, and others mentioning Aeithir, a project specializing in it. I will study this concept more.

I think that's the goal of Aeithir: to make decentralized GPU cloud infrastructure widely available and standard. This would foster innovation and accessibility in gaming and AI. These aspects influenced my decision to take a position, after observing the price action on BG few days ago. It's a long term hold for me..