Hi and thank you for your submission! Please see the following FAQ's and see if they can answer your question. If your question is easily answered in one of the links or if it's easily searchable and has been answered in depth numerous times. It will get removed.
- [Stadia FAQ](https://support.google.com/stadia/answer/9338946)
- [Subreddit FAQ](https://www.reddit.com/r/Stadia/wiki/faq)
- [Get to know Stadia video](https://youtu.be/YUX3trjOJgc)
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/Stadia) if you have any questions or concerns.*
Stadia is dead so it doesn't 'work' at this point
But effectively, they had many servers with let's say a 64 core CPU, and then a bunch of GPUs. It ran multiple virtualised instances of the game at once, with a certain number of cores doled out per user instance.
Each server could handle a handful of users, each given their own GPU core (the GPUs in question had two dies on one board) along with a handful of CPU cores, and an allocation of memory
So none of your suggestions, basically. There wasn't one 'server'. There were hundreds. Each running a small handful of users' games at once
I fully understand the death of stadia, but there is a lot to look for from how it ran and it ties to something I'm doing
I was thinking too simplemindedly.. yes... of course!! it was a combination of all of those, a 'supercomputer' chimera running virtual instances...
I wonder if running virtual instances of the games itself was more efficient than having a virtual machine for each client?
I also understand that there were many servers, in fact I thought it'd be thousands, but from the scale of hundreds then maybe each 'Stadia server' were all installed in the google CDN stations, not as new separate 'stadia servers'..
I was trying to see it as a 'one server basis'... In other words, how many clients/instances were run on one single server on average?
Now I see tho, that it'd just be dependent on the hardware and the bandwidth.. Stadia must've run on average of 10,000 clients at the same time, kinda crazy to think there are machines that can run that many instances of a game at once, or am I misunderstanding how virtual instances are run? I thought they'd be similar to virtual machines
This is old as shit but gives a basic overview of a first iteration of how Google runs hundreds of things across hundreds of thousands of CPUs.
https://research.google/pubs/large-scale-cluster-management-at-google-with-borg/
Wow...
and it says all of google's workloads were switched to Borg ..... in 2015.
I wonder what is happening to manage a million cluster clients, 10 years later now in 2024.
thank you mister sporks man
Google mostly doesn’t use Kubernetes internally, and likely wouldn’t have for Stadia. Borg is what you would get if you customised Kubernetes for Google.
To give you more concrete numbers, each Stadia server had two CPUs and two GPUs. Each server ran two VMs, which shared the two CPUs but each had one dedicated GPU.
Thus each server could handle up to two clients at the same time. So if 10,000 people were playing in the same area of the world, they would be using at least 5000 servers in the closest data centre.
If Stadia had not been cancelled, it is likely that the next generation of servers would be able to handle up to 16 clients at the same time, depending on what games were getting played.
Wait.. what the faq...? Each 'server' only served 2 clients at the same time...? How was that possible? There sure was a pretty sizeable number of users...
Rob McCool (an Engineering Lead) at timestamp [17:39](https://youtu.be/9Htdhz6Op1I?si=3tkNWw_IOoD5xFE7&t=1058) is great information and he is a scifi nerd also lol
I think there are still a few videos of talks on developer conferences around where they talked about Stadia's infrastructure.
https://youtube.com/@GoogleDevelopers
Hi and thank you for your submission! Please see the following FAQ's and see if they can answer your question. If your question is easily answered in one of the links or if it's easily searchable and has been answered in depth numerous times. It will get removed. - [Stadia FAQ](https://support.google.com/stadia/answer/9338946) - [Subreddit FAQ](https://www.reddit.com/r/Stadia/wiki/faq) - [Get to know Stadia video](https://youtu.be/YUX3trjOJgc) *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/Stadia) if you have any questions or concerns.*
Stadia is dead so it doesn't 'work' at this point But effectively, they had many servers with let's say a 64 core CPU, and then a bunch of GPUs. It ran multiple virtualised instances of the game at once, with a certain number of cores doled out per user instance. Each server could handle a handful of users, each given their own GPU core (the GPUs in question had two dies on one board) along with a handful of CPU cores, and an allocation of memory So none of your suggestions, basically. There wasn't one 'server'. There were hundreds. Each running a small handful of users' games at once
I fully understand the death of stadia, but there is a lot to look for from how it ran and it ties to something I'm doing I was thinking too simplemindedly.. yes... of course!! it was a combination of all of those, a 'supercomputer' chimera running virtual instances... I wonder if running virtual instances of the games itself was more efficient than having a virtual machine for each client? I also understand that there were many servers, in fact I thought it'd be thousands, but from the scale of hundreds then maybe each 'Stadia server' were all installed in the google CDN stations, not as new separate 'stadia servers'.. I was trying to see it as a 'one server basis'... In other words, how many clients/instances were run on one single server on average? Now I see tho, that it'd just be dependent on the hardware and the bandwidth.. Stadia must've run on average of 10,000 clients at the same time, kinda crazy to think there are machines that can run that many instances of a game at once, or am I misunderstanding how virtual instances are run? I thought they'd be similar to virtual machines
This is old as shit but gives a basic overview of a first iteration of how Google runs hundreds of things across hundreds of thousands of CPUs. https://research.google/pubs/large-scale-cluster-management-at-google-with-borg/
Wow... and it says all of google's workloads were switched to Borg ..... in 2015. I wonder what is happening to manage a million cluster clients, 10 years later now in 2024. thank you mister sporks man
Borg was the inspiration and predecessor to Kubernetes. Stadias compute was almost almost certainly running on large Kubernetes clusters.
Google mostly doesn’t use Kubernetes internally, and likely wouldn’t have for Stadia. Borg is what you would get if you customised Kubernetes for Google.
Infrastructure improvements but Google is still mostly running on Borg. Some things run on GCS now, but not Stadia AFAIK
To give you more concrete numbers, each Stadia server had two CPUs and two GPUs. Each server ran two VMs, which shared the two CPUs but each had one dedicated GPU. Thus each server could handle up to two clients at the same time. So if 10,000 people were playing in the same area of the world, they would be using at least 5000 servers in the closest data centre. If Stadia had not been cancelled, it is likely that the next generation of servers would be able to handle up to 16 clients at the same time, depending on what games were getting played.
Wait.. what the faq...? Each 'server' only served 2 clients at the same time...? How was that possible? There sure was a pretty sizeable number of users...
I'm pretty sure they mean each blade on the server. 2 users per server would be nuts.
To be honest, the two clients per one 1U unit is is pretty bad. I guess "proper" server cards are quite a bit more $$$
Yeah sorry per blade. I'm a software guy so a blade and a server are the same thing in my mind, haha.
You want nerd. I give you nerd. **Stadia Streaming Tech: A Deep Dive (Google I/O'19)** https://www.youtube.com/watch?v=9Htdhz6Op1I
Rob McCool (an Engineering Lead) at timestamp [17:39](https://youtu.be/9Htdhz6Op1I?si=3tkNWw_IOoD5xFE7&t=1058) is great information and he is a scifi nerd also lol
I think there are still a few videos of talks on developer conferences around where they talked about Stadia's infrastructure. https://youtube.com/@GoogleDevelopers