In Theory: Can Cloud Gaming Replace Console?

Can the lag situation be improved? Well, game developers can certainly improve latency through more efficient code: Guerrilla Games reduced Killzone latency from 150ms down to around 116ms between sequels, and Criterion Games managed to get Need for Speed: Hot Pursuit lag down to 83ms on a 30Hz title (which we believe is a first) and reduced it still further to a phenomenal 50ms on the PC version of the game. The lower the core latency in the game code itself, the less noticeable the encoding/decoding/transmission overhead added by Cloud services will be.

It's also reasonable to assume that infrastructure deals such as the one struck by OnLive with BT Internet will make a difference: cutting out as much of the internet as possible and talking as directly with the server as you can is bound to make a difference.

But what of the fluctuating picture quality? OnLive appears to operate on the same general principle as Gaikai - both systems use the same h.264 video codec as featured in streaming Flash video, but the keyframes, or "intra" frames (reference points from which future frames are derived) are instead replaced with what is called periodic intra refresh. In this situation the frame is split into sections which have reference information updated in sequence, cutting down latencies and improving compression efficiency in an environment where every millisecond counts.

A potential route to improving picture quality may well be to offload the issue of video compression from the cloud service and instead make it part of the actual rendering process in-game.

However, the fact remains that there's only so much bandwidth available. The more detailed an image is and the more motion there is on-screen, the more data needs to be sent to the user in order to sustain the same image quality. The result can be really poor picture quality in the heat of the action and a direct impact on the gameplay experience. Just the basic make-up of a game's visuals can make a huge difference to compression efficiency. A dark, slow-moving game like Alan Wake is eminently suitable for some serious compression, while a game with a lot of detail/noise like Enslaved is far more difficult to compress, even with relatively slow-moving motion.

Constricted bandwidth is always going to be a problem to a certain extent, and short of throwing more bandwidth at the issue, or introducing more efficient coding technologies, not much is going to change that. However, a potential route to improving picture quality may well be to offload the issue of video compression from the Cloud service itself and instead make it part of the actual rendering process in-game. In the here and now, engine architects are dealing with a high def display as their final output and calibrate their outputs towards that, but what if this situation changed? What if they also targeted h.264 output as well?

The way things stand, the Gaikai and OnLive compression systems don't have the ability to judge which parts of the image are important and which are not, so bandwidth allocation is based on movement rather than where the player's focus is at any given point. Crytek has already made some fleeting references in its technical presentations to a "points of interest" focus on video compression - where a core part of the engine tech intelligently decides where bandwidth should be utilised in order to maximise image quality where it matters to the player.

Over and above that, there's the basic fact that optimising for a specific target platform - be it console or cloud-based - will almost always produce a better result. Should cloud gaming take off, we may well see the basic make-up of art assets being influenced by how well they will compress, for example. The other element to factor in is the price of bandwidth itself. Right now, OnLive targets 5mbps for its HD "720p60" streaming. Double that data throughput, and many of the issues to do with picture quality would be resolved pretty quickly.

The notion of a cloud-based delivery system doesn't need to be restricted to just video either. John Carmack predicts a day where rendering technology is so powerful, we have a single device that can dock anywhere and provide gameplay in the lounge, on the move, or wherever you like. At this point, the notion of having a far-off server rendering each individual frame and beaming it across the internet could be replaced by a different system, where gameplay assets are streamed instead with rendering and gameplay logic being handled locally. Different cloud-based systems like this wouldn't necessarily compete with the established providers either - there's nothing to stop OnLive repurposing its datacentres for a different kind of traffic, for example.

This way of utilising the cloud wouldn't have the immediacy of the Gaikai/OnLive experience (games would need to be downloaded) but it would resolve the issues of latency and image quality - the device would still be generating the image, and response would be as instant as a local video game. However, the bandwidth requirement in background-loading gameplay assets would be considerable and making it work convincingly could require a fundamental re-think of the way games are designed.

There's plenty of time for that to happen, of course, and for a whole range of alternative solutions to become apparent. If cloud gaming is to gain traction over two console generations, the transformation we could expect to see in that time period would be quite phenomenal. Quite where the PC would sit within the new eco-structure is an interesting question: OnLive and Gaikai are both based on PC architecture, suggesting a rosy future for hardcore gamers if these systems gain traction. Of course, the real unknown surrounds how the existing major platform holders - Microsoft, Sony and Nintendo - would respond to the challenge in seeing their business models effectively replaced...