David Chalmers considers the possibilities of VR
lithub.comOh, another philosopher discovers VR. I asked the people who moderate r/metaverse to create a tag, "MYFIRSTMETAVERSEARTICLE", for this sort of thing, and they did. I've read about a hundred such articles in the last three months. They're rather similar.
For a view from the other direction, "How to be a God", by Battle. This is a game dev who became an academic and spent too much time thinking about philosophy.
If you want some good metaverse questions to think about, here are a few, based on experience with mature systems such as Second Life.
* Games, like most forms of entertainment, must be interesting. So they have a much higher frequency of interesting events than people usually experience in real life. Much effort is expended in game design to make that happen. User-built virtual worlds, where the world itself is mostly passive, are more like real life. The frequency and density of interesting events is comparable to real life. That indicates the virtual world is doing a good job of simulating the real one. But it can be boring. It results in the standard Second Life new user question, "What do I do now?". The answer is "What do you want to do", which may lead to them being directed to an area where something that fits their interest is happening. But the world itself is indifferent to the players and does not try to engage them.
* How do we govern this thing? Almost everybody seems to assume the existence of some unchallengable authority. That is not only obnoxious, but has scaling problems. Second Life uses property rights to allow property owners to control much of what visitors can do on an owned parcel. This reduces the need for "moderators", who, in practice, are minimum wage workers in some outsourced call center. It's disappointing that democracy is out of fashion. The crypto people's idea of democracy is "one dollar, one vote". That lacks something.
* How "safe" does the virtual world have to be? Roblox takes a very hard line on this. Facebook claims to but has trouble delivering. Decentraland is too empty for it to matter. Second Life takes the position that they don't get involved with disputes between residents, and "safety", if desired, is the problem of the property owner.
* Are you your avatar, or are you puppeteering your avatar? This is a big issue in game design. If someone annoys your avatar, are they annoying you?
* What are we going to do about identity in virtual worlds? "Real Names"? Cross-system identities? Face recognition? Crypto wallets?
* How much of the user do we want to project into the virtual world? Typing only? Voice? Facial feature tracking? Full body tracking? All of those are available.
To Chalmers' credit, he's been writing about this stuff at least back to 2003, when he had a paper called "The Matrix as Metaphysics" defending the idea that the claim that we're living in a simulation is not a skeptical hypothesis, and that such a world would be just as real, just one layer "in." (Probably not as wild of an idea now as it was back then.) Also a couple of other papers on VR since then and many on AI going back to 1990 [1].
Your comment(s) really nails my reservations about VR with my Oculus. After the Wow! factor of a sense immersion, you're in kind of a dead zone trying to think of something interesting to do just like in real life. You went from your real living room to your virtual living room. Big deal. You could play a game in either, but the screen is going to be much better back in your real living room. You don't want to watch Netflix in VR because the screen door effect sucks.
It'd be nice at least in VR if you were sitting in your virtual living room and the door bell would ring. Oh, whose that. It's a white rabbit. I should probably go with, because I'm really bored here. He's running off! I better chase him.
Something to do in VR that you can't do in real life. Something fun, exciting or an AI adventure tailored just for you based on what the AI knows about you.
> Are you your avatar, or are you puppeteering your avatar? This is a big issue in game design. If someone annoys your avatar, are they annoying you?
I read an interesting article earlier that speaks to this. Ram Dass imagines your ego as the coachman, but he's not in charge. He's the servant of you riding in the coach. Anyway, I thought that connection was interesting. In Ram Dass' view, we are puppeteering our avatar, we are not the avatar.
The Quest 2 largely eliminated the screen door effect. I think what you’re seeing in Netflix is that the stream is only 480P because Netflix refuses to update their app.
The big issue is that VR is meant to be social. I find multiplayer VR a lot more enjoyable than single player VR or multiplayer on other video game platforms.
I'll give multiplayer VR a try. Maybe virtually doing fun activities with others is the secret sauce.
Some of the most fun games are silly and not too sophisticated, like this one: https://www.youtube.com/watch?v=bpSwwKK_Nvc
It’s surreal being able to virtually play ping pong or racket ball with a friend or family member who you’re limited to seeing either due to distance or lifestyle ie new parents. Board games are nice too.
That sounds good. I'm charging the batteries of the Oculus and will turn it on tomorrow for the first time in about a year.
> but the screen is going to be much better back in your real living room. You don't want to watch Netflix in VR because the screen door effect sucks
Some of the stuff that’s done well today (e.g. some of the Oculus originals) I already find to be far more immersive and engaging than sitting 20’ away from a screen on the wall.
I think the tech to make AR mainstream for consumers is still years away, and in the meantime, entertainment in VR is the killer app.
I expect this is where Apple may be the main (only?) threat to Oculus. They have the AppleTV+ studios to turn out great original content, and a core skill set in performant and beautiful mobile devices will killer displays. (Not to mention a lot of brand loyalty with folks already in their ecosystem). We’ll see what the price is though…
I have high hopes for Apple. Given their reputation for "taste" and design, I would expect something more sophisticated than Meta, not so plug and play. More "Tomorrowland" vs. Meta's "It's a Small, Small World" vibe.
IMO we are just in denial that the VR headset has really solved anything.
It is not just what you can do in VR that you can't do in real life but what you can do in VR with missing most of your senses.
I suspect in 50 years people will look at this time in VR as not much different than VRML 20 years ago. Obviously, that was never going to work with the technological limitations of the time.
It is really hard to deliver when the expectation is 'virtual reality'.
> For a view from the other direction, "How to be a God", by Battle. This is a game dev who became an academic and spent too much time thinking about philosophy.
For anyone else who was struggling to locate this reference, the author is Bartle, not Battle.
https://www.amazon.com/How-Be-God-Would-Be-Deities/dp/095564...
Link for Richard A Bartle's “How to Be a God”:
Oh, nice, there's a free version. I bought the 2" thick paperback.
> Games, like most forms of entertainment, must be interesting
One of the challenges VR has at the moment is that games are a bit of a dead end. There are some specific exceptions, but the key is that by and large, VR is more limiting as an environment for gameplay not less constrained as people naively assume. So if you are trying to make some interesting and challenging game play mechanisms, you have all the challenges from pancake games, but now you actually many more constraints to make the game work in VR. And in exchange for that, you aren't actually getting a lot more ways to make the game interesting and challenging. You can do some stuff with 3d space that is not there for 2d. But beyond that its just all the same things you would have access in 2d but harder to implement because you can't nauseate or disorient the user, the screen is effectively low resolution, you are limited by what the user can phyiscally do and breaking that often just leads to loss of immersion which frustrates the user.
The actual longer term potential for VR sits mostly outside gaming but it's currently stuck in a local optimum where engaging a subset of gamers who enjoy it is the most lucrative market available, but doesn't lead anywhere useful longer term.
I’m going to disagree about VR being “more limiting than pancake games”. Even formerly mundane things such as hitting or shooting an opponent become eye opening because the player is now actually performing those actions as opposed to directing an avatar to do the same with buttons and a joystick. Immersion is just much better. Also VR players still have access to joysticks and buttons, so you’re not limited to what VR players can do physically.
As for low res screens, looking at tech history it’s only a matter of time before it gets “faster, better, and cheaper”.
That makes sense. Get the gamers to fund what's coming. I bought an Oculus not realizing it was mostly a gaming platform. I'm not complaining at all about games or gamers, but I didn't grow up with games so they're not part of who I am. What I am is a science fiction reader, so I have a different idea of what VR could be. I think most of know what it is, but we don't know how to get there. What Meta is building ain't it, because that's going to be very corporate friendly to sell product. The potential is there, we just have to figure it out.
A little off the deep end when he gets to the philosophical part (which I understand is what the bulk of the book it is excerpted from is focused on).
It's quite weird at the moment how we have a mix of people with completely discordant views about VR: still lots of people viewing it as a failed experiment from 10 years ago, written it off as having no interest and no future ("I have a VR headset; I got bored with it after a few days and now its in the closet" - most tech journalists); vs those who have pretty much factored in that VR will take over and become a mainstream if not dominant computing experience in a meaningful timeframe.
One thing is clear: with Facebook all in on the Metaverse, Microsoft purchasing Blizzard with one of the core stated reasons that it will empower their "metaverse", and Apple on the brink of releasing a VR product - the hype is back and a huge amount of cash is going to get sunk into VR. Whatever that means for the long term, I'm glad it probably will mean there are some short term dollars to propel the fundamental tech along. Whatever happens, it will be fun to play with that.
I'm glad it probably will mean there are some short term dollars to propel the fundamental tech along. Whatever happens, it will be fun to play with that.
Agreed. I think the Metaverse will be a niche, but it will soon become a much higher quality niche.
> Metaverse will be a niche
One big reason for this is some strange social stigma surrounding VR. Yes, there are many other issues like cost (minimum $2000 investment for a VR ready PC and headset) and complexity if you’re not using Oculus / Meta. Then there’s also Facebook’s toxic brand, which drives away many early tech adopters; but what if we were able to take them out of the equation?
Anyways, I did an experiment last Christmas. I got several family members Oculus Meta Quest 2 headsets. At the same time Meta was offering a $60 referral credit where both you and the new Quest user would get $60 in store credit.
To summarize, I removed the barrier of monetary cost, and Meta removed the barrier of complexity from VR (ie no wires, or PC setup). None of these people had a bad opinion of Facebook either. What was the result?
They tried the free demos once and stopped using it. It wasn’t until I constantly pestered them, that they actually tried apps with free credits and games and started to understand VR and use it more regularly, namely the fitness and social apps. I even recently talked to Meta contractor who mentioned that she wasn’t interested in a free Quest 2 headset even though she held the company in high regard. I feel for VR marketing teams. Until Apple helps make this mainstream, XR will have a very big hill to climb.
Interesting experiment.
> started to understand VR and use it more regularly, namely the fitness and social apps
This is the interesting thing that I observe : beyond the hype there are some genuinely valuable quite mainstream applications. Fitness, e-sports, and virtual monitors being some of the key ones. I regularly use VR for 1-3 hours a day doing these.
The problem is that the hype actually gets in the way of people experiencing those. They all require some skill acquisition or semi-non-trivial setup. So instead of someone getting introduced to VR in the form of one of these more sustainable ways, they are shown a glitzy experience that dazzles them with 3d effects that is interesting for a few minutes but has no longer term value. It's like a sugar hit that lasts a short time but actually leaves you feeling worse afterwards.
I think Facebook et al need to work out how to bridge people between these experiences to make it get more mainstream uptake.
Meta’s Quest 2 doesn’t require either “skill acquisition or semi-non-trivial setup” which was why I found the results of my adhoc experiment interesting.
Yes most gaming doesn't require much, but I think the more sustainable valuable applications do.
For example there are table tennis apps so realistic that pros use them to train. I will never ever be able to own a table tennis / ping pong table due to lack of space in my house but I can have it with VR. Not only that I don't need to find a comparably skilled player and line up schedules every time I want to play. And just the price of a real a table alone is more than buying a Quest!
So what's the issue? Well these apps intrinsically take a bit of getting used to. There's a specific technique for serving that relies on some use of the controllers that is not hard but not obvious to someone who started using VR 5 minutes ago. So nearly 100% of people fail at using this app first time they play. Very few people can do this well until they've spent a bit of time in VR, getting used to how you can open and close your grip in the right way to pick things up and put them down etc. We may eventually get there with hand tracking etc where this is not such a problem, but its far from that point now.
So this is what I mean when I say, the "cheap" experiences that are easy for people to experience actually work against - in some ways - VR fulfilling its potential, because typically that is all they get shown and they never get a chance to learn to do the more "high value" activities.
The cost of learning these apps is minimal because the UI relies on UX that’s very well established. Putting them in 3D doesn’t drastically change them. Even people from the boomer generation have little issues with navigation. The only exception would be the G2 and other WMR headsets with terrible tracking. That’s less of an issue with people and more to do with MS’s poor WMR specification.
Imo the main friction is still mainly the social perception of VR.
You’re assuming VR is a paradigm shift and not just a gimmicky console like the Wii.
There’s nothing particularly interesting in VR, at least not yet. Most games suck. The ones that don’t are largely stationary with little rotation if at all. There’s a fundamental problem that humans, even when not constrained by space, aren’t very agile, and much less so wearing a vr headset. It still sucks.
I have an index.
The fitness apps are the most absurd thing. No one that is serious about fitness is working out for any length of time with a headset on.
If you could go to a real virtual gym and lift virtual weights that was no different than lifting real weights, that would be amazing. That would be revolutionary because so many problems would have to be solved.
Instead, the headset has literally solved nothing in the last 30 years. There is a video of Jaron Lanier on youtube showing a vr headset and vr glove in 1990. It could literally be a VR advertisement next year and you wouldn't know the difference.
there are bunch of things here that are just simply empirically wrong ...
The fitness apps and communities are real ... there are subscription services with virtual coaches etc. I myself workout at least 45 mins a day. It's the best workout I've ever had - Synthriders, Crazy Kung Fu, Pistol Whip ... they have you dripping with sweat and surprisingly good strength training (as in, my arms are bulking up more than they ever did with actual weights).
And nothing has been solved in 30 years? Do you understand the Quest is a wireless fully stand alone mobile device? Just that alone is a revolution. It does fully controller free hand tracking. It does 6DoF positional tracking with no base stations or external equipment.
I can't really conclude anything other than that you simply have not even looked in real life at modern VR and have no idea what you are talking about.
I feel that you need to actually try it before dismissing it. I’ve been using VR for HIIT for almost two years now. It can also integrate with your stationary bike or rower. I’ve lost 20 lbs and it helped dropped my cholesterol by 100 point playing VR games.
The only thing absent would be weight lifting. That probably will be integrated with AR and not VR due to safety issues.
Do you really have an Index? The reason I ask is because I highly disagree with your statement about games being “largely stationary with little rotation at all”. It’s the exact opposite, which is why having a wire is so annoying.
VR is a huge paradigm shift. It’s just still in its infancy. Similar to the internet in the mid 1990s.
Like what games?
Virtually every first person VR game that isn't a driving or flying sim needs turning or it kills immersion:
- Alyx
- Boneworks
- Blades & Sorcery / GORN
- Skyrim / Fallout 4 VR
- Onward, Zero Caliber, Population One, Contractors
- Racket NX
- Minecraft
- Lone Echo
- holopoint
There's really too many games to name, and I can name more. A huge pain point for me prior to getting the Quest 2 was tangled wires from too much turning.
The only games where there's no turning involved are fitness apps like Fit XR and ping pong. Even Beatsaber and SuperNatural have 360 degree levels. Your comment makes me wonder if you've ever used your Index, or if you even own a VR headset because it sounds bizarre.
Alyx is cool but it also sucks. The little interactions with items feel novel. The combat is bad.
It’s a thin layer of game design tricks to make you think you’re in something intricate but it’s actually dumb as rocks. The lightning dogs are the peak of this. Even on the hardest difficulty they telegraph their attacks for like… 10 seconds. It’s not clear if it’s possible to dodge it by physically walking 5m. The game wants you to teleport pretty much anywhere to “dodge” it. I don’t blame valve for this. What they almost certainly realized is that humans are incompetent in vr so the enemies need to be dumb as rocks. Not that the AI is bad or anything, but the principles behind their behavior are built for the fact that humans are slow, have low situational awareness, and and especially in vr don’t have a good intuition for where their body is exposed. The electric dogs are still decently challenging. But the limitations on it were incredibly immersion breaking to me, much more than having a helmet benefited.
Superhot solves this the other way by having very short high failure levels and just letting you lose due to human incompetence at your own pace. It works pretty well but it’s not a generalizable strategy for other games. I’m looking to do boneworks next. I’ve never felt wires were a real problem. Mostly because the games I play don’t involve moving around much. I have tried wireless.
I have also done one of those vr domes with a huge open warehouses and multiplayer vr shooters with mild graphics but big gun peripherals. This is the biggest freedom you could possibly have. In my experience playing and watching others, people just slowly walk from place to place, rotate in place, and stand still shooting while monsters get too close and “hit” them because melee attacks feel unintuitive still. They move like they’re an old resident evil tank control character lol.
Glad to find someone else unimpressed by Alyx. I cannot work out why people are so impressed with it. It's just a super impressive sandboxed VR demo really. The whole world is highly constrained - you can't go anywhere they don't want you to, you can only pick up and manipulate a subset of objects they have modeled properly and there all these arbitrary restrictions that just frustrate you from creatively solving any of the challenges. Ends up a totally linear storyline that's more like watching a movie than a real open world VR game (like Skyrim, for example).
It was fairly ambitious and achieved a lot of new ground. The magnet gloves did feel like a really good innovation. The physical devices like the healing station were good examples of paradigm shifts that are cooler in vr. I just didn’t feel like the actual gameplay was very good.
It was never sold as an open world game so I’m not sure why you’re referencing that.
One big reason for this is some strange social stigma surrounding VR.
Matthew Ball, the venture capitalist, argued last year that the social stigma ended during the pandemic.
People are walking around looking at phone screens while wearing iDweebs hanging out of their ears without being laughed at. VR is just the next step.
Unless I missed it, I don’t see any data that supports it. He’s writing about investments in tech for web3. I don’t see anything about consumer adoption of XR headsets.
As for “iDweebs”, they look fashionable and have been deemed socially acceptable by fashion house Apple. They’re also not some giant, novel monstrosity that covers your face and head; AirPods are new yet familiar. They’re just a hybrid of earrings and headphones.
From my personal experience, the pushback against VR is both subtle and strong and it’s not limited to cost or tech complexity (setup). I mean how do multiple people with no ties to each other in different geographical areas reject free revolutionary hardware?
In the wild, I’ve also repeatedly seen claims that VR sucks made by people who’ve never tried modern VR, to the point where they start fabricating their experience. It’s a strange phenomena. It would be nice to see a more formal study on this. I’m guess that form factor matters, and that mass adoption won’t happen until the headset transitions into a glasses form factor.
The problem is I think there is a bias created when we still call our hand held computers that can make telephone calls, "phones".
There is just not that many situations that a VR headset is a better UI than a hand held computer.
The opposite is actually true. If everyone was using VR headsets then it would be obvious that the hand held computer is the next big thing. You are finally free to not have to wear this goofy headset and still do 99% of what you would have done outside of gaming in VR.
One important thing to understand is the "metaverse" these companies are trying to build for is both VR and AR. Not solely VR.
Here, Chalmers is flirting with the simulation hypothesis. I have not yet read his new book, but an article in the NY Times indicates that there he goes deeper into the issue, where he says that he estimates a 25% likelihood that we are in a simulation.
I wonder how he squares that with his enthusiasm for zombie arguments, which purport to show that no mere simulation of a conscious human would have all that is necessary for it to be conscious itself?
https://www.nytimes.com/2022/01/26/opinion/virtual-reality-s...
Honestly it annoys me that someone would throw out a specific number like that for something they have literally no possible basis for.
John Kay wrote a good book about this (Radical Uncertainty). There is a trend to falsely quantify questions that take place either under conditions of uncertainty or where numbers are just axiomatic assumptions rather than based on regular observations.
It's very much everywhere now, not just in abstract philosophy like this but even in a lot of real world scenarios like the pandemic. Instead of giving a qualitative narrative and leaving space for human intuition people try to present arguments as more certain than they are by slapping some numbers / models onto them.
Without knowing where this number came from, I could imagine that his reasoning is that there's 4 main theories that are well-reasoned and he estimates they are all as equally likely.
Grant Sanderson (3blue1brown) was recently on a Numberphile video where he explained Bertrand's Paradox.
An under-specified question meant that there were good arguments for different answers, depending on how the question was interpreted.
In the complementary video supporting the discussion, I found Sanderson's discussion pretty interesting. -- One of the suggested arguments was even "let's take the average of the other answers", although Sanderson wasn't sure if this was meant to be a joke or not. https://www.youtube.com/watch?v=pJyKM-7IgAU
That’s not how probability works
Sure it is, there's even a name for it: https://en.wikipedia.org/wiki/Principle_of_indifference
> I hold that virtual reality is genuine reality.
Ok, but one cannot do science in virtual reality. Is that not a necessity of "genuine" reality?
(Certainly some science can be done entirely in a virtual world, but I would say definitionally not all of science.)
It's clear that what he seems to be saying is "there is no reason VR won't be an acceptable place to live". Which is fair enough, but that seems like a much weaker claim than that VR could be on par with "genuine reality" as a blanket statement.
I dropped off when he starts saying this will work great when we get to brain interfaces.
I’ve read this kind of article so many times. Great if you have insomnia.
> Once simulation technology is good enough, these simulated environments may even be occupied by simulated people, with simulated brains and bodies, who will undergo the whole process of birth, development, aging, and death. Like the nonplayer characters that one encounters in many video games, simulated people will be creatures of the simulation. Some worlds will be simulations set up for research or to make predictions about the future. For instance, a dating app (as seen on the TV series Black Mirror) could simulate many futures for a couple in order to see whether they are compatible.
> A historian might study what would have happened if Hitler had chosen not to start a war with the Soviet Union. Scientists might simulate whole universes from the Big Bang onward, with small variations to study the range of outcomes: How often does life develop? How often is there intelligence? How often is there a galactic civilization?
Uh huh.
Thanks, Supernintendo Chalmers.