Apple AR Glasses - The Future of Reality!

AR is the future and I’m so excited for it! 

Apple is currently the leader in terms of AR Tracking right now. We know that they’re working on their brand new AR Glasses, which we’ve done a number of videos on but you see, this video is quite a bit different, this is because I’ve sort of tried the Apple AR Glasses myself. Well, not the actual unit as no one outside of Apple really has access to those, but I have tried two devices which are essentially early prototypes of what the Apple AR Glasses will deliver, in terms of functionality.

So, without any further ado, get those snacks ready and let’s jump into some AR.

---

DreamGlass 4K

The first item that I have tried is called the DreamGlass 4K. This thing hasn’t fully launched just yet, it’s on Indiegogo, DreamGlass hasn’t sponsored this in any way, they have sent this over for us to check out. After checking it out, I honestly don’t recommend it but it does have some interesting features that do give us an early taste of what the Apple Glasses can do.

This is basically a Heads-On Display Headset, very similar to the Google Glass where you had this tiny Display in a corner of your field-of-view. That tiny Display would show you some info such as the Time, Date, Weather, Notifications and stuff like that. The first difference here is that the Display on these is Full-Screen, rather than it being a tiny window. Secondly, these Glasses are actually tethered to a Remote, which I’ll get to in just a second, meaning that they’re more like a home-experience device rather than something that you would take on the street or in public.

The way they work is that they have these two tiny Displays in each of the Lenses, which your eye then perceives as one Display. It’s fairly high-res, at least according to DreamGlass. They claim that this is a 4K Panel, but  I’m not so sure about that as the content that I was viewing on this was mostly 1080p. However, I can’t deny that the Display inside of this is pretty decent. You connect the Headset to a Remote, which runs Android. It has Bluetooth, WiFi and all of that, which means you can put movies and a few Apps on here, then preview those on the Headset itself. The reason why this isn’t AR is because the Display itself is fixed, it doesn’t move. If you move your head, it will move as well, just like the Google Glass did. 

The DreamGlass 4K is an early prototype with some flaws to iron out, but it has some promising features.

Now, what’s cool about this is that the Remote itself also has a HDMI Port, meaning that you can connect this to a Console and play Console Games on your Headset without anyone even noticing. You can connect your Smartphone and play some movies directly or even stream content wirelessly, that’s doable as well. Plus, you can connect a Controller and basically have a gaming set-up on the go. However, my favourite feature is that you can also connect it to a Laptop and have a full Desktop UI, which you can then control with your Mouse & Keyboard and then when you remove the Glasses, the virtual set-up is all gone.

So, that’s what I really like about these, the fact that they give us a glimpse of what we could do with true AR Glasses in the future. If you’re ever played ‘Horizon Zero Dawn’, humans had these Chips that they would attach to their heads and they were able to see AR Elements in the real world, that’s how they were all using their computers. There were no Monitors, you would just sit on a desk, turn on your AR Chip or Headset and your computer will appear right in front of you. The DreamGlass is essentially an early look at that.

Unfortunately, it does have a lot of issues. For example, even-though DreamGlass says that this is 4K Display, on their Specs sheet they only list 2.5K, which I’m assuming is for each eye. But anyway, once I connected my Laptop to the Headset, the Laptop was only seeing this as a 1080p Display, rather than a 4K Display. Not only that, but there was a significant amount of ghosting and lag when using the Mouse. So, the Response Time on this is extremely high, making it unsuitable for almost anything other than watching movies really. Speaking of that, we tried manually putting some videos and Apps onto the Headset, but our computers just couldn’t see it. Not even a USB stick would work, through that single USB A Port. You can activate 3D Mode using a Button on the Remote, which actually works surprisingly well, that’s cool but realistically, I just cannot recommend this to anyone.

It costs $400 or £300, as much as a Console, but it’s nothing more than a Monitor that’s strapped to your head, which also needs another device to work properly. The DreamGlass isn’t really worth it, but at least we got a good idea of how the Apple Glasses could be used to interact with a virtual Mac.

---

Oculus Quest

Now, the second device that I have is a bit more special, this is the Oculus Quest. It is something that came out last year and we’ve even made a very detailed Review Video, which you can check out on the channel.

Now, as most of you might now, the Oculus Quest is a VR Headset, meaning that you’re fully immersed into the experience and you cannot see the real world at all. Something quite unique about the Oculus Quest is that it is a fully wireless VR experience so unlike the Smartphone VR systems, where you just slide in your Phone and you can just look around up, down, left or right, the Quest has the full Six Degrees of freedom. This means that you can even walk around your room and the Quest would be able to track that. It’s pretty much like the high-end VR systems, like the HTC Vive, except it’s fully wireless and it does all the tracking on its own, without the need to place large tracking Sensors in your room. In order to achieve this, it uses four Cameras, one in each corner that tracks the environment in 3D. 

A recent update for the Oculus Quest really ups it’s AR game, with features that Apple’s own device could implement.

But what has this got to do with the Apple AR Glasses, which are surely AR and not VR? Well, Oculus has actually released a recent update, which allows you to also use the Quest as an AR Headset. So, remember those Cameras that I mentioned that are used to map the environment in 3D? Well, with this recent update, you can actually replace the standard background in the Menus, with the video feed from the Cameras. Even-though this is just black and white, it perfectly matches the environment in real life and you now have all the Menu Elements appear on top of your real world. This is fully tracked, which is really what the Apple AR Glasses will be all about.

The only difference will be that Apple’s Glasses will be smaller and made so that they resemble actual Glasses. Plus, the AR Elements would be overlaid on top of your real-world view, rather than a Camera recording your real-world view and then overlaying the AR Clements on top of that video recording. Everything will be just as sharp and just as colourful as in real life.

This would be cool if you could just use your hands to control the UI. Well, it turns out you actually can! The Oculus Quest has full Hand-Tracking Support, meaning that I can just use my hands to navigate the UI. There are also a few Gestures that I can do to simulate a click or even move the UI around. I have to say, if you do have an Oculus Quest, you have to try this for yourself.

Firstly, you need to make sure that you have the latest updates installed, then go into ‘Settings’, ‘Experimental Features’ and turn on the new Beta HomeScreen UI. Once you’ve done that, the Headset will reboot. After that, you can go into ‘Settings’ again, select ‘Virtual Environments’, select ‘Passthrough’ and there you go, an early look at AR Glasses.

---

Apple AR Glasses

Ok, so now that I have talked about two pieces of tech that give us an idea of how Apple’s AR Glasses will work, how would they be any different from these two Headsets?

First of all, Apple will designing their AR Glasses to look like regular Glasses. We have heard some rumors that Apple is also working on a VR/AR Headset, which is said to look similar to the Oculus Quest and that one might launch earlier. The main AR Glasses Headset that we’re all waiting for, that would just look like a regular pair of Glasses.

The use of the LiDAR Sensor on the iPad Pro & iPhone 12 Pro’s may be a test-run for something much bigger.

The second difference, like I mentioned before, is that the AR Elements would be displayed on the actual Lenses of the Glasses, rather than those being displayed on a video-stream, like they are on the Oculus Quest. You will get to see the AR Elements projected right onto the real world, with the elements themselves being in 8K Resolution, according to the info that we’ve seen so far. Also, instead of using actual Cameras to map the environment, like the Oculus Quest, Apple is said to be using LiDAR Modules that they’re currently using in the 2020 iPad Pro (this is also what the iPhone 12 Pro’s will be using).

Not only that, but Jon Prosser said that this is Apple’s plan, to implement the LiDAR Module on their iPads and iPhones first so that users get to use it for a bit, then take all the AR data that they’ve gathered from those devices and improve on the AR experience for the Glasses. It seems like the only reason why the LiDAR Modules are there is to create the AR experience of a future product, Apple’s AR Glasses. 

In terms of interacting with the UI Elements, Siri will indeed be present. Just like with the AirPods and pretty much all of Apple’s devices today, you’ll be able to ask Siri different questions and requests certain actions. The interesting part is when it comes to touch interaction. We’ve seen some reports that Apple will have a Touch Panel built into the Frame. That may be the case for things such as Volume Control, but I think the main interaction would be done in a very similar way as to how it works on the Oculus Quest, which is by fully using your hands in the air, flicking and scrolling through the UI. 

In fact, a recent Patent Application found by ‘AppleInsider’ shows that Apple is looking into having interactive AR Elements appear on a real-world surface. What this means is that you would be able to have Buttons, Menus and even Apps on a flat surface, in the real world, and interact with them just by pressing the virtual Buttons. This will be sort of like having a virtual iPad that’s just sitting on a desk, that you can actually interact with. 

In fact, one MacRumors user, ‘AngerDanger’, claims that Apple could potentially use Thermal Imaging to detect hotspots left by finger-taps on surfaces, which they can then register as Touch Input. Not only that, but if you’ve been following Apple’s advancements in AR, with ARKit, you know that they managed to pull off things that were previously considered impossible. They managed to pull of AR Tracking with just a single Camera Lens. Normally, you would need at least two Cameras so you can compare the differences between the two and create a 3D shape. Apple managed to pull this off with just one Camera and by using the data from their built-in Gyroscope and Accelerometer. Not only that, but Apple has also managed to add real-time shadows onto the virtual AR objects. What this means is that, if you have a virtual object and in the real world and you have a light pointed in one direction, that virtual object would blend into the scene perfectly with the light casting a shadow on its other side.  Apple has also managed to pull this off with reflections. If you have a glossy virtual object, objects from the real world, this would actually cast reflections on it.

The bulkier headset that Mike Rockwell advocated for would need external hardware, something that Jony Ive and Tim Cook did not side with.

Apple’s AR glasses are said to be announced by the end of 2021, with a full release in 2022. This can of course be delayed, depending on how the project is going for Apple. Speaking of that, a report that came from Mark Gurman in June 2020 claims that there have been some serious internal debates between Jony Ive and Mike Rockwell, who leads Apple’s AR and VR development on how this Headset should work.

Jony wanted a fully wireless Headset that was thin and sleek, essentially, the Glasses. Mike, on the other hand, wanted something revolutionary in terms of Graphics and experience and because of that, the Headset ended up being bulky and needing an External Box, which would process all the data and then stream it wirelessly to the Headset. This Headset would’ve been an AR and VR Headset, again, very similar to the Oculus Quest. 

Tim Cook apparently sided with Jony on a Headset that doesn’t take people from the real world, but instead adds Elements onto the real world in order to improve it, which I fully agree with. I’m personally team Jony here but do let me know what do you guys think? Would you prefer that Apple develops the AR Glasses or an AR/VR Headset, like the Oculus Quest, instead?

Oculus Quest Review

---

Our lives are sometimes boring. We just feel that time doesn’t move fast enough or sometimes we feel that it moves way too fast. We want to be able to do great things, travel around the world, do space walks from the ISS or maybe even travel aboard an actual advanced space craft and explore our Milky Way Galaxy at the speed of light! 

All these are things we dream of but they’re also things that 99.9% of us, will never get the chance do to.

But what if I told you that there was a way? The Oculus Quest is a VR or Virtual Reality headset. You put this on your head and you get fully transported into a virtual world and you can pretty much do anything that you can imagine.

Whats special about the Oculus compared to others on the market at the moment is that this is the first real VR that does not have a cable at all. Normally you have the VR headset connected to your PC or game console, but this one is truly wireless and it also supports 3D tracking so you can move around in your room, you can also see your hands as well, and it also tracks when you close your fingers and more.

So how does this measure up against its competitors and what do I think? Well, here is my full unbiased review of the Oculus Quest, after over two months of use!

---

RESOLUTION

The Oculus Quest has a resolution of 1440x1600 per eye which is quite a lot! The original Oculus Rift had 1080x1200 per eye so this is higher than that. This is also higher than the newly released Rift S which has 1280x1440 pixels per eye and this is also significantly higher than the 960x1080 that the PSVR has per eye! 

In fact, the Oculus Quest actually has a higher resolution that the much more expensive HTC Vive and it even has the exact same resolution as the Valve Index VR, which is pretty much the best VR headset that money can buy right now! There are a few Chinese ones that have 5K or 8K displays but they’re only for watching movies mostly. 

Now I have been an avid user of the PSVR, using it for over 8 months, and coming from that I could definitely notice a significant increase in resolution. You can still see the pixels on this by the way, you would need something like a 16K display per eye in order to not see any pixels at all, but this is already a major improvement from the PSVR.

However, if it sounds too good to be true, it probably is.

GRAPHICS

So following on from that thought let’s talk about the graphics.

Even though we do get such a high resolution, the Oculus Quest has to run the graphics internally, using a Snapdragon 835 processor. Yes, the same processor that you would find in a Samsung Galaxy S8 from more than 2 years ago, and the S8 wasn’t a powerful phone in the first place. Performance wise, the 835 is even weaker single-core wise than an iPhone 6s from 2015. And GPU wise, it is just barely more powerful the iPhone 6s from 2015.

The Snapdragon 835 Processor found in both the Samsung Galaxy S8 and the Oculus Quest is less powerful than that of the 2015 iPhone 6s

Not only that, but the Quest only has 4GB of RAM, which is pretty much the same as you can find in low to mid-range smartphones today. The Galaxy S10 or OnePlus 7 Pro for example can have up to 12GB of RAM, 3 times as much as the Quest has.

So performance wise, this headset is very very under powered. But wait, there’s more!

The severely under powered 835 CPU inside of this not only has to run the game at 72FPS with a 72Hz refresh rate, but it also has to do all the tracking of you hands and the environment in real time!

Now although that is impressive that means that games don’t even get access to the full power of this weak CPU and because of that, they never run at full resolution, at best you are looking at 1920x1080 or even lower in same cases. Whats annoying about this is that it doesn’t really matter that you have such a high resolution display when the image that’s displayed on it is a much lower resolution. So the Quest is like having a 4K display. But playing the games in 720p.

Still games such as Beat Saber, Creed & Superhot VR actually look sharper than on the PSVR! Shaper but the graphics are not that great. For example in Beat Saber, which is literally my favourite VR game, on the Quest there are no reflections on the walls, there are less sparks when the cubes are cut, and the whole thing looks more like a mobile game than a PC game. A good way to put all this is, imagine the Oculus Quest like playing in 4K but on low setting, while something like a PSVR is playing in 1080p but on epic settings.

Also something that I want to address is the frame rate. The Quest has a refresh rate of 72Hz which means that the maximum frame-rate that you can get in games is 72fps. For “proper” VR you need at least 90fps. This is why most VR headsets are even pushing for well over 90Hz now. The PSVR for example, can do 120Hz so you get almost double the frame-rate with the PSVR.

However, while I was expecting the Quest to be a very laggy experience, with a lot of motion sickness because of the lower refresh rate, that was definitely not the case. In fact, in most games I couldn’t even tell that the Quest had that much of a lower refresh rate, when compared to the PSVR. In Beat Saber for example, playing on Easy, Normal and even Hard was perfectly fine. The only time I’ve noticed the frame-rate was when playing on Expert.

Sometimes it would lag, but only slightly, maybe dropped a frame or 2 and that was a bit noticeable. Other than that, I’m quite impressed.

The patent of the Oculus Quest showing the cooling system, including a hybrid fan

So how does the Quest do that? How can it render the games in 1080p or even higher, while keeping a frame rate of 72fps, and also mapping your room in 3D, and tracking your controllers in real time with that heavily under powered Snapdragon 835 processor?

Well two ways, optimisation and a fan! Yes, the Quest has a lot of thermal paste on the CPU, two individual heat pipes as well as an actual active fan in order to keep the processor cooled, because this thing is overclocked! And that overclock is how this CPU manages to handle everything!

COMFORTABILITY

But a good VR headset needs to be comfortable. So how comfortable is the Quest?

Well, the PSVR has that ring that attaches to your head and the VR itself just floats right above your face, it doesn’t really touch it at all. Which means that this PSVR is extremely comfortable! In fact, everyone that has used the PSVR and other VR headsets agrees that the PSVR is the most comfortable VR headset on the market right now.

As the Velcro straps are the only thing that hold the Quests position, some may find that it needs adjusting often to keep it in place

So coming from that PSVR experience to the Quest was an awful experience! The Quest is by far the most uncomfortable VR that I have ever used. It is very front heavy so you constantly have to adjust it, after just 5 minutes or so. It only has a Velcro strap which is extremely basic and doesn’t even go to the bottom of your head at all.

Now there are a few mods and accessories that you can buy and make this more comfortable if you wish. You can buy an HTC Vive Pro attachement and install that, if you want to be creative.

But Oculus does not sell any 1st party accessory to make this more comfortable, which is a shame, because I honestly believe that this is the worst thing about the Quest. It’s not the graphics or the frame rate, it’s just how unpleasant this is to wear, and that’s really bad to say about a VR headset that you’re supposed to use for at least 30 minutes if not even a few hours.

TRACKING

Another very important part of any VR headset is how good the tracking is, and I’m glad to say that the tracking on the Quest is just outstanding! 

So it uses four cameras, two in the top corners and two in the bottom corners of the headset and then this is how it maps your room in 3D. I think probably my favourite part of this is that every time you put the Quest on, it will enter into Guardian mode where you can see the outside world and you just draw and outline on the floor where you want the play area to be.

Whilst wearing the Quest, if you come close to or go out of the Guardian Area the walls will start to appear like in the above image

The idea here is that if you step near the virtual walls that you created, you’ll get a warning, and if you put your head through that wall you can actually see the real world. Honestly, this is amazing as no other VR system does this! This way I always feel safe inside the Quest as I know that I won’t hit a piece of furniture or walk into a wall, because I’ll get warning and I can actually see the virtual walls when I come close! This is a great feature!

However, you do need to have a fairly generous space, to play in. For example, my Quest told me that my living room was too small, even though my PSVR didn’t have any problem. So in my case, I ended up activating the Virtual Walls whenever I was playing Beat Saber and I had to disable the guardian in the end, just because it was getting quite annoying. You can do that by enabling developer mode, in the Oculus app on your smartphone by the way. 

Now when it comes to the tracking on the controllers, the new Oculus Touch controllers have this ring facing you that contains IR transmitters that the cameras on the Oculus Quest pick up. These worked extremely well, especially after the July 2019 update. 

Unfortunately, the tracking does not work in a very bright environment, so you wouldn’t be able to use this outdoors and it also does not work in a very dark environment either. Now the PSVR on the other hand does work in complete darkness, which is a pretty good advantage to have.

But overall the tracking is indeed better than the PSVR, especially after the latest July update I mentioned before. In Beat Saber on Expert, the tracking lost about 2-4 blocks per song, compared to maybe 5-6 on the PSVR.

CONTROLLERS

Now I briefly touched on the controllers in the last section but there’s a lot to talk about so they have to have their own section.

They both have a joystick as well as two buttons, XY AB, and you also have two triggers, one on the back and one on the side, so you have the full experience that you have on a console controller here. 

As the controllers are capacitive, you only have to place your fingers on or off the buttons and triggers on the controller for it to register

But probably the best part is that all the buttons have a capacitive sensor on them. This means that if you touch the buttons, without pressing them, this would make your fingers close. Really cool stuff! Grabbing objects in games with this is extremely intuitive. 

But there are a couple of things I dislike about these controllers.

First off, they are quite on the small side, so if you’re coming from the PSVR they’re not that easy to grip. So in Beat Saber they do not feel like swords like the PSMove controllers do, instead they feel like gloves or small objects that you hold in your hand.

They’re also very light and the vibration motor inside of these is quite weak, and the battery door kept coming off during Beat Saber gameplay which was quite annoying! So even though the tracking is great on these, in Beat Saber these are not the best controllers. The PSMove controllers are much better for Beat Saber. So what I’ve done, is that I’ve actually bought these extensions for the controllers which work amazing! They make the controllers feels almost as good as the PSMove ones by making them heavier and the vibrations feels a bit stronger as well!

GAMES

But how do those features integrate into the gaming experience I hear you ask! 

So, I’ve played a few games on this. Obviously Beat Saber which is my favourite, but also Creed, Superhot VR, Starwars Vader Immortal, Google Tilt Brush and wow! I’m extremely impressed!

You put on the Oculus Quest and it instantly turns on! And if you were previously in a game it would instantly bring you back into that game! That is amazing! There is no wait time, you can just jump right into VR when you want! 

I personally do not support unlicensed songs, but Beat Saber does support custom songs and mods on the Quest. You need to download an app called SideQuest, connect your Oculus Quest on your computer and do it from there, so a little bit more effort but it is doable. You can download and load pretty much any songs you want, which is something that you cannot do on the PSVR version. 

Now there aren’t that many games as of yet, there are about 30 or 40 but that list is constantly growing. Also I was surprised to see how little storage games occupied. I got the 64GB model for myself and that’s also the once that Oculus had sent over. But after installing about 10 or so apps and games, I still had more than 40 GB left. In fact, most Apps only take less than 500MB! So in case you’re thinking about that 128GB model don’t buy it unless you’ll also be using it to store a ton of movies.

Now something quite cool about Quest is that you can also stream your view to a TV, smartphone or tablet. By default, you can do it in the app on the device that you’ve set it up on and this is how you can show your friends what you’re doing in VR. Unfortunately there is no sound if you do it this way, but if you have a Google Chromecast you can also stream it directly to your TV and this way, you do get sound output. Unfortunately the signal was extremely poor in my case and it was constantly dropping out. But hey at least it’s doable to some extent. 

Streaming to a smartphone is just one way for your friends to see what you see through the Quest

And speaking of sound, the Quest does have some built-in speakers which are okay. I wouldn’t use them for Beat Saber but for general sound effects and navigation and maybe Google Tilt Brush they’re fine.

The Quest does have two headphones jacks, one on each side. Oculus does supply first party headphones to purchase but I couldn’t find them in stock anywhere, but you can actually use your own headphones it’s just that you will have that annoying cable in between that would get in your way. 

Now, something that I’ve personally noticed is that the lenses on my Quest were quite blurry, even after cleaning them, they was still the same. I’ve noticed this on both my Quest and the one that Oculus had sent over so I’m not sure if this is a wide-spread issue or if this is just how the lenses on the Quest are? So unfortunately they’re a bit blurry and they also have a lot of reflections, something that I’ve never had an issue with on my PSVR or even on my Samsung GearVR headsets.

BATTERY

As I mentioned at the beginning of this review, the Quest is the first truly wireless VR headset. So whats the battery like on this?

There is no way to charge the controllers whilst using them and the batteries have to be removed to recharge or replace them

Well I got about 2 hours of gameplay. It does depend on what game you play, but 2-3 hours is what you should expect. I do like the fact that the charging cable is long enough for you to use the Quest while it’s charging, but I do not like the fact that the controllers do not have a charging port. Instead, you have to use AA batteries which is quite inconvenient. Everything should be rechargeable in 2019! 

Also Oculus did tell me that the 128GB is also heavier due to the larger battery. Personally I haven’t been able to verify this claim anywhere else, so from my knowledge both the 64GB and the 128GB models have exactly the same battery.

CONCLUSION

So in the end is the Oculus Quest worth it?

Honestly? Yes it definitely is! If you don’t have a VR then this is the best all round VR headset in my opinion and even if you do have a VR, you should still try this one because the joy of not having a cable anchoring you down is just incredible!

Yes the graphics are not as good as on the PSVR or any desktop VR for that matter, but they are good enough, and the fact that you can just put this thing on and you’re instantly into a game is something that you don’t have on any other system right now!

I just hope that Oculus releases a Quest Pro in the near future with a more powerful processor and a better head strap because those are my 2 main complaints, but other than that the Quest is a console category of its own. So if you haven’t upgraded to an Xbox One X or a PS4 Pro this is a much better option since it’s something completely different! I’m truly looking forward to the future of VR!