FACEBOOK IS WORKING ON READING YOUR MIND … LITERALLY

December 20, 2019 in News by RBN Staff

 

 “Facebook can now decode brain activity in real time, and it’s working on an intermediary system for identifying single words as it pushes toward 100 words-per-minute brain typing.”

UNITED STATES – APRIL 11: Facebook CEO Mark Zuckerberg prepares to testify before a House Energy and Commerce Committee in Rayburn Building on the protection of user data on April 11, 2018. (Photo By Tom Williams/CQ Roll Call)

Source: Tech Crunch

Facebook is building an operating system so it can ditch Android

Josh Constine @joshconstine

Facebook  doesn’t want its hardware like Oculus or its augmented reality glasses to be at the mercy of Google because they rely on its Android operating system. That’s why Facebook has tasked Mark Lucovsky, a co-author of Microsoft’s Windows NT, with building the social network an operating system from scratch, according to The Information’s Alex Heath. To be clear, Facebook’s smartphone apps will remain available on Android.

“We really want to make sure the next generation has space for us,” says Facebook’s VP of Hardware, Andrew ‘Boz’ Bosworth. “We don’t think we can trust the marketplace or competitors to ensure that’s the case. And so we’re gonna do it ourselves.”

Eye OS

By moving to its own OS, Facebook could have more freedom to bake social interaction — and hopefully privacy — deeper into its devices. It could also prevent a disagreement between Google  and Facebook from derailing the roadmaps of its gadgets. Facebook tells TechCrunch the focus of this work is on what’s needed for AR glasses. It’s exploring all the options right now, including potentially partnering with other companies or building a custom OS specifically for augmented reality.

One added bonus of moving to a Facebook-owned operating system? It could make it tougher to force Facebook to spin out some of its acquisitions, especially if Facebook goes with Instagram branding for its future augmented reality glasses.

Facebook Portal Lineup

Facebook has always been sore about not owning an operating system and having to depend on the courtesy of some of its biggest rivals. Those include Apple, whose CEO Tim Cook has repeatedly thrown jabs at Facebook and its chief Mark Zuckerberg over privacy and data collection. In a previous hedge against the power of the mobile operating systems, Facebook worked on a secret project codenamed Oxygen circa 2013 that would help it distribute Android apps from outside the Google Play store if necessary, Vox’s Kurt Wagner reported.

That said, its last attempt to wrestle more control of mobile away from the OS giants in 2013 went down in flames. The Facebook phone, built with HTC hardware, ran a forked version of Android  and the Facebook Home user interface. But drowning the experience in friends’ photos and Messenger chat bubbles proved wildly unpopular, and both the HTC First and Facebook Home were shelved.

Investing in tomorrow tech

Now Facebook is hoping to learn from past mistakes as it ramps up its hardware efforts with a new office for the AR/VR team in Burlingame, 15 miles north of the company’s headquarters. The 770,000-square-foot space is designed to house roughly 4,000 employees. Facebook tells TechCrunch the team will move there in the second half of 2020 to make use of its labs, prototype space and testing areas. The AR/VR team will still have members at other offices across California, Washington, New York and abroad.

TechCrunch asked for more info about the space, and Facebook revealed that it’s planning to open a public-facing, experiential space — possibly the first Facebook-branded permanent location that anyone can visit. There, people will be able to come play with its augmented reality and virtual reality products. Those could range from the Oculus  Quest headsets and Facebook Portal smart displays it currently sells to potential future products like the camera glasses it’s reportedly building with Ray Ban-maker Luxottica and eventually its full-fledged AR eyewear.

A rendering of Facebook’s under-construction new space in Burlingame, Calif.

Facebook says it’s considering building true retail space into the Burlingame office to let people try and then buy its hardware products. This would be a significant first step toward self-branded Facebook retail spaces in the vein of Apple and Microsoft’s stores.

Interested in potentially controlling more of the hardware stack, Facebook held acquisition talks with $4.5 billion market cap semiconductor company Cirrus Logic, which makes audio chips for Apple and more, The Information reports. That deal never happened, and it’s unclear how far the talks went given tech giants constantly keep their M&A teams open to discussions. But it shows how serious Facebook is taking hardware, even if Portal and Oculus sales have been slow to date. Facebook declined to comment on the matter.

That could start to change next year, though, as flagship virtual reality experiences hit the market. I got a press preview of the upcoming Medal of Honor first-person shooter that will launch on the Oculus Quest in 2020. An hour of playing the World War II game flew by, and it was one of the first VR games that felt like you could enjoy it week after week rather than being just a tech demo. Medal of Honor could prove to be the killer app that convinces gamers they have to get a Quest.

Social hardware

Facebook has also been working on hardware experiences for the enterprise. Facebook Workplace video calls can now run on Portal, with its smart camera auto-zooming to keep everyone in the board room in frame or focused on the action. The Information reports Facebook is also prototyping a VR videoconferencing system that Boz has been testing with his team. Facebook tells TechCrunch that Boz hosted two internal events where he videoconferenced through VR to about 100 of his team leaders using virtual Q&A software Facebook is prototyping internally. It’s hoping to learn what would be necessary to consistently hold meetings in VR.

The hardware initiatives, meanwhile, feed back into Facebook’s core ad business. It’s now using some data about what people do on their Oculus or Portal to target them with ads. From playing certain games to accessing kid-focused experiences to virtually teleporting to vacation destinations, there’s plenty of lucrative data for Facebook to potentially mine.

Facebook tells TechCrunch that Portal currently takes data — like if you log in, make calls or use certain features — to inform ad targeting. For example, it could show you ads related to video calling if you do that a lot. With Oculus, if you connect your Facebook account, then data about apps you use or events you join could be used to tune its algorithms or target ads.

Facebook even wants to know what’s on our mind before we act on it. The Information reports that Facebook’s brain-computer interface hardware for controlling interfaces by employing sensors to recognize a word a user is thinking has been shrunk down. It’s gone from the size of a refrigerator to something hand-held, but is still far from ready for integration into a phone. Facebook tells TechCrunch it’s making progress, improving the word error rate significantly up the state-of-the-art research and expanding the dictionary of words that can be recognized. Facebook can now decode brain activity in real time, and it’s working on an intermediary system for identifying single words as it pushes toward 100 words-per-minute brain typing.

Selling Oculus headsets, Portal screens and mind-readers might never generate the billions in profits Facebook earns from its efficient ads business, but they could ensure the social network isn’t locked out of the next waves of computing. Whether those are fully immersive like virtual reality, convenient complements to our phones like smart displays or minimally invasive sensors, Facebook wants them to be social. If it can bring your friends along to your new gadgets, Facebook will find some way to squeeze out revenue while keeping these devices from making us more isolated and less human.