news

zuckerberg's "second startup": selling glasses, selling the world's most powerful glasses

2024-09-26

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina

when zuckerberg was about to come up with a code name at the meta connect conference orion prototypehe even rubbed his pants nervously.

when he is nervous, zuckerberg is more like a real person, not a robot face at the hearing...

to summarize zuckerberg’s opening speech briefly: ar and ai. in fact, these two keywords also summarizezuckerberg and meta's "second venture"he likened orion to a "time machine" that attempts to map out "what meta has done in the past decade" and where meta is going in the future.

it is said that various headsets and smart glasses prototypes are always on zuckerberg's desk.

glasses, everything for glasses

in 2022, he showedfour vr prototypes

(code)Butterscotch explore high resolution;Half Domezoom technology optimized to reduce dizziness;Starburst the main feature is hdr (high dynamic range imaging), but in order to pursue high brightness display, the power support and heat sink equipped make its appearance very heavy; it doesn't matter, there is another Holocake 2, is to study how to create a thin and light appearance.

these prototypes do not bear the burden of commercialization, they are more of a "concept verification" of a certain function (or some functions). what is accumulated is not only technology, of course, but also the outside world's understanding of meta, the next generation of consumer smart glassesexpectations.

“state-of-the-art glasses”

meta shows two relatively clear product lines. one is,iterating on the quest headset, creating a realistic mixed reality experience; second,to build a new personal ai computing platform, lightweight glasses that can be worn daily are currently the best carrier

new quest, shipping in october

the "youth edition" quest 3s follows the industry's trend of gradually expanding vr to mr. it integrates the quest 3 processor (snapdragon xr2 gen 2 chipset), color perspective, hand tracking, touch plus handles, etc. the price was reduced by $200 by replacing the pancake lens solution of quest 3 with the fresnel optical solution.priced at $299.99in the first-person demonstration on site, edge distortion still occurs

in addition to the horizon worlds (metaverse) that we always talk about,quest is also getting closer to vision pro - zuckerberg himself said,this is a general-purpose multitasking computernot just for gaming

compared with the previous generation, the price is much more youthful

because apple's introduction of "spatial computing" has overturned the public's perception of mr products, and alsobringing vr products with entertainment attributes to the dimension of productivity

mr is the inevitable trend towards productivity

quest 3s can project windows desktops and realize multi-screen office. rethinking from the perspective of spatial interface and interaction (different from two-dimensional), such as the social experience on software such as instagram; zuckerberg demonstrated an application called "hyperscape", where users can invite others to "visit" after scanning a real room and reconstructing it in the headset.

multi-screen work is a must-have feature

quest pro and quest 3 did not continue the success of quest 2, so the burden must fall on quest 3s. vision pro undoubtedly has the best mr hardware, but its price really discourages many people.

many meta employees can't explain why ray-ban meta became a "hot item"? glasses are functional products with clear demand. meta did one thing right - let users accept wearing it every day when going outmeta introduced photochromic lenses from essilor luxottica (ray-ban's parent company) to seamlessly switch between indoor and outdoor use; it also launched a transparent frame version to better hide the technology, all of which made smart glasses more everyday.

yes, meta himself didn’t expect this pair of glasses to become so popular.

however, all these preparations are to introduce orion, the first prototype of holographic ar glasses. in zuckerberg's conception, this prototype will be available to consumers.

orion concept phone, the actual version is likely to have a tweaked look (otherwise it would be ugly enough...)

orion uses silicon carbide instead of glass to make its lenses. silicon carbide is very light, it does not produce optical artifacts or stray light, and it has a high refractive index.its field of view (fov) can reach 70 degrees. the waveguide itself has a very complex nanoscale 3d structure and achieves this field of view by diffracting or propagating light.

the projector is uled, which is very small and very energy-efficient.bright enough in any lighting condition

new lenses and projectors

the holographic display can "hold" multiple screens; there are holographic images of different depths and sizes, which can "project" friends remotely to chat with you (if you ignore the fact that the current demonstration effect is still very weird);

manual and eye movements are no longer rare

when the holographic image is small enough, gestures can be recognized accurately enough; even voice, gestures, eye tracking... these are not worth mentioning.neural interaction (emg wristband) is the future

zuckerberg thinks wristband neural interaction is the future

in the demonstration video,huang renxun praised orion after wearing it, "good head tracking, good brightness, good color contrast, excellent field of view" -it’s almost a pair of smart glasses with all the buffs you can imagine.

llama, the linux of ai?

why are glasses such a natural computing device?

assume a few scenarios:

scene 1, you are carrying things in both hands, passing by a vegetable stall, take a picture with your glasses, and ask it, what dish can be cooked with these ingredients?

orion demonstration 1: recognizing food

scene 2, you parked your car in an unfamiliar parking lot and asked the glasses to take a picture and remember the specific parking location;

scene 3, two people who only speak english and one who only speaks spanish used the glasses as simultaneous interpreters to talk in real time;

scene 4, when scanning the qr code to pay, you no longer have to search your pockets for your phone.

orion demonstration 2: work anytime

these are the ai ​​functions that meta exemplifies. the “meta ai” personal assistant will be gradually iterated through subsequent updates.

in addition, meta ai is also working with third parties, such as spotify, amazon music, etc. other functions are superimposed on the glasses, such as speakers can replace tws headphones, and cameras can replace mobile phones.

orion display 3: watch movies anytime

"meta ai" is developed based on the open source model llama, and the model itself has also been updated.

llama 3.2 multimodal model is officially released, including four sizes: 1b, 3b, 11b and 90b. 1b/3b is designed to provide edge computing power, that is, it can run on mobile devices. 11b/90b has multimodal capabilities and can directly replace llama 3.1 8b and 70b——zuckerberg says llama is the linux of ai

linux for ai is a huge ambition

in march this year, foreign media the information broke the news:google is working hard to develop the android xr system. they found meta in the hope of extending android to the xr field.

meta, as expected, refused.. then, meta opened horizon os (vr/ar operating system) to third-party hardware partners.

it is too early to predict whether meta can become the "android of xr", but since meta wants to be the next generation computing platform, then,the grasp of the entrance and ecology will be very important(an analogy is google paying apple $20 billion per year to ensure its default search engine position).

facebook once wrote in its s-1 filing: "facebook is intended to fulfill a social mission and make the world open and connected." more than one billion people have established social networks and developed digital habits on facebook.

connectivity. connectivity for the future

zuckerberg reiterated this statement at meta connect,building a future that is more open, more accessible, more natural, and more connected.

this time, zuckerberg listed the following chips: mr headsets, open source models, more advanced ai, smart glasses...all of which point together to the future he talked about.