news

Actual test of Apple AI beta version: It’s too difficult to use, really.

2024-08-01

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina


As soon as he woke up yesterday, Shichao saw news from various media:

iOS 18.1 beta is here, and it also bringsHeavy-hitting call recording and Apple Intelligence AI . . .

Just when I was thinking about upgrading, I found a string of words written:

Apple Intelligence is available on iPhone 15 Pro and iPhone 15 Pro Max.Apple Intelligence is not currently available in the EU or China .

It's AppleAIRequires 15 Pro/Pro max, and does not currently support the EU and China regions.


Although Shichao has the 15 pro, I have the Chinese version. This means that even if I update to iOS 18.1 beta, I can't experience Apple AI.

According to the experience of netizens who have updated, Apple AI is hardware-locked.

This means that even if you are at Apple's US headquarters, your phone is connected to CookOpen it for you personallyhotspot, but you can’t use it if it’s an iPhone sold in China or the EU.

But in order to satisfy the curiosity of my fellow enthusiasts, I made a decision that cost me a fortune.

I stole some of the bad reviewer's pocket money, asked a mobile phone store to get me a Taiwanese or American version of the iPhone, and then asked the errand boy to deliver it across Hangzhou.


After receiving it, I immediately logged into the US developer account, upgraded to iOS 18.1 beta, selected English as the system and Siri language, selected the United States as the region, and finally joined the AI ​​waiting list...

After a period of anxious waiting, I received a notification that the apple flavoredAIIt has finally arrived...


As for how to experience it, don't worry, let's talk about it in order, first talking about the one that you have been looking forward to for a long timeApple call recording.

After upgrading to iOS18.1, there will be a recording button in the upper left corner when making a call. Click it to start recording.

But you may have heard that when you turn on the recording, the other party will hear a very clear prompt:This call will be recorded. . .


After recording, we can find the recording file named "Talk with xxx" in the memo.

to be honestVery clear sound quality, Ergou from the hardware department even said that this is enough to be made into a podcast directly.

In addition, the recording can also be converted to text. It supports Chinese but the accuracy is average. There are typos and omissions. When two people are talking at the same time, the text is simply not converted.


Although Apple has finally released the call recording function this time, most netizens don’t seem to like the “recording and notifying the other party” setting. . .


It can be said that Lei Jun has a good business sense.

The newly launched earphones can not only record independently but also convert speech to text, and they are not stuck on the model. They are indeed designed for iPhone users...


OK, now let's talk about Apple.AI

Unfortunately, there aren't many AI features introduced this time.

According to 9TO5MAC, the new features include:New Siri,AISummary of writing tools and email supportHowever, the important features officially announced at WWDC, such as screen sensing function and Wenshengtu, have not been launched.

Let’s introduce them one by one.

First of all, the upgraded Siri has finally become a marquee, and a colorful aperture will appear around the screen during a conversation.

As a detail fanatic, Apple has also designed different Siri appearance animations based on different wake-up methods.

When you wake up Siri with your voice, the animation pops up from the microphone; when you long press the power button to call out Siri, the animation pops up from the power button.


Of course, if you are like Shichao, who is handsome but socially anxious and shy to talk to Siri in public, you can double-click the horizontal bar at the bottom of the screen to enter text and talk to Siri.


I have to say that Siri's animations are really cool. But after testing it, I found that Siri only seems to be cooler, and its IQ has not increased.

For example, it is rumored that Siri has the ability to understand context, but I have not tested it successfully.

I asked Siri to help me find a photo of headphones in the Photos App. I don’t know if it was because I triggered it in the wrong way or what, but it didn’t understand me and instead found a photo of headphones on the Internet.

I asked Siri what the weather was like in Shanghai as I was going there tomorrow, and it answered the weather conditions in Shanghai.

I then asked: Do I need to bring sunscreen?

It turns out it gives me advice based on the weather in Hangzhou (my current location).

It's clear that Siri's second response didn't take into account the context.


Then I asked Siri to help me find the nearest restaurant. After it showed me the restaurant, I asked if it had any recommendations. It then recommended a movie to me.

Siri, you are still the same boy as before, without changing at all~


In addition to Siri simply becoming cooler, the new features of the Photo App are also a bit cool.

You can enter a description in the photo and let Apple's AI create a set of memory videos.

For example, if you write "cat over the years", it will use a very cool animation (a bit like Rockstar) to combine the photos of cats over the years into a memory video.

Video source @TheAppleDesign ▼


However, the above video was seen by Shichao from the Internet.

I haven't tested it myself, and the system reminds me that it is still processing photos. I guess it's because I have had the phone for too short a time, and the newly uploaded photos have not yet been learned. I can only demonstrate it to you next time.


This update also adds an AI writing tool, Writing Tools, which you can use in typing and reading scenarios.

Currently it hasProofreading, rewriting and summarizing are the three major functions.


For example, the sentence “my name is Michael, what is your nome!” contains errors in vocabulary, grammar, and punctuation.

When we click Proofread, it will change to the correct way of writing, understand the tone, and change the exclamation mark to a question mark.


Click rewrite and the union will also rewrite the sentence to put it in another way.

Of course, when dealing with people, you will be weak when facing the strong and crazy when facing the weak. You will say different things in different scenarios. Therefore, in addition to the default style, Apple also has the rewrite function.Friendly, professional, conciseThree options available.

According to current tests, the friendly style is more like a conversation between acquaintances, while the professional style is more suitable for written language used in formal occasions.


Although it does not support the Chinese iPhone now, the AI ​​writing tool actually supports some Chinese, but it is really just a little bit.

For example, when I asked it to rewrite the sentence “I’m free tomorrow, do you want to go out for a nice meal together?” into a concise and professional style, it was written directly in English. . .


It's Chinese until the friendly style, but the last word is kind of funny.


The last thing I want to introduce is the summary function of the writing tool. When reading an article, you can select a paragraph and let it generateBullet points, lists, and even tables.

Sounds okay, right?

Okay, Shichao used the following text for testing, which mainly talked about the data comparison between iOS and Android in the US market share, global market share, user App spending, and App Store revenue.


I asked it to summarize, and it gave me this paragraph.

iOS accounts for 57.93% of the US mobile market, while Android accounts for 70.29% of the global market.


This is not a summary. Didn’t you just read the first two sentences? And the first and second halves of the sentence don’t matter.

What's even more amazing is that I asked it to summarize it in a table format. After calculating for a long time, I thought I was going to use a big move, and then a 2x4 table popped up.

Not only does iOS appear twice, but the data is also wrong. 57.93% and 41.64% are the market shares of iOS and Android in the United States, not the global market...


I sent the same text to Google's Gemini, and it responded like this:

Not only does the table take every point into account and the data is correct, but the summary is also on point.


In addition to writing tools, Apple alsoSafari and MailA little AI summarizing capability has been injected into it.

There is a summary button at the top of each email. When you click it, Apple AI will extract the summary.

Shichao tested it three times.Two emails were summarized incorrectly, and one email could not be summarized.

For example, this email was sent to me by Perplexity (an AI search) to introduce its features. It only mentioned 4 features in total, and only one of them clearly stated that a Pro membership was required, and the free ones were limited in number of times.


But AppleAIAfter summarizing, it directly determined that all 4 were paid features...You are just trying to undermine others.


In addition, when browsing the web in reading mode, there is also an AI summary button at the top.

I found two articles, one about the iOS 18.1 beta update, and the other about Mexican food delivery guys running to deliver express packages.

Not to mention, Apple’s summaries were both good and contained no factual errors.

For example, the article about Mexico clearly explains the background and reasons why people switched to express delivery.


The above is the main content of this update.

Although Apple's AI capabilities can be described as "very weak" after testing, most tests were unsatisfactory.But I think we can wait a little longer.

First of all, we don’t know whether the iPhone’s AI capabilities are local or server-side. If it is local, it is understandable, because local models are much weaker than large server models (most of the ones we have seen are).

This is also AppleAIThe first developer beta version is for developers.Let them work together to test and optimize the system and apps so that consumers can have a better experience when they officially come into contact with AI.

That’s all for today~ Wait for the next update, and Shichao will be the first to give you guys a taste.

Written by:hedgehog

edit: Noodles Jiang Jiang

Art editor: Xuanxuan Huanyan

Image, source:iPhone