07:40AM EDT - Huawei has a keynote at IFA this year. Having quietly announced the Kirin 970 and its new Neural Processing Unit yesterday without a word through the regular press channels, we're expecting to here Huawei's future march into AI from Richard Yu, CEO of Huawei's Consumer Business Group (CBG).

07:40AM EDT - Just me for images and photos today. Today is the first public day of IFA, so there's a lot of foot traffic in the halls. This keynote should be full, if not just with press

07:46AM EDT - We posted our Kirin 970 news yesterday, with the limited details we had

07:46AM EDT - http://www.anandtech.com/show/11804/huawei-shows-unannounced-kirin-970-at-ifa-2017-dedicated-neural-processing-unit

07:46AM EDT - The key new features for the Kirin 970 start with the move to TSMC's 10nm

07:47AM EDT - When Huawei launched the Kirin 960 last year, it was slightly too early for the first wave of 10nm, so they spent another generation of 16FF+ on their flagship. Now arguably 10nm is more mature, and ripe for the picking

07:47AM EDT - Next on the list is the new dedicated neural processing unit (NPU)

07:47AM EDT - this is a dedicated ISP that can provide 1.92 TFLOPs of FP16 performance in neural networks

07:48AM EDT - I'm told it's a sizable chunk of the silicon die. I doubt we'll find out today about that, but it'll be interesting to see a die shot

07:48AM EDT - One of the NPUs troubles will be vendor lock-in. No app developers will take the time to learn how to use it unless it's integrated into regular compute APIs, because if they learn to use it then it'll lock the software to Huawei

07:49AM EDT - Huawei has some 5000 software developers apparently, so there is a goal for their own apps to leverage the NPU

07:49AM EDT - they showed image recognition at a rate of 2000 pictures a minute (33 per second), compared to 97 pictures per minute using just the CPU

07:50AM EDT - On the core specifications, Huawei is keeping 4xA73 and 4xA53 in the design. This is for two reasons

07:51AM EDT - Taking a known core and shrinking the node is easier than taking a new core and putting it on a new node

07:51AM EDT - The other side of the coin is that it's still very early for A75/A55. ARM is expecting these cores to see the light of day next year, probably later than earlier (depending on how adventurous some designers are)

07:51AM EDT - The 970 is however moving from a MaliG71 MP8 to MaliG72 MP12

07:54AM EDT - It will be interesting to see how the G72 power consumption comes out. We saw big power spikes with Huawei's G71 implementation. They should be more in tune with G72 this time around, we hope

07:54AM EDT - The last sticker item for the Kirin 970 (that we know about) is the modem

07:54AM EDT - The integrated LTE is going to be supporting Category 18, good for 1.2 Gbps download

07:55AM EDT - In our piece I said it was likely 4xCA with MU-MIMO and 128-QAM. I think our readers got a better read on the situation, suggesting 256-QAM instead (because 128-QAM doesn't exist as a standard)

07:56AM EDT - We're a few minutes from starting, and the hall is full. People are standing in the wings

07:58AM EDT - I'm sitting in the front row, next to people I believe to be executives from ZTE.

07:59AM EDT - Perhaps I should learn more Chinese. The conversation would be interesting

08:01AM EDT - Still waiting to start. Again, our Kirin 970 piece is worth reading just before we start :) http://www.anandtech.com/show/11804/huawei-shows-unannounced-kirin-970-at-ifa-2017-dedicated-neural-processing-unit

08:05AM EDT - Still waiting. Some people are wandering to the front row expecting a seat

08:06AM EDT - OK here we go

08:06AM EDT - People sitting on the floor ahead of the front row

08:07AM EDT - IFA Exec Director on the stage up first, to announce Richard Yu. But first a little about IFA

08:07AM EDT - ''AI has been talked about for decades, but only now are they ready for consumers'

08:08AM EDT - 'In just a few years we will live in an AI first world, not a smartphone first world'

08:08AM EDT - 'AI requires some serious lifting for computing power'

08:09AM EDT - 'For a thermostat, you can wait a millisecond to compute what is needed in the cloud. In a car, you can't have that latency and the compute needs to be local'

08:09AM EDT - 'Huawei is one company investing in AI technology'

08:09AM EDT - Huawei employs 40k, as much as IFA gets in visitors per day

08:10AM EDT - Announcing Richard Yu

08:10AM EDT - Today I want to show you Huawei's approach to AI with our new AI processor

08:10AM EDT - Innovation is growing so fast

08:11AM EDT - Using a smartphone for more and more, for work and everything

08:11AM EDT - But we need more intelligence

08:11AM EDT - Human beings are always the source of intelligence

08:12AM EDT - Individual Intelligence'

08:12AM EDT - 'Collective Intelligence'

08:12AM EDT - >He just quoted F1. Do Huawei sponsor someone in F1?

08:14AM EDT - Individual Intelligence from the device, and collective intelligence from the cloud

08:14AM EDT - Individual Intelligence from the device, and collective intelligence from the cloud

08:14AM EDT - Today focusing more about on-device AI

08:15AM EDT - 4 challenges: Perception, Cognition, Security and Power

08:15AM EDT - Perception on a smartphone is the camera and the microphone

08:15AM EDT - Having more angles to learn is important for AI, and you need the processing power

08:16AM EDT - e.g. one microphone going to two, to an array with audio processing as one input to the AI. Need to identify the important information

08:16AM EDT - Can a smartphone detect a Human Being's emotion?

08:16AM EDT - Stage 2: Cognition

08:16AM EDT - This can be complex for a smartphone beyond simple data entry

08:17AM EDT - Recognising the scene and the behaviour

08:17AM EDT - 3: Security

08:17AM EDT - On device processing gives more privacy protection (when done right)

08:17AM EDT - AI can assist with on-device security

08:18AM EDT - Stage 4: Power

08:18AM EDT - Needs high performance and high efficiency

08:19AM EDT - We need a TPU in the a power consumption for a smartphone and a limited battery. 16 GFLOPs at 0.4 mA

08:19AM EDT - When a smartphone is detecting an object, it needs a lot of power

08:20AM EDT - Huawei wants to invest in high performance on-device AI for the best intelligent experience

08:20AM EDT - 'Our Solution'

08:20AM EDT - Kirin 970

08:21AM EDT - Image DSP with 512-bit SIMD, 32bit/384k HiFi Audio, i7 sensor processoer

08:21AM EDT - 5.5 billion transistors

08:22AM EDT - '4.5G' LTE Modem

08:22AM EDT - Dual ISP

08:22AM EDT - 'Dual 4.5G LTE' technology ?

08:22AM EDT - First company to have a dedicated AI processor inside

08:22AM EDT - NPU follows the ISP, DSP, coprocessor as the next element needed in smartphone chips

08:23AM EDT - Using TSMC10nm - 10 years ago was using 180nm

08:23AM EDT - Cat 18 LTE, 1.2 Gbps

08:23AM EDT - '4.5G' again

08:24AM EDT - 20% power consumption reduction over Kirin 960

08:24AM EDT - no wait, that's just 10nm

08:25AM EDT - Perf of NPU = 25x CPU. Efficiency of NPU = 50x CPU

08:25AM EDT - 'All benchmark data is based on internal testing'

08:25AM EDT - NPU can do image processing in realtime

08:25AM EDT - High performance density = 25x performance in half the CPU size

08:26AM EDT - (So NPU is the size of four CPU cores?)

08:26AM EDT - 0.3W for image recognition. 1000 images took 0.19% of a 4000 mAh battery

08:27AM EDT - 2005 images per minute using CPU+GPU+TPU, comapred to Samsung S8 CPU which does 95 per minute

08:27AM EDT - That's only using the S8 CPUs

08:27AM EDT - Video demo showing 200 image recognition done in 6s on NPU

08:28AM EDT - CPU took 120 seconds, so 20x perf

08:28AM EDT - Open AI Ecosystem: support for Tensorflow / Tensorflow Lite, Caffe/Caffe2

08:28AM EDT - Uses Kirin AI API and Android NN

08:29AM EDT - If it uses an Android standard, that might make it used by other apps

08:29AM EDT - > rather than just Huawei's apps

08:29AM EDT - 'Open architecture'

08:30AM EDT - Use AI for: Task Scheduling, load balancing, memory allocation, real-time painting, ui rendering, graphics processing, camera image processing

08:30AM EDT - (so the next smartphone will have a big new camera feature I imagine)

08:30AM EDT - Real time computer vision, low power AR, language translation

08:31AM EDT - Developer website support and website, also development kits and dev boards with toolchains and app markets

08:32AM EDT - The CPU efficiency for the cores are 20% more efficiency

08:32AM EDT - Mali G72 perf up 20%, efficiency up 50%, even moving MP8 to MP12

08:32AM EDT - Now talking blurry photos

08:33AM EDT - out of focus, fast moving

08:33AM EDT - Solve issues with ISP

08:33AM EDT - Throughput up 25%, response time up 15%, support for 3 cameras or more, enhanced noise reduction

08:34AM EDT - With AI processor, we can understand the world through photos

08:35AM EDT - Adjust auto-settings based on the scene and the image recognition (e.g. flower, cat, building)

08:35AM EDT - helps take the best photo automatically

08:36AM EDT - Bands supported: B 1 2 3 4 5 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 and others

08:36AM EDT - 4x4 MIMO, 5x CA (3x FDD, 2xTDD), and 256QAM

08:37AM EDT - World's first 1.2 Gbps Cat 18

08:37AM EDT - 4x4 MIMO + 256QAM + 3CC CA

08:37AM EDT - 'Qualcomm's latest is 835 is only Cat 16, but we support 18'

08:37AM EDT - >But Qualcomm is shipping today, Huawei is not

08:38AM EDT - Dual 4G network connection supported, both working simultaneously. Both support VoLTE

08:39AM EDT - 'Challenge on high speed railway: speed and conditions'

08:39AM EDT - With high speed motion, it's a challenge to provide a fast speed and problems with signal

08:39AM EDT - Weak signals are not always great, but Huawei can improve it

08:39AM EDT - over 400,000km Hi-Speed railway field test

08:40AM EDT - So, 2000 hrs?

08:40AM EDT - Tested on China high-speed railway, German ICE and Japan Shinkansen

08:40AM EDT - 'more stable connection and fewer calls dropped - better cell handover'

08:41AM EDT - 'Most powerful and most efficient SoC, most complete AI solution'

08:42AM EDT - 'World's First Smartphone AI Computing Platform with a Dedicated NPU'

08:42AM EDT - Video time

08:44AM EDT - Coming with the Mate 10, launching in Munich on 16th October. Mate 10 and Mate 10 Pro. Huawei's first full display smartphone

08:44AM EDT - I think that image is meant to be bezels

08:44AM EDT - That's a wrap, I'll upload that final video and add it in when it gets through the rest of the uploads in the room.

Comments Locked


View All Comments

  • jjj - Saturday, September 2, 2017 - link

    Wish they would use machine learning to adjust the camera settings. Users are terrible at that.
    Ofc , you can do lots of other things but adjusting camera settings is of high value and can't recall anyone doing it yet.
  • jjj - Saturday, September 2, 2017 - link

    Look at that, they are doing this, good job.
  • Slaveguy - Saturday, September 2, 2017 - link

    Do you need a tissue or did you use all of them up joikin' awff to this garbage
  • jjj - Saturday, September 2, 2017 - link

    I do need one when i see that someone like you is part of the human race.
    It's the saddest thing i can imagine.
  • jjj - Saturday, September 2, 2017 - link

    Would be great if you can ask about packaging and if they do something there, likely not given the low CPU clocks.
  • jjj - Saturday, September 2, 2017 - link

    In the pics the top is for a 366-ball DRAM package.
  • jjj - Saturday, September 2, 2017 - link

    "The CPU efficiency for the cores are 20% more efficiency"

    The perf per W comparison is less favorable vs Kirin 95X, way too little progress in 2 years.
  • jjj - Saturday, September 2, 2017 - link

    "But Qualcomm is shipping today, Huawei is not"

    The Mate 10 launch is scheduled for mid October so TSMC should be shipping it in volume already.
  • name99 - Saturday, September 2, 2017 - link

    Well, if that's the metric that iPhone A11 (presumably with its own NPU, and who knows what modem) is ALSO shipping in volume already...
  • jjj - Saturday, September 2, 2017 - link

    That bit was about the modem not the NPU.

Log in

Don't have an account? Sign up now