Sunday, March 29, 2020

Huawei Smartphone Claimed to Measure Human Body Temperature with Si-based Cameras

cnTechPost quotes Huawei Consumer Business CEO Richard Yu on-line interview:

"When asked if the P40 series has some functional design in terms of hygiene, Yu mentioned that the P40 Pro+ can detect human body temperature very accurately through a rear camera with a unique algorithm.

Yu added that its global sales team initially stated that such a feature was not needed, but the Chinese team insisted. Of course, Yu pointed out that Huawei cares about user privacy, and related functions require consumer authorization to turn on.

According to Yu's outlook, with AI training and sensor cooperation, Huawei products will have a bigger stage in the future. He also previewed an app that can detect data such as breathing rate, pressure value, heart rate, etc., which is currently ready and will be the first to be launched for Chinese users.
"

10 comments:

  1. How is this possible ?

    ReplyDelete
  2. Will I have to put my phone under my armpit to measure it? There aren't many other body parts that give a reliable answer. And I certainly wouldn't want to put my phone there... So, what's the plan?

    ReplyDelete
    Replies
    1. Do you mean they just use a temperature sensor embedded on one of their image sensor chips? Then, your approach could work, even though you don't like it

      Delete
    2. We've been told that smartwatches will never give a body temperature estimation because the wrist wouldn't give a reliable answer, so I was just wondering on how this technique IF implemented on a phone would work.

      Delete
  3. AI is different. No one knows what is in the automatically collected data sets. In fact, generally, they are not understandable to humans. You show the phone a few thousand people with different body temperatures. If the algorithm can see differences it can quantify, then it uses those to calibrate itself. Then you show it a bunch of people it has not seen before and see if it detects their body temperatures correctly. If it does, you have a product.

    A radiologist once told me that the way you train radiologists is to show them 50,000 radiographs with known indications. Then, when they see new ones, they know what the indications are without having to think about it. This is the same process.

    ReplyDelete
    Replies
    1. yes, theorically, but x-ray shows clearly things, but where have you seen that visible wavelength shows correlation with human temperature?

      Delete
    2. X-rays seem to clearly show things to untrained eyes after they have been pointed out by experts. AI does not require experts, it is the expert. I have no idea what the AI algorithm finds correlated with temperature, maybe no one does. This kind of work can be done completely blind. The only issue is - did the AI training system find enough correlation between the image data and patient temperature to allow the camera to be used as an instrument.

      Delete
    3. I think you are forgetting that there is a ToF sensor there, which operates with active illumination in the IR region and can be used as an IR 2D camera too. So why would you assume the temperature estimations are done in the visible light region? Seems plausible to me that it would be possible to train a network to work on the IR data to determine the temperature.

      Delete
  4. Using IR region, it is very interesting. But as you know, ToF can support IR image, depth image and point cloud. So IR image is calclulated with raw data from ToF sensor. It is not a real IR. So I need how to calculate a body temperature with ToF and RGB camera? Well, please let me know your good advice for me. VERY THANKS!!!!

    ReplyDelete

All comments are moderated to avoid spam and personal attacks.