KoreaTimes: Samsung is facing the U.S. International Trade Commission's (USITC) investigation for allegedly infringing on image sensor patents held by Pictos Technologies. This is a fairly long story publicly presented in 2018 by Gil Amelio.
It's not clear what is the relation between the new Pictos and the old image sensor company under the same name that started as Rockwell spin-off and later acquired by ESS. Bloomberg reports that the new Pictos has been formerly known as Imperium IP.
IFNews quotes UBS and Fomalhaut teardown analysis estimating 3D cameras in iPhone 12 Pro and Pro Max cost at 67% and 54% of the cost of 2D cameras, respectively:
UBS poll reveals that smartphone camera spec is rated #12 among the most desirable features. Other image sensor-based features like dual camera, on-display fingerprint, Face ID, and AR/VR functionality are all rated much lower than that:
Sony publishes an article on its image sensor interface Scalable Low-Voltage Signaling with Embedded Clock, abbreviated SLVS-EC. SLVS-EC is standardized by the Japan Industrial Imaging Association (JIIA). It looks similar to MIPI M-PHY, but has a slower speed of up to 5Gbps per lane.
Sony releases a new 5um BSI ToF sensor - 5um pixel-based IMX570. The new VGA sensor is sampling now with mass production start planned for March 2021.
IPNewsShots reports that Sony has bought hundreds of Intel patents to protect its image sensor business. Earlier, Sony also has quietly acquired IBM semiconductor patents.
Chronoptics CTO Refael Whyte publishes an overview of approaches to "Phase Wrapping and its Solution for Indirect Time-of-Flight Depth Sensing" with very nice animations:
Institute of Technology Sligo and Waterford Institute of Technology, Irland, publishe a paper "Characterisation of CMOS Image Sensor Performance in Low Light Automotive Applications" by Shane Gilroy, John O'Dwyer, and Lucas Bortoleto.
Smartsens has held a Partnership Meeting 2020 (SPM 2020) updating about the company's business and future plans. Smartsens CEO Xu Chen says:
"2020 is an unusual year, but under the influence of the complex international situation and the global epidemic, the overall CIS industry still maintains a growth rate of 20% (data source: Yole)
Dr. Xu Chen pointed out that although next year’s forecasted growth rate has slowed down, Smartsens' overall sales situation still maintains a high-speed growth, and has doubled sales this year, with shipments reaching 220 million units. It is expected that the target set at the beginning of the year will be exceeded, and the sales target of Smartsens will double again next year.
In addition to the repeated increase in sales, Smartsens product line and application areas are also rapidly expanding. The number of Tapeout products has doubled from 13 in 2019 to 26 in 2020, and strives to empower more with excellent CIS imaging technology.
Smartsens' consumer-grade Global Shutter image sensor market, which was laid out in 2017, also achieved good results this year, ranking first in the world in terms of shipments in the consumer-grade machine vision field . And this year's acquisition of Allchip (Shenzhen Anxin Micro) also enabled Smartsens to quickly enter the automotive electronics application field . In addition, just before the SPM 2020 conference, Smartsens released a full range of 2MP-13MP Cellphone Sensor (CS) series of mobile phone application products , officially entering the mobile phone market.
Mr. Chen Xu, Deputy Director of TSMC, gave a speech introducing TSMC’s current latest process R&D and production capacity planning, and said that TSMC will spare no effort to cooperate with Smartsens' growth and development, and also strongly support Smartsens production capacity manufacturing. In the future, TSMC will also work with Smartsens to help China's semiconductor industry chain achieve global cutting-edge quality and maintain a state of sustainable development.
Samsung Semiconductor Executive (Vice President) Mr. Minghui Zhu said in his speech that the cooperation between Samsung and Smartsens is very harmonious and happy, and highly summarized and appreciated the development of Smartsens in recent years with three characteristics. The first is "speed". , I am deeply impressed by Smartsens’s high efficiency; the second is "high and big ", which greatly appreciates its technological innovation ability, and the third is "strategic vision . In the future, Samsung will continue to make efforts to support Smartsens' strategic development and look forward to more future results of joint development with Smartsens.
Next year, Smartsens will celebrate its 10th birthday. On this conference, Dr. Xu Chen announced the three major events of Smarsens' 10th anniversary to the guests. These include the spacious and bright brand-new Smartsens office building that is under design and renovation and will be settled in April next year ; and the new Kunshan test center with a capacity plan of 100kk/month and an area of 20 acres that will be completed next year; However, after completing the 1.5 billion pre-ipo round of financing this year, Smartsens will submit a listing application and start the listing plan!"
SemiconductorForYou publishes an interview with Philipp von Schierstaedt, SVP RF & Sensors at Infineon. Few quotes:
"We see a development towards 3D ToF image sensors as a standard for high-end smartphones on the front camera – flagship phones are already proving this – and on the rear camera. The fastest growing will surely be the rear camera with above 500 million units/y over the next years. The deployment of 3D sensing technologies will follow this growth as they solve the challenges that new applications set to the rear camera and that traditional 2D technologies fail to accomplish: a real 3D depth map.
Still, challenges exist, for example current commercial devices deploying existing 3D image sensing solutions are not yet able to provide a reasonable resolution without significant trade-offs on extended distance ranges and on the power consumption.
Such shortcomings are now being addressed by the latest 3D ToF imager generations in the REAL3 portfolio of Infineon. Therefore we’re convinced that we will see our new 3D sensor either enabling new classes of applications or taking existing applications to a new level of quality and user experience."
Draper reports that its Single Photon Detector (SPD) patent has been awarded by by the Boston Patent Law Association at its 10th Annual Invented Here! event.
Draper’s SPD is intended to be configured in an array of multiple SPDs capable of detecting a single photon with high timing resolution, speed and efficiency over an unparalleled wavelength range, from visible to infrared.
Draper’s SPD uses a silicon-germanium photodiode, which enables detection of the longer wavelengths of light and performance similar to a conventional silicon SPD. It can also function at room temperature. The performance of the new detector is intended to enable ultralow dark-counting rate and timing resolution of better than one nanosecond.
Steven Spector, principal member of Draper’s technical staff, developed the technology with a team at Draper. He said, “Draper’s SPD is so fast and efficient that it can absorb and detect a single particle of light and reset itself for the next one within a nanosecond.”
The patent US10636918 "Single electron transistor triggered by photovoltaic diode" presents the idea using a single electron bipolar avalanche transistor (SEBAT) circuit:
"Embodiments of the present invention are directed to a single photon detection circuit that includes a germanium photodiode configured with zero voltage bias to avoid dark current output when no photon input is present and also configured to respond to a single photon input by generating a photovoltaic output voltage and current. A single electron bipolar avalanche transistor (SEBAT) has a base emitter junction connected in parallel with the germanium photodiode and is configured so that the photovoltaic output voltage triggers an avalanche collector current output.
The SEBAT may be formed of silicon material. The germanium photodiode may be formed using germanium material used as deposited plus any dopings and anneals needed to turn it into a photodiode.
Unlike SPADs, which are triggered by single photons, SEBATs are triggered by single electrons. For single electron detection operation, the collector voltage Vcc is set to a high voltage above the breakdown of the collector-base junction. If a negative voltage is applied to the emitter E, the base-emitter junction is forward biased and an emitter current IE appears."
Nature paper "Curved neuromorphic image sensor array using a MoS2-organic heterostructure inspired by the human visual recognition system" by Changsoon Choi, Juyoung Leem, Min Sung Kim, Amir Taqieddin, Chullhee Cho, Kyoung Won Cho, Gil Ju Lee, Hyojin Seung, Hyung Jong Bae, Young Min Song, Taeghwan Hyeon, Narayana R. Aluru, SungWoo Nam, & Dae-Hyeong Kim (Seoul Institute for Basic Science (IBS), Seoul National University, Gwangju Institute of Science and Technology, and University of Illinois at Urbana-Champaign) sets off a lot of Google News Alerts for me: neuromorphic, organic, curved, heterojunction.
"Conventional imaging and recognition systems require an extensive amount of data storage, pre-processing, and chip-to-chip communications as well as aberration-proof light focusing with multiple lenses for recognizing an object from massive optical inputs. This is because separate chips (i.e., flat image sensor array, memory device, and CPU) in conjunction with complicated optics should capture, store, and process massive image information independently. In contrast, human vision employs a highly efficient imaging and recognition process. Here, inspired by the human visual recognition system, we present a novel imaging device for efficient image acquisition and data pre-processing by conferring the neuromorphic data processing function on a curved image sensor array. The curved neuromorphic image sensor array is based on a heterostructure of MoS2 and poly(1,3,5-trimethyl-1,3,5-trivinyl cyclotrisiloxane). The curved neuromorphic image sensor array features photon-triggered synaptic plasticity owing to its quasi-linear time-dependent photocurrent generation and prolonged photocurrent decay, originated from charge trapping in the MoS2-organic vertical stack. The curved neuromorphic image sensor array integrated with a plano-convex lens derives a pre-processed image from a set of noisy optical inputs without redundant data storage, processing, and communications as well as without complex optics. The proposed imaging device can substantially improve efficiency of the image acquisition and recognition process, a step forward to the next generation machine vision."
Sony publishes 4 promotional videos about its image sensors: SWIR, polarization sensing, and ToF:
BusinessWire, Forbes: Luminar has struck a deal with Mobileye, an Intel company, to supply Luminar lidar for the company’s Autonomous Vehicle (AV) Series solution in its next phase of driverless car development and testing.
As part of the agreement, Mobileye will collaborate with Luminar to use its lidar for the first generation of its level 4 Mobility-as-a-Service (MaaS) pilot and driverless fleet in key markets around the world, including Tel Aviv, Israel; Dubai, UAE; Paris, France; and Daegu City, South Korea.
Financial terms of the deal aren’t being disclosed. They don’t include Mobileye taking an equity stake in Luminar.
“The camera gets you the first 99%” of visual data for self-driving vehicles, says Austin Russell, Luminar CEO. “Lidar gets you that last 1%.”
Voyant Photonics responds to Elon Mask statement "you need to focus on vision because the entire road system is based on passive optical.
So you have to sell passive optical to have a self-driving system that is generally a solution. And once you solve passive optical, you’ve solved self-driving. So, why bother with anything else?"
National University of Singapore presents a paper "Spying with your robot vacuum cleaner: eavesdropping via lidar sensors" by Sriram Sami, Yimin Dai, Sean Rui Xiang Tan, Nirupam Roy, and Jun Han.
"This paper presents LidarPhone, a novel acoustic side-channel attack through the lidar sensors equipped in popular commodity robot vacuum cleaners. The core idea is to repurpose the lidar to a laser-based microphone that can sense sounds from subtle vibrations induced on nearby objects. LidarPhone carefully processes and extracts traces of sound signals from inherently noisy laser reflections to capture privacy sensitive information (such as speech emitted by a victim's computer speaker as the victim is engaged in a teleconferencing meeting; or known music clips from television shows emitted by a victim's TV set, potentially leaking the victim's political orientation or viewing preferences). We implement LidarPhone on a Xiaomi Roborock vacuum cleaning robot and evaluate the feasibility of the attack through comprehensive real-world experiments. We use the prototype to collect both spoken digits and music played by a computer speaker and a TV soundbar, of more than 30k utterances totaling over 19 hours of recorded audio. LidarPhone achieves approximately 91% and 90% average accuracies of digit and music classifications, respectively."
SystemPlus publishes a reverse engineering report "3D Time-of-Flight Module in Meizu 17 Pro."
