Journal-first submissions deadline
8 Aug
Priority submissions deadline 30 Jul
Final abstract submissions deadline 15 Oct
Manuscripts due for FastTrack publication
30 Nov

Early registration ends 31 Dec

Short Courses
11-14 Jan
Symposium begins
17 Jan
All proceedings manuscripts due
31 Jan

No content found

Imaging and Multimedia Analytics at the Edge 2022

  • Below is the the program in San Francisco time.
  • Talks are to be presented live during the times noted and will be recorded. The recordings may be viewed at your convenience, as often as you like, until 15 May 2022.

Monday 17 January 2022

IS&T Welcome & PLENARY: Quanta Image Sensors: Counting Photons Is the New Game in Town

07:00 – 08:10

The Quanta Image Sensor (QIS) was conceived as a different image sensor—one that counts photoelectrons one at a time using millions or billions of specialized pixels read out at high frame rate with computation imaging used to create gray scale images. QIS devices have been implemented in a CMOS image sensor (CIS) baseline room-temperature technology without using avalanche multiplication, and also with SPAD arrays. This plenary details the QIS concept, how it has been implemented in CIS and in SPADs, and what the major differences are. Applications that can be disrupted or enabled by this technology are also discussed, including smartphone, where CIS-QIS technology could even be employed in just a few years.

Eric R. Fossum, Dartmouth College (United States)

Eric R. Fossum is best known for the invention of the CMOS image sensor “camera-on-a-chip” used in billions of cameras. He is a solid-state image sensor device physicist and engineer, and his career has included academic and government research, and entrepreneurial leadership. At Dartmouth he is a professor of engineering and vice provost for entrepreneurship and technology transfer. Fossum received the 2017 Queen Elizabeth Prize from HRH Prince Charles, considered by many as the Nobel Prize of Engineering “for the creation of digital imaging sensors,” along with three others. He was inducted into the National Inventors Hall of Fame, and elected to the National Academy of Engineering among other honors including a recent Emmy Award. He has published more than 300 technical papers and holds more than 175 US patents. He co-founded several startups and co-founded the International Image Sensor Society (IISS), serving as its first president. He is a Fellow of IEEE and OSA.

08:10 – 08:40 EI 2022 Welcome Reception

Wednesday 19 January 2022

IS&T Awards & PLENARY: In situ Mobility for Planetary Exploration: Progress and Challenges

07:00 – 08:15

This year saw exciting milestones in planetary exploration with the successful landing of the Perseverance Mars rover, followed by its operation and the successful technology demonstration of the Ingenuity helicopter, the first heavier-than-air aircraft ever to fly on another planetary body. This plenary highlights new technologies used in this mission, including precision landing for Perseverance, a vision coprocessor, new algorithms for faster rover traverse, and the ingredients of the helicopter. It concludes with a survey of challenges for future planetary mobility systems, particularly for Mars, Earth’s moon, and Saturn’s moon, Titan.

Larry Matthies, Jet Propulsion Laboratory (United States)

Larry Matthies received his PhD in computer science from Carnegie Mellon University (1989), before joining JPL, where he has supervised the Computer Vision Group for 21 years, the past two coordinating internal technology investments in the Mars office. His research interests include 3-D perception, state estimation, terrain classification, and dynamic scene analysis for autonomous navigation of unmanned vehicles on Earth and in space. He has been a principal investigator in many programs involving robot vision and has initiated new technology developments that impacted every US Mars surface mission since 1997, including visual navigation algorithms for rovers, map matching algorithms for precision landers, and autonomous navigation hardware and software architectures for rotorcraft. He is a Fellow of the IEEE and was a joint winner in 2008 of the IEEE’s Robotics and Automation Award for his contributions to robotic space exploration.

EI 2022 Interactive Poster Session

08:20 – 09:20
EI Symposium

Poster interactive session for all conferences authors and attendees.

Virtual Reality

Session Chairs: Jan Allebach, Purdue University (United States); Raja Bala, Amazon (United States); and Qian Lin, HP Labs, HP Inc. (United States)
16:15 – 17:15
Red Room

Cognitive load inference within a multitasking paradigm in virtual reality (Invited), Jishang Wei, HP Labs (United States) [view abstract]


VR facial expression tracking via action unit intensity regression model, Xiaoyu Ji1, Jishang Wei2, Yvonne Huang3, Qian Lin3, Jan P. Allebach1, and Fengqing Zhu1; 1Purdue University, 2HP Labs, and 3HP Inc. (United States) [view abstract]


Thursday 20 January 2022

KEYNOTE: Photography

Session Chairs: Jan Allebach, Purdue University (United States); Raja Bala, Amazon (United States); and Qian Lin, HP Labs, HP Inc. (United States)
07:00 – 08:05
Red Room

KEYNOTE: Analogue – Digital – Mobile – Social: How photography has changed in the last 25 years, Reiner Fageth, CEWE Stiftung & Co. KGAA (Germany)

This paper will describe how digital photography has evolved from being a niche product for digital experts and IT freaks, to total domination of the mass-market and the disruption of analogue photography. This rapid, industry-altering process will be put into relationship to conferences and presentations given at Electronic Imaging in the last three decades. Developments and influence on quality were driven by imaging sensors and printing technologies. A review of the battle for attainting the high quality of silver-halide prints from negatives will be presented. The development of image enhancement technologies and printing technologies will be analyzed. The classical one-hour in-store photo order process in North America and Asia based on mini labs, and the logistics systems in Europe (collecting the film from the points of sale in the evening and returning the prints, processed by huge photofinishing plants, the next day) were substituted by digital kiosk systems in stores, and software applications in the browser or downloadable software. The development of the technologies involved will also be presented, as well as the efforts in supporting the selection process of the most suitable images. New digital printers based on liquid ink and toner offered new products, personalized photobooks and calendars allowed for story-telling and emotionalized gifting via tangible photo products and raised the value of every printed image. A review will be provided of the improvements there, as well as classical silver-halide based printing systems. The introduction of smartphones disrupted the new digital imaging ecosystems once more. The camera was now a constant companion in nearly everybody’s pocket. The resulting increase in the number of images taken complicated the selection process (convenience photos, images “only” for social communication, ...) and the image quality discussion was once more raised and addressed in these conference. All of these challenges are addressed by actual imaging eco-systems. They include ordering possibilities over all devices (classical digital cameras and smartphones) and retail locations, as well as providing home delivery options. Selling these products became more of a marketing than a technological challenge. These systems utilize AI based solutions (on device and utilizing edge computing) combined with experience/heuristics gathered in the last 25 years. Some very good approaches will be presented at the end.

Reiner Fageth occupies the position of Head-Technology, Research & Development at CEWE Stiftung & Co. KGaA and Chairman-Supervisory Board of CEWE Color as (a subsidiary of CEWE Stiftung & Co. KGaA). Dr. Fageth is also on the board of CeWe Color, Inc. and Member-Management Board at Neumüller CEWE COLOR Stiftung. Reiner Fageth studied electronic engineering at the Fachhochschule Heilbronn, Germany. He received a PhD from the University of Northumbria at Newcastle, UK in split research with Telefunken Microelectronic and the Steinbeis Transferzentrum Image Processing in 1994. The major research topics there and also for the following years were industrial image processing systems based on classification using fuzzy logic and neural networks. In 1998 he joined CeWe Color with the charge to drive the analogue photo business into digital. First he was responsible for R&D and the production of consumers digital files on silver halide paper. CeWe Color is Europe largest wholesale photofinisher producing more than 3 billion prints a year. He is a member of the German DIN Normenausschuss Bild und Film NA 049-00-04 AA and has published over 30 technical papers.

Efficient real-time portrait video segmentation with temporal guidance, Weichen Xu1, Yezhi Shen1, Qian Lin2, Jan P. Allebach1, and Fengqing Zhu1; 1Purdue University (United States) and 2HP Inc. (United States) [view abstract]


Machine / Deep Learning

Session Chairs: Jan Allebach, Purdue University (United States); Raja Bala, Amazon (United States); and Qian Lin, HP Labs, HP Inc. (United States)
08:30 – 09:30
Red Room

Generating high-resolution atmospheric gas concentration imagery with multiple remote sensing data using a geography-informed machine learning approach (Invited), Kalai Ramea, Palo Alto Research Center (United States) [view abstract]


Cultural assets identification using transfer learning, Huajian Liu, Simon Bugert, Waldemar Berchtold, and Martin Steinebach, Fraunhofer Institute for Secure Information Technology (Germany) [view abstract]


Image / Video Analysis

Session Chairs: Jan Allebach, Purdue University (United States); Raja Bala, Amazon (United States); and Qian Lin, HP Labs, HP Inc. (United States)
10:00 – 11:00
Red Room

Correspondences for image and video reconstruction (Invited), Xiaoyu Xiang, Facebook Inc. (United States) [view abstract]


Towards the creation of a nutrition and food group based image database, Zeman Shao, Jiangpeng He, Ya-Yuan Yu, Luotao Lin, Alexandra E. Cowan, Heather A. Eicher-Miller, and Fengqing Zhu, Purdue University (United States) [view abstract]



Session Chairs: Jan Allebach, Purdue University (United States); Raja Bala, Amazon (United States); and Qian Lin, HP Labs, HP Inc. (United States)
15:00 – 16:00
Red Room

Automatic facial skin feature detection for everyone, Qian Zheng1, Ankur Purwar2, Heng Zhao1, Guang Liang Lim1, Ling Li1, Debasish Behera2, Qian Wang1, Min Tan1, Rizhao Cai1, Jennifer Werner2, Dennis Sng1, Maurice van Steensel1, Weisi Lin1, and Alex C. Kot1; 1Nanyang Technological University and 2Procter & Gamble (Singapore) [view abstract]


Mix-loss trained bias-removed blind image denoising network, Yi Yang1, Chih-Hsien Chou2, and Jan P. Allebach1; 1Purdue University and 2Futurewei Technologies, Inc (United States) [view abstract]


Billion-scale pretrained unified visual embedding and its applications in Pinterest, Josh Beal1, Rex Wu1, Seth Park1,2, Kofi Boakye1, Bin Shen1, Andrew Zhai1, and Chuck Rosenberg1; 1Pinterest and 2University of California, Berkeley (United States) [view abstract]


No content found

No content found

No content found

No content found

No content found