ESP32-CAM as a programmable camera research platform

Henry Dietz, Dillon Abney, Paul Eberhart, Nick Santini, William Davis, Elisabeth Wilson, Michael McKenzie

Research output: Contribution to journalConference articlepeer-review

4 Scopus citations

Abstract

Experimenting with custom-programming of cameras can be difficult. Most consumer cameras are protected to prevent users from reprogramming them. Industrial cameras can be flexibly controlled by an external computer, but are generally not standalone programmable devices. However, various inexpensive camera modules, designed largely to be used for building IoT (Internet of Things) devices, combine extensive programmability with a camera in a compact, low-power, module. One of the smallest and least expensive, the ESP32-CAM module, combines a 2MP Omnivision OV2640 camera with a dual-core 32-bit processor, 802.11 WiFi and BlueTooth as well as wired I/O interfaces, a microSD slot, low power modes, etc., all supported by the Arduino programming environment and a rich collection of open source libraries. Why not use it for programmable camera research? This paper describes how the ESP32-CAM had to be adapted to enable use in a variety of experimental cameras. For example, some of these cameras do not use the lens screwed and glued onto the OV2640, and replacing this lens revealed a number of issues ranging from spectral response to adjustment of lens corrections. There are numerous strange interactions between different functions that end-up sharing the same I/O pins, so work-arounds were needed. It also was necessary to devise ways to handle various higher-level issues such as implementation of a live view and synchronization across cameras. However, the key problems have been resolved with open source software and hardware designs described here.

Original languageEnglish
Article number232
JournalIS and T International Symposium on Electronic Imaging Science and Technology
Volume34
Issue number7
DOIs
StatePublished - 2022
EventIS and T International Symposium on Electronic Imaging: Imaging Sensors and Systems, ISS 2022 - Virtual, Online
Duration: Jan 17 2022Jan 26 2022

Bibliographical note

Publisher Copyright:
© 2022 Society for Imaging Science and Technology. All rights reserved.

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Human-Computer Interaction
  • Software
  • Electrical and Electronic Engineering
  • Atomic and Molecular Physics, and Optics

Fingerprint

Dive into the research topics of 'ESP32-CAM as a programmable camera research platform'. Together they form a unique fingerprint.

Cite this