Stimulus- and goal-oriented frameworks for understanding natural vision

Maxwell H. Turner; Luis Gonzalo Sanchez Giraldo; Odelia Schwartz; Fred Rieke

doi:10.1038/s41593-018-0284-0

Stimulus- and goal-oriented frameworks for understanding natural vision

Maxwell H. Turner, Luis Gonzalo Sanchez Giraldo, Odelia Schwartz, Fred Rieke

Electrical and Computer Engineering

Research output: Contribution to journal › Review article › peer-review

22 Scopus citations

Abstract

Our knowledge of sensory processing has advanced dramatically in the last few decades, but this understanding remains far from complete, especially for stimuli with the large dynamic range and strong temporal and spatial correlations characteristic of natural visual inputs. Here we describe some of the issues that make understanding the encoding of natural images a challenge. We highlight two broad strategies for approaching this problem: a stimulus-oriented framework and a goal-oriented one. Different contexts can call for one framework or the other. Looking forward, recent advances, particularly those based in machine learning, show promise in borrowing key strengths of both frameworks and by doing so illuminating a path to a more comprehensive understanding of the encoding of natural stimuli.

Original language	English
Pages (from-to)	15-24
Number of pages	10
Journal	Nature Neuroscience
Volume	22
Issue number	1
DOIs	https://doi.org/10.1038/s41593-018-0284-0
State	Published - Jan 1 2019

Bibliographical note

Funding Information:
We thank H. Krapp, D. Pospisil, and J. Shlens for helpful feedback on an earlier version of this review. H. Krapp very generously provided the data and schematic shown in Fig. 4a,b. This work was supported by NIH grants F31-EY026288 (to M.H.T.), EY028542 (to F.R.), and a National Science Foundation Grant 1715475 (to O.S.).

Publisher Copyright:
© 2018, Springer Nature America, Inc.

ASJC Scopus subject areas

Neuroscience (all)

Access to Document

10.1038/s41593-018-0284-0

Cite this

@article{20760fb937694c6d8ef45318fd7341dc,

title = "Stimulus- and goal-oriented frameworks for understanding natural vision",

abstract = "Our knowledge of sensory processing has advanced dramatically in the last few decades, but this understanding remains far from complete, especially for stimuli with the large dynamic range and strong temporal and spatial correlations characteristic of natural visual inputs. Here we describe some of the issues that make understanding the encoding of natural images a challenge. We highlight two broad strategies for approaching this problem: a stimulus-oriented framework and a goal-oriented one. Different contexts can call for one framework or the other. Looking forward, recent advances, particularly those based in machine learning, show promise in borrowing key strengths of both frameworks and by doing so illuminating a path to a more comprehensive understanding of the encoding of natural stimuli.",

author = "Turner, {Maxwell H.} and {Sanchez Giraldo}, {Luis Gonzalo} and Odelia Schwartz and Fred Rieke",

note = "Funding Information: We thank H. Krapp, D. Pospisil, and J. Shlens for helpful feedback on an earlier version of this review. H. Krapp very generously provided the data and schematic shown in Fig. 4a,b. This work was supported by NIH grants F31-EY026288 (to M.H.T.), EY028542 (to F.R.), and a National Science Foundation Grant 1715475 (to O.S.). Publisher Copyright: {\textcopyright} 2018, Springer Nature America, Inc.",

year = "2019",

month = jan,

day = "1",

doi = "10.1038/s41593-018-0284-0",

language = "English",

volume = "22",

pages = "15--24",

number = "1",

}

TY - JOUR

T1 - Stimulus- and goal-oriented frameworks for understanding natural vision

AU - Turner, Maxwell H.

AU - Sanchez Giraldo, Luis Gonzalo

AU - Schwartz, Odelia

AU - Rieke, Fred

N1 - Funding Information: We thank H. Krapp, D. Pospisil, and J. Shlens for helpful feedback on an earlier version of this review. H. Krapp very generously provided the data and schematic shown in Fig. 4a,b. This work was supported by NIH grants F31-EY026288 (to M.H.T.), EY028542 (to F.R.), and a National Science Foundation Grant 1715475 (to O.S.). Publisher Copyright: © 2018, Springer Nature America, Inc.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Our knowledge of sensory processing has advanced dramatically in the last few decades, but this understanding remains far from complete, especially for stimuli with the large dynamic range and strong temporal and spatial correlations characteristic of natural visual inputs. Here we describe some of the issues that make understanding the encoding of natural images a challenge. We highlight two broad strategies for approaching this problem: a stimulus-oriented framework and a goal-oriented one. Different contexts can call for one framework or the other. Looking forward, recent advances, particularly those based in machine learning, show promise in borrowing key strengths of both frameworks and by doing so illuminating a path to a more comprehensive understanding of the encoding of natural stimuli.

AB - Our knowledge of sensory processing has advanced dramatically in the last few decades, but this understanding remains far from complete, especially for stimuli with the large dynamic range and strong temporal and spatial correlations characteristic of natural visual inputs. Here we describe some of the issues that make understanding the encoding of natural images a challenge. We highlight two broad strategies for approaching this problem: a stimulus-oriented framework and a goal-oriented one. Different contexts can call for one framework or the other. Looking forward, recent advances, particularly those based in machine learning, show promise in borrowing key strengths of both frameworks and by doing so illuminating a path to a more comprehensive understanding of the encoding of natural stimuli.

UR - http://www.scopus.com/inward/record.url?scp=85058189294&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058189294&partnerID=8YFLogxK

U2 - 10.1038/s41593-018-0284-0

DO - 10.1038/s41593-018-0284-0

M3 - Review article

C2 - 30531846

AN - SCOPUS:85058189294

VL - 22

SP - 15

EP - 24

IS - 1

ER -

Stimulus- and goal-oriented frameworks for understanding natural vision

Abstract

Bibliographical note

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this