Behavioral and neural constraints on hierarchical representations

Odelia Schwartz, Luis Gonzalo, Sanchez Giraldo

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Central to behavior and cognition is the way that sensory stimuli are represented in neural systems. The distributions over such stimuli enjoy rich structure; however, how the brain captures and exploits these regularities is unclear. Here, we consider different sources of perhaps the most prevalent form of structure, namely hierarchies, in one of its most prevalent cases, namely the representation of images. We review experimental approaches across a range of subfields, spanning inference, memory recall, and visual adaptation, to investigate how these constrain hierarchical representations. We also discuss progress in building hierarchical models of the representation of images-this has the potential to clarify how the structure of the world is reflected in biological systems. We suggest there is a need for a closer embedding of recent advances in machine learning and computer vision into the design and interpretation of experiments, notably by utilizing the understanding of the structure of natural scenes and through the creation of hierarchically structured synthetic stimuli.

Original languageEnglish (US)
Pages (from-to)1-25
Number of pages25
JournalJournal of Vision
Volume17
Issue number3
DOIs
StatePublished - Mar 1 2017

Fingerprint

Cognition
Brain
Machine Learning

Keywords

  • Deep learning
  • Hierarchy
  • Natural scenes
  • Representation

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Cite this

Behavioral and neural constraints on hierarchical representations. / Schwartz, Odelia; Gonzalo, Luis; Giraldo, Sanchez.

In: Journal of Vision, Vol. 17, No. 3, 01.03.2017, p. 1-25.

Research output: Contribution to journalArticle

Schwartz, Odelia ; Gonzalo, Luis ; Giraldo, Sanchez. / Behavioral and neural constraints on hierarchical representations. In: Journal of Vision. 2017 ; Vol. 17, No. 3. pp. 1-25.
@article{0e20ee4e473d4739b0055ff60056ea72,
title = "Behavioral and neural constraints on hierarchical representations",
abstract = "Central to behavior and cognition is the way that sensory stimuli are represented in neural systems. The distributions over such stimuli enjoy rich structure; however, how the brain captures and exploits these regularities is unclear. Here, we consider different sources of perhaps the most prevalent form of structure, namely hierarchies, in one of its most prevalent cases, namely the representation of images. We review experimental approaches across a range of subfields, spanning inference, memory recall, and visual adaptation, to investigate how these constrain hierarchical representations. We also discuss progress in building hierarchical models of the representation of images-this has the potential to clarify how the structure of the world is reflected in biological systems. We suggest there is a need for a closer embedding of recent advances in machine learning and computer vision into the design and interpretation of experiments, notably by utilizing the understanding of the structure of natural scenes and through the creation of hierarchically structured synthetic stimuli.",
keywords = "Deep learning, Hierarchy, Natural scenes, Representation",
author = "Odelia Schwartz and Luis Gonzalo and Sanchez Giraldo",
year = "2017",
month = "3",
day = "1",
doi = "10.1167/17.3.13.",
language = "English (US)",
volume = "17",
pages = "1--25",
journal = "Journal of Vision",
issn = "1534-7362",
publisher = "Association for Research in Vision and Ophthalmology Inc.",
number = "3",

}

TY - JOUR

T1 - Behavioral and neural constraints on hierarchical representations

AU - Schwartz, Odelia

AU - Gonzalo, Luis

AU - Giraldo, Sanchez

PY - 2017/3/1

Y1 - 2017/3/1

N2 - Central to behavior and cognition is the way that sensory stimuli are represented in neural systems. The distributions over such stimuli enjoy rich structure; however, how the brain captures and exploits these regularities is unclear. Here, we consider different sources of perhaps the most prevalent form of structure, namely hierarchies, in one of its most prevalent cases, namely the representation of images. We review experimental approaches across a range of subfields, spanning inference, memory recall, and visual adaptation, to investigate how these constrain hierarchical representations. We also discuss progress in building hierarchical models of the representation of images-this has the potential to clarify how the structure of the world is reflected in biological systems. We suggest there is a need for a closer embedding of recent advances in machine learning and computer vision into the design and interpretation of experiments, notably by utilizing the understanding of the structure of natural scenes and through the creation of hierarchically structured synthetic stimuli.

AB - Central to behavior and cognition is the way that sensory stimuli are represented in neural systems. The distributions over such stimuli enjoy rich structure; however, how the brain captures and exploits these regularities is unclear. Here, we consider different sources of perhaps the most prevalent form of structure, namely hierarchies, in one of its most prevalent cases, namely the representation of images. We review experimental approaches across a range of subfields, spanning inference, memory recall, and visual adaptation, to investigate how these constrain hierarchical representations. We also discuss progress in building hierarchical models of the representation of images-this has the potential to clarify how the structure of the world is reflected in biological systems. We suggest there is a need for a closer embedding of recent advances in machine learning and computer vision into the design and interpretation of experiments, notably by utilizing the understanding of the structure of natural scenes and through the creation of hierarchically structured synthetic stimuli.

KW - Deep learning

KW - Hierarchy

KW - Natural scenes

KW - Representation

UR - http://www.scopus.com/inward/record.url?scp=85017104101&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017104101&partnerID=8YFLogxK

U2 - 10.1167/17.3.13.

DO - 10.1167/17.3.13.

M3 - Article

VL - 17

SP - 1

EP - 25

JO - Journal of Vision

JF - Journal of Vision

SN - 1534-7362

IS - 3

ER -