
Contents
-
-
-
-
-
-
-
-
-
-
-
-
-
10.1 Introduction and overview 10.1 Introduction and overview
-
10.2 Body-relative spaces 10.2 Body-relative spaces
-
10.2.1 Redundant, body-relative, multisensory spaces 10.2.1 Redundant, body-relative, multisensory spaces
-
10.2.2 Simple population encoding in a locust 10.2.2 Simple population encoding in a locust
-
10.2.3 Learning peripersonal spaces 10.2.3 Learning peripersonal spaces
-
10.2.4 Optimal information fusion 10.2.4 Optimal information fusion
-
10.2.5 Spatial, topology-preserving transformations 10.2.5 Spatial, topology-preserving transformations
-
-
10.3 Multisensory recognition 10.3 Multisensory recognition
-
10.3.1 Object recognition 10.3.1 Object recognition
-
10.3.2 Behavior recognition 10.3.2 Behavior recognition
-
-
10.4 Cognitive maps 10.4 Cognitive maps
-
10.4.1 Hippocampus and episodic memory 10.4.1 Hippocampus and episodic memory
-
10.4.2 Behavior-oriented cognitive map 10.4.2 Behavior-oriented cognitive map
-
-
10.5 Summary and conclusions 10.5 Summary and conclusions
-
10.6 Exercises 10.6 Exercises
-
-
-
-
-
-
-
10 Multisensory Interactions
Get access-
Published:January 2017
Cite
Abstract
This chapter shows that multiple sensory information sources can generally be integrated in a similar fashion. However, seeing that different modalities are grounded in different frames of reference, integrations will focus on space or on identities. Body-relative spaces integrate information about the body and the surrounding space in body-relative frames of reference, integrating the available information across modalities in an approximately optimal manner. Simple topological neural population encodings are well-suited to generate estimates about stimulus locations and to map several frames of reference onto each other. Self-organizing neural networks are introduced as the basic computation mechanism that enables the learning of such mappings. Multisensory object recognition, on the other hand, is realized most effectively in an object-specific frame of reference – essentially abstracting away from body-relative frames of reference. Cognitive maps, that is, maps of the environment are learned by connecting locations over space and time. The hippocampus strongly supports the learning of cognitive maps, as it supports the generation of new episodic memories, suggesting a strong relation between these two computational tasks. In conclusion, multisensory integration yields internal predictive structures about spaces and object identities, which are well-suited to plan, decide on, and control environmental interactions.
Sign in
Personal account
- Sign in with email/username & password
- Get email alerts
- Save searches
- Purchase content
- Activate your purchase/trial code
- Add your ORCID iD
Purchase
Our books are available by subscription or purchase to libraries and institutions.
Purchasing informationMonth: | Total Views: |
---|---|
October 2022 | 5 |
December 2022 | 2 |
February 2023 | 2 |
April 2023 | 6 |
June 2023 | 3 |
July 2023 | 18 |
October 2023 | 4 |
April 2024 | 3 |
June 2024 | 11 |
July 2024 | 14 |
August 2024 | 2 |
September 2024 | 6 |
October 2024 | 1 |
Get help with access
Institutional access
Access to content on Oxford Academic is often provided through institutional subscriptions and purchases. If you are a member of an institution with an active account, you may be able to access content in one of the following ways:
IP based access
Typically, access is provided across an institutional network to a range of IP addresses. This authentication occurs automatically, and it is not possible to sign out of an IP authenticated account.
Sign in through your institution
Choose this option to get remote access when outside your institution. Shibboleth/Open Athens technology is used to provide single sign-on between your institution’s website and Oxford Academic.
If your institution is not listed or you cannot sign in to your institution’s website, please contact your librarian or administrator.
Sign in with a library card
Enter your library card number to sign in. If you cannot sign in, please contact your librarian.
Society Members
Society member access to a journal is achieved in one of the following ways:
Sign in through society site
Many societies offer single sign-on between the society website and Oxford Academic. If you see ‘Sign in through society site’ in the sign in pane within a journal:
If you do not have a society account or have forgotten your username or password, please contact your society.
Sign in using a personal account
Some societies use Oxford Academic personal accounts to provide access to their members. See below.
Personal account
A personal account can be used to get email alerts, save searches, purchase content, and activate subscriptions.
Some societies use Oxford Academic personal accounts to provide access to their members.
Viewing your signed in accounts
Click the account icon in the top right to:
Signed in but can't access content
Oxford Academic is home to a wide variety of products. The institutional subscription may not cover the content that you are trying to access. If you believe you should have access to that content, please contact your librarian.
Institutional account management
For librarians and administrators, your personal account also provides access to institutional account management. Here you will find options to view and activate subscriptions, manage institutional settings and access options, access usage statistics, and more.