A multimodal approach to mapping soundscapes

Tawfiq Salem; Menghua Zhai; Scott Workman; Nathan Jacobs

doi:10.1109/IGARSS.2018.8517977

A multimodal approach to mapping soundscapes

Tawfiq Salem, Menghua Zhai, Scott Workman, Nathan Jacobs

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

11 Scopus citations

Abstract

We explore the problem of mapping soundscapes, that is, predicting the types of sounds that are likely to be heard at a given geographic location. Using a novel dataset, which includes geo-tagged audio and overhead imagery, we develop an approach for constructing an aural atlas, which captures the geospatial distribution of soundscapes. We build on previous work relating sound to ground-level imagery but incorporate overhead imagery to overcome the limitations of sparsely distributed geo-tagged audio. In the end, all that we require to construct an aural atlas is overhead imagery of the region of interest. We show examples of aural atlases at multiple spatial scales, from block-level to country.

Original language	English
Title of host publication	2018 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018 - Proceedings
Pages	3477-3480
Number of pages	4
ISBN (Electronic)	9781538671504
DOIs	https://doi.org/10.1109/IGARSS.2018.8517977
State	Published - Oct 31 2018
Event	38th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018 - Valencia, Spain Duration: Jul 22 2018 → Jul 27 2018

Publication series

Name	International Geoscience and Remote Sensing Symposium (IGARSS)
Volume	2018-July

Conference

Conference	38th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018
Country/Territory	Spain
City	Valencia
Period	7/22/18 → 7/27/18

Bibliographical note

Publisher Copyright:
© 2018 IEEE

Keywords

Audio
Mapping
Multimodal
Satellite

ASJC Scopus subject areas

Computer Science Applications
General Earth and Planetary Sciences

Access to Document

10.1109/IGARSS.2018.8517977

Cite this

@inproceedings{305c8924a5dc4fb4b6a80a5070ff98cc,

title = "A multimodal approach to mapping soundscapes",

abstract = "We explore the problem of mapping soundscapes, that is, predicting the types of sounds that are likely to be heard at a given geographic location. Using a novel dataset, which includes geo-tagged audio and overhead imagery, we develop an approach for constructing an aural atlas, which captures the geospatial distribution of soundscapes. We build on previous work relating sound to ground-level imagery but incorporate overhead imagery to overcome the limitations of sparsely distributed geo-tagged audio. In the end, all that we require to construct an aural atlas is overhead imagery of the region of interest. We show examples of aural atlases at multiple spatial scales, from block-level to country.",

keywords = "Audio, Mapping, Multimodal, Satellite",

author = "Tawfiq Salem and Menghua Zhai and Scott Workman and Nathan Jacobs",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE; 38th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018 ; Conference date: 22-07-2018 Through 27-07-2018",

year = "2018",

month = oct,

day = "31",

doi = "10.1109/IGARSS.2018.8517977",

language = "English",

series = "International Geoscience and Remote Sensing Symposium (IGARSS)",

pages = "3477--3480",

booktitle = "2018 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018 - Proceedings",

}

Salem, T, Zhai, M, Workman, S & Jacobs, N 2018, A multimodal approach to mapping soundscapes. in 2018 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018 - Proceedings., 8517977, International Geoscience and Remote Sensing Symposium (IGARSS), vol. 2018-July, pp. 3477-3480, 38th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018, Valencia, Spain, 7/22/18. https://doi.org/10.1109/IGARSS.2018.8517977

A multimodal approach to mapping soundscapes. / Salem, Tawfiq; Zhai, Menghua; Workman, Scott et al.
2018 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018 - Proceedings. 2018. p. 3477-3480 8517977 (International Geoscience and Remote Sensing Symposium (IGARSS); Vol. 2018-July).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A multimodal approach to mapping soundscapes

AU - Salem, Tawfiq

AU - Zhai, Menghua

AU - Workman, Scott

AU - Jacobs, Nathan

PY - 2018/10/31

Y1 - 2018/10/31

N2 - We explore the problem of mapping soundscapes, that is, predicting the types of sounds that are likely to be heard at a given geographic location. Using a novel dataset, which includes geo-tagged audio and overhead imagery, we develop an approach for constructing an aural atlas, which captures the geospatial distribution of soundscapes. We build on previous work relating sound to ground-level imagery but incorporate overhead imagery to overcome the limitations of sparsely distributed geo-tagged audio. In the end, all that we require to construct an aural atlas is overhead imagery of the region of interest. We show examples of aural atlases at multiple spatial scales, from block-level to country.

AB - We explore the problem of mapping soundscapes, that is, predicting the types of sounds that are likely to be heard at a given geographic location. Using a novel dataset, which includes geo-tagged audio and overhead imagery, we develop an approach for constructing an aural atlas, which captures the geospatial distribution of soundscapes. We build on previous work relating sound to ground-level imagery but incorporate overhead imagery to overcome the limitations of sparsely distributed geo-tagged audio. In the end, all that we require to construct an aural atlas is overhead imagery of the region of interest. We show examples of aural atlases at multiple spatial scales, from block-level to country.

KW - Audio

KW - Mapping

KW - Multimodal

KW - Satellite

UR - http://www.scopus.com/inward/record.url?scp=85063164241&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063164241&partnerID=8YFLogxK

U2 - 10.1109/IGARSS.2018.8517977

DO - 10.1109/IGARSS.2018.8517977

M3 - Conference contribution

AN - SCOPUS:85063164241

T3 - International Geoscience and Remote Sensing Symposium (IGARSS)

SP - 3477

EP - 3480

BT - 2018 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018 - Proceedings

T2 - 38th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018

Y2 - 22 July 2018 through 27 July 2018

ER -

A multimodal approach to mapping soundscapes

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this