Full metadata record
DC poleHodnotaJazyk
dc.contributor.authorThissen, Martin
dc.contributor.authorHergenröther, Elke
dc.contributor.editorSkala, Václav
dc.date.accessioned2023-10-15T16:58:02Z
dc.date.available2023-10-15T16:58:02Z
dc.date.issued2023
dc.identifier.citationWSCG 2023: full papers proceedings: 1. International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, p. 28-35.en
dc.identifier.isbn978-80-86943-32-9
dc.identifier.issn2464–4617 (print)
dc.identifier.issn2464–4625 (CD/DVD)
dc.identifier.urihttp://hdl.handle.net/11025/54396
dc.format8 s.cs
dc.format.mimetypeapplication/pdf
dc.language.isoenen
dc.publisherVáclav Skala - UNION Agencyen
dc.rights© Václav Skala - UNION Agencyen
dc.subjectpočítání davůcs
dc.subjectmultimodální učenícs
dc.subjectRGB-Tcs
dc.subjecttransformátorcs
dc.titleWhy Existing Multimodal Crowd Counting Datasets Can Lead to Unfulfilled Expectations in Real-World Applicationsen
dc.typekonferenční příspěvekcs
dc.typeconferenceObjecten
dc.rights.accessopenAccessen
dc.type.versionpublishedVersionen
dc.description.abstract-translatedMore information leads to better decisions and predictions, right? Confirming this hypothesis, several studies concluded that the simultaneous use of optical and thermal images leads to better predictions in crowd counting. However, the way multimodal models extract enriched features from both modalities is not yet fully understood. Since the use of multimodal data usually increases the complexity, inference time, and memory requirements of the models, it is relevant to examine the differences and advantages of multimodal compared to monomodal models. In this work, all available multimodal datasets for crowd counting are used to investigate the differences between monomodal and multimodal models. To do so, we designed a monomodal architecture that considers the current state of research on monomodal crowd counting. In addition, several multimodal architectures have been developed using different multimodal learning strategies. The key components of the monomodal architecture are also used in the multimodal architectures to be able to answer whether multimodal models perform better in crowd counting in general. Surprisingly, no general answer to this question can be derived from the existing datasets. We found that the existing datasets hold a bias toward thermal images. This was determined by analyzing the relationship between the brightness of optical images and crowd count as well as examining the annotations made for each dataset. Since answering this question is important for future real-world applications of crowd counting, this paper establishes criteria for a potential dataset suitable for answering whether multimodal models perform better in crowd counting in general.en
dc.subject.translatedcrowd countingen
dc.subject.translatedmultimodal learningen
dc.subject.translatedRGB-Ten
dc.subject.translatedtransformeren
dc.identifier.doihttps://www.doi.org/10.24132/CSRN.3301.5
dc.type.statusPeer-revieweden
Vyskytuje se v kolekcích:WSCG 2023: Full Papers Proceedings

Soubory připojené k záznamu:
Soubor Popis VelikostFormát 
D97-full.pdfPlný text5,68 MBAdobe PDFZobrazit/otevřít


Použijte tento identifikátor k citaci nebo jako odkaz na tento záznam: http://hdl.handle.net/11025/54396

Všechny záznamy v DSpace jsou chráněny autorskými právy, všechna práva vyhrazena.