Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Development of a Real-Time Instrument Tracking System for Enabling the Musical Interaction with the WF-4RIV
Karlstad University, Faculty of Technology and Science, Department of Physics and Electrical Engineering.ORCID iD: 0000-0002-6865-7346
2008 (English)In: IROS 2008. IEEE/RSJ International Conference on Intelligent Robots and Systems, 2008., 2008, p. 3654-3659Conference paper, Published paper (Refereed)
Abstract [en]

The aim of this paper is to create an interface for human-robot interaction. Specifically, musical performance parameters (i.e. vibrato expression) of the Waseda Flutist Robot No.4 Refined IV (WF-4RIV) are to be manipulated. Our research is focused on enabling the WF-4RIV to interact with human players (musicians) in a natural way. In this paper, as a first approach, a vision processing algorithm, that is able to track the 3D-orientation and position of a musical instrument, was developed. In particular, the robot acquires image data through two cameras attached to its head. Using color histogram matching and a particle filter, the position of the musicianpsilas hands on the instrument are tracked. Analysis of this data determines orientation and location of the instrument. These parameters are mapped to manipulate the musical expression of the WF-4RIV, more specifically sound vibrato and volume values. We present preliminary experiments to determine if the robot may dynamically change musical parameters while interacting with a human player (i.e. vibrato etc.). From the experimental results, we may confirm the feasibility of the interaction during a performance, although further research must be carried out to consider the physical constraints of the flutist robot

Place, publisher, year, edition, pages
2008. p. 3654-3659
National Category
Robotics
Identifiers
URN: urn:nbn:se:kau:diva-18291DOI: 10.1109/IROS.2008.4650831ISBN: 978-1-4244-2057-5 (print)OAI: oai:DiVA.org:kau-18291DiVA, id: diva2:591921
Conference
The 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2008), 22-26 September, Nice, France
Available from: 2013-01-21 Created: 2013-01-21 Last updated: 2015-06-17Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records BETA

Solis, Jorge

Search in DiVA

By author/editor
Solis, Jorge
By organisation
Department of Physics and Electrical Engineering
Robotics

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 25 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf