Dataset Information

3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation.

ABSTRACT: The 3D Tune-In Toolkit (3DTI Toolkit) is an open-source standard C++ library which includes a binaural spatialiser. This paper presents the technical details of this renderer, outlining its architecture and describing the processes implemented in each of its components. In order to put this description into context, the basic concepts behind binaural spatialisation are reviewed through a chronology of research milestones in the field in the last 40 years. The 3DTI Toolkit renders the anechoic signal path by convolving sound sources with Head Related Impulse Responses (HRIRs), obtained by interpolating those extracted from a set that can be loaded from any file in a standard audio format. Interaural time differences are managed separately, in order to be able to customise the rendering according the head size of the listener, and to reduce comb-filtering when interpolating between different HRIRs. In addition, geometrical and frequency-dependent corrections for simulating near-field sources are included. Reverberation is computed separately using a virtual loudspeakers Ambisonic approach and convolution with Binaural Room Impulse Responses (BRIRs). In all these processes, special care has been put in avoiding audible artefacts produced by changes in gains and audio filters due to the movements of sources and of the listener. The 3DTI Toolkit performance, as well as some other relevant metrics such as non-linear distortion, are assessed and presented, followed by a comparison between the features offered by the 3DTI Toolkit and those found in other currently available open- and closed-source binaural renderers.

SUBMITTER: Cuevas-Rodriguez M

PROVIDER: S-EPMC6411112 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation.

Cuevas-Rodríguez María M Picinali Lorenzo L González-Toledo Daniel D Garre Carlos C de la Rubia-Cuestas Ernesto E Molina-Tanco Luis L Reyes-Lecuona Arcadio A

PloS one 20190311 3

The 3D Tune-In Toolkit (3DTI Toolkit) is an open-source standard C++ library which includes a binaural spatialiser. This paper presents the technical details of this renderer, outlining its architecture and describing the processes implemented in each of its components. In order to put this description into context, the basic concepts behind binaural spatialisation are reviewed through a chronology of research milestones in the field in the last 40 years. The 3DTI Toolkit renders the anechoic si ...[more]

PMID: 30856198

Similar Datasets

Project description:BackgroundInertial measurements (IMUs) facilitate the measurement of human motion outside the motion laboratory. A commonly used open-source software for musculoskeletal simulation and analysis of human motion, OpenSim, includes a tool to enable kinematics analysis of IMU data. However, it only enables offline analysis, i.e., analysis after the data has been collected. Extending OpenSim's functionality to allow real-time kinematics analysis would allow real-time feedback for the subject during the measurement session and has uses in e.g., rehabilitation, robotics, and ergonomics.MethodsWe developed an open-source software library for real-time inverse kinematics (IK) analysis of IMU data using OpenSim. The software library reads data from IMUs and uses multithreading for concurrent calculation of IK. Its operation delays and throughputs were measured with a varying number of IMUs and parallel computing IK threads using two different musculoskeletal models, one a lower-body and torso model and the other a full-body model. We published the code under an open-source license on GitHub.ResultsA standard desktop computer calculated full-body inverse kinematics from treadmill walking at 1.5 m/s with data from 12 IMUs in real-time with a mean delay below 55 ms and reached a throughput of more than 90 samples per second. A laptop computer had similar delays and reached a throughput above 60 samples per second with treadmill walking. Minimal walking kinematics, motion of lower extremities and torso, were calculated from treadmill walking data in real-time with a throughput of 130 samples per second on the laptop and 180 samples per second on the desktop computer, with approximately half the delay of full-body kinematics.ConclusionsThe software library enabled real-time inverse kinematical analysis with different numbers of IMUs and customizable musculoskeletal models. The performance results show that subject-specific full-body motion analysis is feasible in real-time, while a laptop computer and IMUs allowed the use of the method outside the motion laboratory.

Dataset Information

3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation.

Publications

3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets