[BlindRUG] ggplot for sound

Gjalt-Jorn Peters gjalt-jorn at behaviorchange.eu
Sat Jul 4 09:32:15 UTC 2020


Dear everybody,

You may have heard of 'ggplot', a plotting engine in R that maps data 
properties onto visual dimensions such as location, color, or size.

On Twitter today, somebody had a random idea: perhaps it's possible to 
design something similar, but mapping data properties onto auditive 
dimensions. The example they gave was:

    ggplot(mtcars) +

    geom_ping(aes(stereo_position = mpg, pitch = wt), sound = 'waterdrop') +

    scale_pitch_continuous(min = 'middle-c', max = 'middle-c + 2 octaves')

This would specify a "auditive plot" based on the mtcars dataset, adding 
an element called "ping", mapping stereo position to the 'mpg' variable 
and mapping pitch to the 'weight' variable, using a sound called 
'waterdrop', and specifying the scale to use for the pitch.

This specific example may be very stupid/impractical, but it 'felt' like 
they might be on to something.

But I have no experience whatsoever with this. There is of course the 
'sonify' package, but a ggplot-like implementation would provide much 
more freedom.

Would something like that be worthwhile to explore further?

Or is this just not useful at all in practice?

Kind regards,

Gjalt-Jorn





More information about the BlindRUG mailing list