Demonstrating change from a drop-in engagement activity through pre- and post- graffiti walls: Quantitative linguistics and thematic analysis applied to a space soundscape exhibit
Abstract. Impact evaluation in public engagement necessarily requires measuring change, however this is extremely challenging for drop-in activities due to their very nature. We present a soundscape exhibit, where young families experienced the usually inaudible sounds of near-Earth space, which used a novel method of evaluation integrating pre- and post- graffiti walls into the activity. We apply two analysis techniques to the captured before and after data: 1) Quantitative linguistics – Applying Zipf's law (the power law statistics of words) reveals an increased diversity of language concerning space afterwards, highlighting participants engaged with and reflected upon the sounds; 2) Thematic analysis – Finding and grouping patterns in the qualitative data shows altered conceptions of space around aspects of sound, dynamism, emptiness and electricity, areas highly relevant to the underlying space plasma physics of the sonified data. Therefore, we demonstrate that this novel approach to drop-in activity evaluation has the power to capture change from before to after, and thus short-term impact – specifically in this case showing the power of data sonification in innately communicating science. We suggest the method could be adopted by others in their drop-in engagement activities more broadly.