Movement trajectories as a window into the dynamics of emerging neural representations dataset
  • Description

    Transforming sensory inputs into meaningful neural representations is critical to adaptive behaviour in everyday environments. While non-invasive neuroimaging methods are the de-facto method for investigating neural representations, they remain expensive, not widely available, time-consuming, and restrictive in terms of the experimental conditions and participant populations they can be used with. Here we show that movement trajectories collected in online behavioural experiments can be used to measure the emergence and dynamics of neural representations with fine temporal resolution. By combining online computer mouse-tracking and publicly available neuroimaging (MEG and fMRI) data via Representational Similarity Analysis (RSA), we show that movement trajectories track the evolution of visual representations over time. We used a time constrained face/object categorization task on a previously published set of images containing human faces, illusory faces and objects to demonstrate that time-resolved representational structures derived from movement trajectories correlate with those derived from MEG, revealing the unfolding of category representations in comparable temporal detail (albeit delayed) to MEG. Furthermore, we show that movement-derived representational structures correlate with those derived from fMRI in most task-relevant brain areas, faces and objects selective areas in this proof of concept. Our results highlight the richness of movement trajectories and the power of the RSA framework to reveal and compare their information content, opening new avenues to better understand human perception.


    • Data publication title Movement trajectories as a window into the dynamics of emerging neural representations dataset
    • Description

      Transforming sensory inputs into meaningful neural representations is critical to adaptive behaviour in everyday environments. While non-invasive neuroimaging methods are the de-facto method for investigating neural representations, they remain expensive, not widely available, time-consuming, and restrictive in terms of the experimental conditions and participant populations they can be used with. Here we show that movement trajectories collected in online behavioural experiments can be used to measure the emergence and dynamics of neural representations with fine temporal resolution. By combining online computer mouse-tracking and publicly available neuroimaging (MEG and fMRI) data via Representational Similarity Analysis (RSA), we show that movement trajectories track the evolution of visual representations over time. We used a time constrained face/object categorization task on a previously published set of images containing human faces, illusory faces and objects to demonstrate that time-resolved representational structures derived from movement trajectories correlate with those derived from MEG, revealing the unfolding of category representations in comparable temporal detail (albeit delayed) to MEG. Furthermore, we show that movement-derived representational structures correlate with those derived from fMRI in most task-relevant brain areas, faces and objects selective areas in this proof of concept. Our results highlight the richness of movement trajectories and the power of the RSA framework to reveal and compare their information content, opening new avenues to better understand human perception.


    • Data type dataset
    • Keywords
      • Cognitive Neuroscience
      • The MARCS Institute
    • Funding source
    • Grant number(s)
      • -
    • FoR codes
      • 520203 - Cognitive neuroscience
      SEO codes
      Temporal (time) coverage
    • Start date
    • End date
    • Time period
       
      Spatial (location,mapping) coverage
    • Locations
      Data Locations

      Type Location Notes
      URL https://osf.io/q3hbp/
      The Data Manager is: Tijl Grootswagers
      Access conditions Open
      The data will be licensed under
    • Other license
    • Statement of rights in data Copyright Western Sydney University
      Citation Grootswagers, Tijl; Koenig-Robert, Roger (2022): Movement trajectories as a window into the dynamics of emerging neural representations dataset. OSF. https://doi.org/10.17605/OSF.IO/Q3HBP