Ground truth recordings for validation of spike sorting algorithms

Giulia LB Spampinato; Elric Esposito; Pierre Yger; Jens Duebel; Serge Picaud; Olivier Marre

doi:10.5281/zenodo.1205233

March 22, 2018 Dataset Open Access

Ground truth recordings for validation of spike sorting algorithms

Giulia LB Spampinato; Elric Esposito; Pierre Yger; Jens Duebel; Serge Picaud; Olivier Marre

MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nmm##2200000uu#4500</leader>
  <datafield tag="999" ind1="C" ind2="5">
    <subfield code="x">https://elifesciences.org/articles/34518</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">neuroscience, spike sorting, ground-truth, spyking circus</subfield>
  </datafield>
  <controlfield tag="005">20191101071251.0</controlfield>
  <controlfield tag="001">1205233</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Institut de la Vision - INSERM URMS 968, France</subfield>
    <subfield code="a">Elric Esposito</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Institut de la Vision - INSERM URMS 968, France</subfield>
    <subfield code="0">(orcid)0000-0003-1376-5240</subfield>
    <subfield code="a">Pierre Yger</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Institut de la Vision - INSERM URMS 968, France</subfield>
    <subfield code="a">Jens Duebel</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Institut de la Vision - INSERM URMS 968, France</subfield>
    <subfield code="a">Serge Picaud</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Institut de la Vision - INSERM URMS 968, France</subfield>
    <subfield code="0">(orcid)0000-0002-0090-6190</subfield>
    <subfield code="a">Olivier Marre</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1969550083</subfield>
    <subfield code="z">md5:196d2a1afb2e55488bda0cc9baf47883</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20160415_patch2.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1493049837</subfield>
    <subfield code="z">md5:06f5fe2ad6c9d02bc9a08c2a29723b98</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20160426_patch2.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1329199864</subfield>
    <subfield code="z">md5:dfb6045c114b459b63373324963c82ba</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20160426_patch3.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1929506495</subfield>
    <subfield code="z">md5:c4a1073d2a2f3445bdb9adc1916e2f5a</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170621_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1833647266</subfield>
    <subfield code="z">md5:ecf4367f385d5b376a3cac8925af6489</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170622_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1852222519</subfield>
    <subfield code="z">md5:ab2c5267aef675b7b988021eeaf28fb3</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170622_patch2.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1931805232</subfield>
    <subfield code="z">md5:efe9026921a731cabde2befccc858f61</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170623_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1947159921</subfield>
    <subfield code="z">md5:7919caafb6eea4e7c37b2e6680329b10</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170627_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1883551126</subfield>
    <subfield code="z">md5:48580bb2849335a4d767b00e7901ed9a</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170629_patch2.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1883429901</subfield>
    <subfield code="z">md5:6409f3f2c7b802fb70f4009e1ac49701</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170629_patch3.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1893341792</subfield>
    <subfield code="z">md5:0432815b86e613339f7b70d7ccf1c727</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170630_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1981224910</subfield>
    <subfield code="z">md5:550bf521cce4f5020c935422d8dd42fe</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170706_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">2041100827</subfield>
    <subfield code="z">md5:0a34eac1b81dbdb1644ad9a432595d38</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170706_patch2.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">2036325050</subfield>
    <subfield code="z">md5:ac9f6ed96e897e2be3b798dc09d772c6</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170706_patch3.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">2007621163</subfield>
    <subfield code="z">md5:70838dcf458498ca6f29b74a92352928</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170713_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1908524733</subfield>
    <subfield code="z">md5:1bc59535d4edfd9427e6fd6d69164fd0</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170725_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1896534323</subfield>
    <subfield code="z">md5:f97ae5e7f528c67f15914e15d0d2ceaa</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170726_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1934697089</subfield>
    <subfield code="z">md5:1639defeeccf5ea82c156dac7d8413e3</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170728_patch2.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1973904781</subfield>
    <subfield code="z">md5:6ec775991a39b4d687cf239b1e503fd5</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/20170803_patch1.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">6815</subfield>
    <subfield code="z">md5:ba8889165d01b059f7ad090a2bb79a2d</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/mea_256.prb</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">2772</subfield>
    <subfield code="z">md5:62f23cdccfe7be85ecbf87e0d8c74ec0</subfield>
    <subfield code="u">https://zenodo.org/record/1205233/files/README.rst</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2018-03-22</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="o">oai:zenodo.org:1205233</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="4">
    <subfield code="p">Elife</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">Institut de la Vision - INSERM URMS 968, France</subfield>
    <subfield code="a">Giulia LB Spampinato</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">Ground truth recordings for validation of spike sorting algorithms</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">http://creativecommons.org/licenses/by/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;&lt;strong&gt;Ground-truth recordings for validation of spike sorting algorithms&lt;/strong&gt;&lt;br&gt;
&amp;nbsp;&lt;/p&gt;

&lt;p&gt;This datasets is composed of simultaneous loose patch recordings of Ganglion Cells in mice retina, combined with dense extra-cellular recordings (252 channels). The details of the dataset can be found here &lt;a href="https://elifesciences.org/articles/34518"&gt;https://elifesciences.org/articles/34518&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Probe layout&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The probe layout can be found as mea_256.prb. This is a 16x16 Multi Electrode Array with 30um spacing. Only 252 channels are extra-cellular signals, and the 4 corners are devoted to triggers/sync/juxta.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Struture of the data&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;In this dataset, you will find several individual recordings, at max 5min long each (but please do not hesitate to contact us if interested by longer recordings).&amp;nbsp;The extra-cellular data are saved as 16bits unsigned integer, with a variable offset at the beginning of the file. The value of this offset is given, for every datafile, in the additional text file (padding value (see following for more details)).&amp;nbsp;The files have already been filtered with a Butterworth filter of order 3 with a cut-off frequency at 100Hz&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Structure of a given dataset&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Please read carefully the following to understand how to load and perform spike sorting with the data. In every .tar.gz file, you will find:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;&amp;nbsp;a jpg image, displaying a small chunk of the juxta-cellular signal (top left), with detected peaks and threshold. The extra-cellular spike triggered waveform, across all channels, for the juxta-spike times (top right). In the bottom, you can see the juxta-cellular spikes, for all the detected triggers (left), and on the right the voltage on the channel where the Spike Triggered Average of the extra-cellular waveform is peaking the most.&lt;/li&gt;
	&lt;li&gt;a file .juxta.raw, as float32, with the juxta-cellular trace at 20kHz, no data offset&lt;/li&gt;
	&lt;li&gt;a file .raw, as uint16, with the extra-cellular signals recorded for 256 channels at a sampling rate of 20kHZ. In fact, only 252 channels are extra-cellular signals, the 4 corners of the arrays are devoted to juxta-cellular and sync signals (see probe layout mea_256.prb)&lt;/li&gt;
	&lt;li&gt;a file .triggers.npy containing the spike times of the juxta-cellular spikes, detected using a threshold of k.MAD. The exact value of k can vary on a per dataset basis, and is written in the .txt file (threshold)&lt;/li&gt;
	&lt;li&gt;a .txt file describing some information for a given dataset, such as the threshold value used to detect the spikes, the channel in the raw file where the juxta-cellular signal is located, the minimal value of the peak for the STA (and on which channel it is located), and the header size to read the raw data&lt;/li&gt;
	&lt;li&gt;a .params file, if you want to analyze the data with SpyKING CIRCUS&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;How to load the raw data in numpy&lt;/strong&gt;&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-python"&gt;#Using the offset value from the txt file, we can load the data with memmap arrays

data=numpy.memmap('mydata.raw', dtype='uint16', offset=offset, mode='r')
data=data.reshape(len(data)//256, 256)

#Then for example, to display the first second of channel 0
one_channel = data[:20000, 0].astype('float32')

#If we want to center data around 0
one_channel -= 2**15 - 1

#And if we want to display data in micro volt, we must use the gain factor of 0.1042 provided in the header
one_channel *= 0.1042&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;&amp;nbsp;&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.1205232</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.1205233</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">dataset</subfield>
  </datafield>
</record>

1,661

629

views

downloads

See more details...

	All versions	This version
Views	1,661	1,672
Downloads	629	629
Data volume	847.2 GB	847.2 GB
Unique views	1,499	1,510
Unique downloads	264	264

More info on how stats are collected.

Indexed in

Publication date:

March 22, 2018

DOI:

Keyword(s):

neuroscience, spike sorting, ground-truth, spyking circus

Published in:

Elife:.

License (for files):

Creative Commons Attribution 4.0 International

Versions

Version 1.0 10.5281/zenodo.1205233

Mar 22, 2018

Cite all versions? You can cite all versions by using the DOI 10.5281/zenodo.1205232. This DOI represents all versions, and will always resolve to the latest one. Read more.

Ground truth recordings for validation of spike sorting algorithms

MARC21 XML Export

Versions

Share

Cite as

Export

About

Blog

Help

Developers

Contribute

Ground truth recordings for validation of spike sorting algorithms

MARC21 XML Export

Zenodo DOI Badge

DOI

10.5281/zenodo.1205233

Markdown

[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.1205233.svg)](https://doi.org/10.5281/zenodo.1205233)

reStructedText

.. image:: https://zenodo.org/badge/DOI/10.5281/zenodo.1205233.svg :target: https://doi.org/10.5281/zenodo.1205233

HTML

<a href="https://doi.org/10.5281/zenodo.1205233"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.1205233.svg" alt="DOI"></a>

Image URL

https://zenodo.org/badge/DOI/10.5281/zenodo.1205233.svg

Target URL

https://doi.org/10.5281/zenodo.1205233

Versions

Share

Cite as

Export