Dataset Open Access

Data Visualization of Weight Sensor and Event Detection of Aifi Store

João Diogo Falcão; Carlos Ruiz; Rahul S Hoskeri; Adeola Bannis; Shijia Pan; Hae Young Noh; Pei Zhang

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="DOI">10.5281/zenodo.4300738</identifier>
      <creatorName>João Diogo Falcão</creatorName>
      <affiliation>Carnegie Mellon University, AiFi Inc</affiliation>
      <creatorName>Carlos Ruiz</creatorName>
      <affiliation>AiFi Inc</affiliation>
      <creatorName>Rahul S Hoskeri</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0002-6990-6084</nameIdentifier>
      <affiliation>University of California, Merced</affiliation>
      <creatorName>Adeola Bannis</creatorName>
      <affiliation>Carnegie Mellon University</affiliation>
      <creatorName>Shijia Pan</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0002-3226-2318</nameIdentifier>
      <affiliation>University of California, Merced</affiliation>
      <creatorName>Hae Young Noh</creatorName>
      <affiliation>Stanford University</affiliation>
      <creatorName>Pei Zhang</creatorName>
      <affiliation>Carnegie Mellon University</affiliation>
    <title>Data Visualization of Weight Sensor and Event Detection of Aifi Store</title>
    <subject>Multi-modal sensing</subject>
    <subject>Autonomous cashier-less store</subject>
    <subject>Sensor data visualization</subject>
    <subject>Event detection</subject>
    <date dateType="Issued">2020-11-26</date>
  <resourceType resourceTypeGeneral="Dataset"/>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.4292483</relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;&lt;a href=""&gt;Aifi&lt;/a&gt; Store is an autonomus store for cashier-less shopping experience which&amp;nbsp;is achieved by multi modal sensing (Vision modality, weight modality and location modality). Aifi Nano store layout (Fig 1)&amp;nbsp;(Image Credits: &lt;a href=""&gt;AIM3S&lt;/a&gt; research paper).&lt;/p&gt;

The store is organized in the gondola&amp;#39;s and each gondola has shelfs that holds the products and each shelf has weight sensor plates. These weight sensor plates data is used to find the event trigger (pick up, put down or no event) from which we can find the weight of the product picked.&lt;/p&gt;

&lt;p&gt;Gondola is similar to vertical fixture consisting of horizontal shelfs in any normal store and in this case there are 5 to 6 shelfs in a Gondola. Every shelf again is composed of weight sensing plates, weight sensing modalities, there are around 12 plates on each shelf.&lt;/p&gt;

&lt;p&gt;Every plate has a sampling rate of **60Hz**, so there are 60 samples collected every second from each plate&lt;/p&gt;

&lt;p&gt;The pick up event on the plate can be observed and marked when the weight sensor reading decreases with time and increases with time when the put down event happens.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Event Detection:&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The event is said to be detected if the moving variance calculated from the raw weight sensor reading exceeds a set threshold of (10000gm^2 or 0.01kg^2) over the sliding window length of 0.5 seconds, which is half of the sampling rate of sensors (i.e 1 second).&lt;/p&gt;

&lt;p&gt;There are 3 types of events:&lt;/p&gt;

	&lt;li&gt;Pick Up Event (Fig 2)= Object being taken from the particular gondola and shelf from the customer&lt;/li&gt;
	&lt;li&gt;Put Down Event&amp;nbsp;(Fig 3)= Object being placed back from the customer on that particular gondola and shelf&lt;/li&gt;
	&lt;li&gt;No&amp;nbsp;Event = (Fig 4)No object being picked up from that shelf&lt;/li&gt;


	&lt;li&gt;1.The python script must be in the same folder as of the &lt;em&gt;weight.csv&lt;/em&gt; files and .&lt;em&gt;csv&lt;/em&gt; files should not be placed in other subdirectories.&lt;/li&gt;
	&lt;li&gt;2.The videos for the corresponding weight sensor data can be found in the &lt;strong&gt;&amp;quot;Videos folder&amp;quot;&lt;/strong&gt; in the repository and are named similar to their corresponding &lt;strong&gt;&amp;quot;.csv&amp;quot;&lt;/strong&gt; files.&lt;/li&gt;
	&lt;li&gt;3.Each video files consists of video data from 13 different camera angles.&lt;/li&gt;

&lt;p&gt;&lt;strong&gt;Details of the weight sensor files:&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;These weight.csv (Baseline cases and team particular cases ) files are from the AIFI CPS IoT 2020 week.There are over 50 cases in total and each file has 5 columns (Fig 5) (timestamp, reading (in grams), gondola, shelf, plate number).&lt;/p&gt;

&lt;p&gt;Each of these files have data of around 2-5 minutes or 120 seconds in the form of timestamp. In order to unpack date and time from timestamp use &lt;em&gt;datetime&lt;/em&gt; module from python.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Details of the &lt;em&gt;product.csv&lt;/em&gt; files:&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;There are&amp;nbsp;&lt;em&gt;product.csv&lt;/em&gt; files for each test cases and these files provide the detailed information about the product name, product location (gondola number, shelf number and plate number) in the store, product weight(in grams), also link to the image of the product.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Instruction to run the script:&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;To start analysing the weigh.csv files using the python script and plot the timeseries plot for corresponding files.&lt;/p&gt;

	&lt;li&gt;Download the dataset.&lt;/li&gt;
	&lt;li&gt;Make sure to place the python/ jupyter notebook file is in same directory as the .csv files.&lt;/li&gt;
	&lt;li&gt;Install the requirements&lt;br&gt;
	&lt;code&gt;$ pip3 install -r requirements.txt&lt;/code&gt;&lt;/li&gt;
	&lt;li&gt;Run the python script;br&gt;
	&lt;code&gt;$ python3;/code&gt;&lt;/li&gt;

&lt;p&gt;After the script has run successfully you will find the corresponding folders of weight.csv files which contain the figures (weight vs timestamp) in the format&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Instruction to run the Jupyter Notebook:&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Run the Plot.ipynb file using Jupyter Notebook by placing .csv files in the same directory as the Plot.ipynb script.&lt;/p&gt;


&lt;p&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp;gondola_number,shelf_number.png&lt;/p&gt;

&lt;p&gt;&amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; &amp;nbsp; Ex: 1,1.png (Fig 4)&amp;nbsp;(&lt;em&gt;Timeseries Graph&lt;/em&gt;)&lt;/p&gt;</description>
    <description descriptionType="Other">{"references": ["", "Ruiz, Carlos &amp; Falcao, Joao &amp; Pan, Shijia &amp; Noh, Hae &amp; Zhang, Pei. (2019). AIM3S: Autonomous Inventory Monitoring through Multi-Modal Sensing for Cashier-Less Convenience Stores. 135-144. 10.1145/3360322.3360834."]}</description>
All versions This version
Views 14886
Downloads 5215
Data volume 2.3 GB303.8 MB
Unique views 10768
Unique downloads 325


Cite as