Material
Abstract
We present a software solution for processing recordings of honeybee brain activity in real time. In the honeybee brain, odors elicit spatio-temporal activity patterns that encode odor identity. These patterns of neural activity in units called glomeruli can be recorded by calcium imaging with fluorescent dyes, but so far glomerulus segmentation was only possible offline, making interactive experiments impossible. Our main contribution is an adaptive algorithm for image processing, along with a fast implementation for the graphics processing unit that enables semantic segmentation in real time. Semantics is based on the temporal dimension, relying on the fact that time series of pixels within a glomerulus are correlated. We evaluate our software on reference data, demonstrate applicability in a biological experiment, and provide free source code. This paves the way for interactive experiments where neural units can be selected online based on their past activity.
BibTeX
@inproceedings{Strauch2012INCIDEbrainbee,
author = {M. Strauch and M. Broeg and C. Müthing and P. Szyszka and O. Deussen and C. Galizia and D. Merhof},
booktitle = {IEEE Symposium on Biological Data Visualization},
doi = {10.1109/BioVis.2012.6378588},
keywords = {brain;data visualisation;image segmentation;medical image processing;neural nets;real-time systems;INCIDE;calcium imaging;fluorescent dyes;glomerulus segmentation;honeybee brain activity visualisation;neural activity;odor identity;real time;semantic segmentation;source code;temporal dimension;Java;Motion pictures;Principal component analysis;Real-time systems;Time series analysis;Vectors},
month = {oct},
pages = {17-24},
title = {INCIDE the brain of a bee: Visualising honeybee brain activity in real time by semantic segmentation},
year = {2012},
url = {http://graphics.uni-konstanz.de/publikationen/Strauch2012INCIDEbrainbee},
}