MindAffect Open Source BCI.¶
What makes mindaffectBCI different¶
When we looked at the existing frameworks, we noticed that whilst they were great and extremely flexible, they weren’t so easy to use for developing end-user applications. So they didn’t quite meet our objective of making it easy to develop new modes of interaction using brain signals.
Our aim is to simplify or hide the brain-signals aspect of the BCI as much as possible (or wanted) and so allow developers to focus on their applications. With this in mind mindaffectBCI is designed to be;
- cross-platform – run on all major desktop OSs (talk to us if you are interested in mobile)
- hardware neutral – support (via brainflow) many existing amplifiers, with instructions to easily add more,
- language neutral – provide APIs and examples for; python, java, c/c++, c#, swift
- batteries included – out of the box include a high-performance BCI, and examples for using this with common app development frameworks; (python, unity, swift)
Target users of mindaffectBCI¶
User Interface Designers¶
The main target users for the mindaffectBCI are Application Developers who would like to add brain control to their applications, for example to add brain controls to a smart TV application. Within that we provide tools for particular user groups.
- Game Designers: Do you want to add brain controls to an existing game? Or make a new game including Brain controls as a novel interaction modality? You can easily do this, in a cross-platform way, using our unity plugin available here.
- Patient Technical Support Teams: One of the key motivators behind the MindAffect team is to make BCIs available to improve peoples lives. We can help some patients directly ourselves, but cannot support every possible patient and their environment. Instead, we try to provide the tools so patient support teams can themselves fit the BCI to their patients needs. For this, we provide a basic text communication application out-of-the-box, with guidance on how to customise this for their users needs, for example for fewer or more letters, or control of novel output devices.
- Hackers and Makers: Do you want to add brain control to your raspberry-pi robot, Lego robot, sphero or drone? Now you can, either by using a simple control app on your laptop, or (more fun) by adding LEDs or LASERS(!!!) to your robot for direct control. We provide examples for driving LEDs from a raspberry Pi, and are happy to help using other hacker boards (micro:bit) or even the LEDs on your drone.
Neuroscience Students and Researchers¶
For the user interface designers, we deliberately hide the brain-signals as much as possible. However, a BCI also provides an excellent tool for learning about basic neuroscience – in particular how the brain responses to external stimulus. For these users provide tools for the on-line real-time visualization of the stimulus specific responses. Importantly, these visualizations utilize the same technology as the on-line BCI, which uses machine learning techniques to improve signal quality and separate the responses from overlapping brain responses. This, gives students a clear view of the brain response in a short amount of time allowing for interactive learning and experimentation with stimulus parameters or mental strategies. For example, so students can directly see the common (p300) and differential (perceptual) responses when using visual vs. auditory oddball paradigms.
Machine Learning Engineers / Data Scientists¶
Modern BCIs (including our own) rely heavily on machine learning techniques to process the noisy data gathered from EEG sensors and cope with the high degree of variability in responses over different individuals and locations. MindAffect firmly believes that with more sophisticated machine learning techniques more useful information can be extracted from even ‘low quality’ consumer grade EEG data. What is really needed is a combination of more and larger datasets on which to train the algorithms and better techniques tuned to the specific issues of neural data. The mindaffect BCI aims to facilitate this data lead approach to BCI in two ways.
- Firstly, by making it easier to rapidly gather relatively large EEG datasets by using consumer grade EEG devices and applications designed in your prefered application development framework. For example, by using a raspberry Pi, headphones, and EEG headband and an openBCI ganglion to measure the brain’s response to different music types.
- Secondly, by providing a sklearn compatiable interface for machine learning developers to experiment with different learning algorithms, both in larger off-line dataset analysis and then directly in on-line applications.
Project ideas for users¶
- Brain controlled robot arm - use a laser or projector to illuminate objects to move, e.g. chess pieces, or food to eat, and the BCI to select which piece to move and where too. Lazy chess or snacking. See here for an example.
- Neural shazam or Perceived music detection - Identify what music someone is listening to directly from their brain response.
- Tactile BCI - Allow someone to answer yes-no-questions (or even spell words) by concentrating on different parts of their body.
- Brain Defenders – Play missile-command using only your brain to pick where to send your defending missiles. Or go further and do it in Virtual Reality
- Brain home-automation - Use brain control to change the color of your lights, like Philips Hue control, or to control your TV.
- Real-world telekinesis - Use your brain to shoot storm-troopers in a modern tin-can-alley, like this
- Brain-Golf (or Croquet)– play golf with your brain by controlling a sphero from a tablet. See Sphero control for some inspiration.
- Brain control of your phone? Use our unity or iOS APIs to build a phone app controllable with your brain?Like this
- How an Evoked Response BCI works
- DIY Brain Computer Interfacing
- Creating a Simple Output Module
- Creating a simple Presentation Module
- Running Custom Presentation
- How to build your own optical sensor
- Checking stimulus time-lock quality
- Offline analysis of a mindaffectBCI savefile
- For DataScientists: How to analyse multiple datasets
- VideoTutorial: Adding Brain Controls to your Unity Game
- VideoTutorial: Controlling a Phillips HUE with your brain
- Raspberry pi GPIO
- Add a new amplifier to mindaffectBCI
- Going Further : Amplifiers, BCI-types, Decoder Config
- Project Ideas / Inspiration
- Frequently Asked Questions
- How do I improve my calibration accuracy?
- My calibration accuracy is fine but prediction mode does not work.
- I’m getting an
Acq did not start correctlyand/or a
- How do I run the BCI in full-screen mode?
- Can I use the mindaffectBCI without an EEG acquisition device?
- I’m getting a framework not found error on Mac OS
- I’m getting poor performance on linux
- Python API
- mindaffectBCI : System Overview and Component Roles
- System Overview
- mindaffectBCI : Message Specification
- Message Specifications
- Message Header
- General Utility Messages
- Presentation -> Recogniser
- Recogniser -> Selection or Output
- Controller or Output -> All
- Recogniser -> User Interface
- Acquisition -> Recogniser
- Extension Messages
- Config -> Recogniser
- Bluetooth Low Energy
- Service: Presentation
- Service: Decoder
- Service: Selection
- Service: ScoreOutput