CIn this paper, I discuss the minimization of the user interface of the interactive fairy tale content based on BCI and Motion Sensing Technology. For this reason, 3 version intervention interfaces of the interactive fairy tale content with Microsoft's Kinect as a non-contact motion sensing device and NeuroSky's MindWave EEG biosensor device as a BCI interface were produced and experimented. The experiments have been accomplished for four children of the first or the second graders by examining three different interactive intervention interfaces: 1) attention indicator by sparkling light; 2) the attention indicator plus behavior instructions; and 3) an indication bar for the attention level plus behavior instructions. As a result of this experimental observations, it shows that the visualized interface such as icons helps the participating children communicate with the fairy tale content system. In addition, they do communicate well without the visualized graphical interfaces when they are demanded by the realistic actions. Whereas, some communication problems have been found neither the realistic actions are requested nor the attention indicators are provided definitely.
This research is the preliminary study for development of narrative contents for improving reading skills and behavior controlling capabilities of children with ADHD. Microsoft's Kinect, a non-contact motion sensing device, and NeuroSky's MindWave, a BCI device, are connected to Unity 3D engine to capture user's motion and brainwaves, respectively. The given narrative contents interactively respond to children with ADHD while they are reading the contents and performing the given tasks presented in the behavior training game system. This study examines whether the contents are suitable for the first and second grader children. For this, The interaction with the contents is first observed by five adults and two children. Then the system is tested by three ordinary first graders. During the experiments, the children easily figure out the given texts and do what the game contents drive for the player to react. All three kids concentrate on the reading contents without leaving their seats for average 37 minutes. This experiment shows that the contents are properly designed for the first and second graders in terms of reading speed, reading completion time, complexity level, and task performance. Based on this experimental study, the interactive narrative contents will be used to conduct full-scale experiments with children with ADHD.
This research introduces the development of fairy tale system directed behavior training game platform with brainwaves and motion sensing cognitive technologies for Attention Deficit Hyperactivity Disorder (ADHD) children. The system includes three major functions: 1) the brainwaves and motion recognition; 2) the interactive intervention with narrative contents; and 3) the sensor and intervention data management. The narrative contents combined with fairy tales and other elements for the game platform including characters, perspectives, quests, and scenes are integrated into the system. While a child is playing a given fairy tale, the child’s brainwaves and motion sensing data are transmitted to the system. This system simultaneously controls the intervention procedure, helping the child concentrate on the story and accomplish quests appropriately. The main contribution of this system is to help children with ADHD manage their behavior by continuously intervening them to increase the attention to the fairy tales and feel confidence on themselves with the improved test results.
This research introduces the interactive fairy tale system based on BCI and Motion Sensing Technology for Children with ADHD. ADHD is a specific disorder which shows deficits in sustained attention, behavioral inhibition, resistance to distraction, and the regulation of one’s activity level to the demands of a situation (hyperactivity or restlessness). The interactive fairy tale system implemented on the Unity3D engine is expected to keep track of a player's time-varying brainwave and motion logs through NeuroSky’s MindWave Brain-Computer Interface (BCI) and Microsoft’s Kinect motion sensing technology. The proposed system helps us take a closer look at the player's behavior than performing a video shoot or direct observation. In addition, as the system keeps the observed data, it is possible to constantly track the changes on the player's brainwave and behavior, and synthetically assess the effect of the proposed approach from many different aspects.