Keynote 1. "Perceptually-Inspired Computing"
Ming C. Lin
Department of Computer Science
University of North Carolina at Chapel Hill and Tsinghua University
E-mail: [email protected] Web: http://www.cs.unc.edu/~lin
Ming C. Lin is currently John R. & Louise S. Parker Distinguished Professor of Computer Science at the University of North Carolina (UNC), Chapel Hill and an honorary Chair Professor (Yangtze Scholar) at Tsinghua University in China. She obtained her B.S., M.S., and Ph.D. in Electrical Engineering and Computer Science from the University of California, Berkeley. She received several honors and awards, including the NSF Young Faculty Career Award in 1995, Honda Research Initiation Award in 1997, UNC/IBM Junior Faculty Development Award in 1999, UNC Hettleman Award for Scholarly Achievements in 2003, Beverly W. Long Distinguished Professorship 2007-2010, Carolina Women’s Center Faculty Scholar in 2008, UNC WOWS Scholar 2009-2011, IEEE VGTC Virtual Reality Technical Achievement Award in 2010, and nine best paper awards at international conferences.
She is a Fellow of ACM and IEEE. Her research interests include physically-based modeling, virtual environments, sound rendering, haptics, robotics, and geometric computing. She has (co-)authored more than 250 refereed publications in these areas and co-edited/authored four books. She has served on over 130 program committees of leading conferences and co-chaired dozens of international conferences and workshops.
She has been the Editor-in-Chief of IEEE Transactions on Visualization and Computer Graphics (2011-2014). She is a member of 6 editorial boards, and a guest editor for over a dozen of scientific journals and technical magazines. She also has served on several steering committees and advisory boards of international conferences, as well as government and industrial technical advisory committees.
Human sensory systems allow individuals to see, hear, touch, and interact with the surrounding physical environment. Understanding human perception and its limit enables us to better exploit the psychophysics of human perceptual systems to design more efficient, adaptive algorithms and develop perceptually-inspired computational models. In this talk, I will survey some of recent efforts on perceptually-inspired computing with applications to crowd simulation and multimodal interaction. In particular, I will present data-driven personality modeling based on the results of user studies, example-guided physics-based sound synthesis using auditory perception, as well as perceptually-inspired simplification for multi-modal interaction. These perceptually guided principles can be used to accelerating multi-modal interaction and visual computing, thereby creating more natural human-computer interaction and providing more immersive experiences. I will also present their use in interactive applications for entertainment, such as video games, computer animation, and shared social experience. I will conclude by discussing possible future research directions.
Keynote 2. "Sensors for the Senses: Meaning-making via self-active entertainment experiences"
Anthony L. Brooks (aka Tony)
School of Media Technology
University of Aalborg, Esbjerg
E-mail: [email protected] Web: http://personprofil.aau.dk/103302
Acknowledged as a third culture thinker1 and referred to as “a world pioneer in digital media and its use with the disabled community”2, Dr Anthony (aka Tony) Brooks, under Aalborg University Esbjerg campus in Denmark, is an Associate Professor and director of the SensoramaLab; a facility exploring Virtual Reality; e-health; HCI and Entertainment Experiences via Human Behaviour Analysis; Interaction Design; Computers in Entertainment; Serious Games/Gamification; Ludic Engagement Designs for All (LEDA); Play, Learning and Innovation. He is also a leading light of the hugely successful Medialogy education, being the sole surviving employed member of the original founding team.
Appointed by the European Commission (Brussels/Luxembourg), Brooks is EU expert examiner, rapporteur, and panel reviewer of funded projects under Future Emerging Technologies (FP6 / FP7) and Horizon 2020 calls. Additionally, he is reviewer for the Council for the Humanities of the Netherlands Organization for Scientific Research (NWO), e-health innovations by SMEs, and The Economic and Social Research Council (ESRC), UK. Brooks is IFIP - (UNESCO) Danish Representative (International Federation for Information Processing) and European Alliance for Innovation Chair of the Wellness SIB Market and society activity. He is also active in the European Alliance for Innovation (EAI); CREATE-NET; E-Health council; steering person of the ArtsIT international conference, and active on numerous boards and committees. His research transcends traditional individual disciplines, which has resulted in a long list of global keynote speaker credits at major events. His research has been responsible for contemporary national (DK) and international (EU) projects. It has also resulted in patents, creative industry initiatives (SMEs) and commercial products. National and International awards have been awarded for his contribution. In his ‘spare time’ he runs his consultancy SME. Personally sponsored by industry (e.g. IBM, Sony, Panasonic, and others) Brooks’ digital media artist work, which feeds into his healthcare research, has been presented at major events including commissions at two Olympic/Paralympic Games Cultural Events (1996/2000); numerous European City of Culture commissions; The Danish NeWave New York (1999); numerous Museum of Modern Art exhibitions; and many more. He is active on the Computers in Entertainment scene having been an invited columnist, article and book chapter author.
Over 170 peer-reviewed publications contribute to his growing body of work which include a number of books relating how ICT, entertainment, creative expression, play and fun are increasingly meaningful implemented alongside serious games/gamification and robotic device scenarios where healthcare, learning, wellbeing and quality of life issues are in foci. His work targets societal impact and benefit in respect of future demographics and service industries through applied ICT and optimized motivation of use through inclusive intervention strategies. Emergent models from his research that focus upon ‘in-action intervention’ and ‘on-action evaluation’ are well cited.
In his ACM Computers in Entertainment article, titled "Artist and Audience: Emerging the Nano-entertainment experience" 3, the author posited on how Inhabited Information Spaces, created as core catalyst of research, may be questioned as a multisensory future virtual work of art. This themed Human-Computer Interaction for Entertainment contribution for the EAI INTETAIN 2015 conference builds upon the earlier work by questioning meaning making from such self-active entertainment experiences. Contextually, self-active relates to actor empowerment via ICT, whilst entertainment refers to HCI paradigms that are fun, engaging, and enjoyable.
Conceptualizing, designing and realizing alternative digital media entertainment situations in stage performance, interactive installations and exhibitions at leading Museums for Modern Art, National and International major events, contributed to development of a sensor-based system conceived as a platform to investigate meaning making having societal impact beyond art. The system involves arrays of selectable sensor profiles mixed and matched according to requirements. Sensing of human input can be through worn (biosignal e.g. EEG, ECG, EMG, GSR), held, and/or non-worn sensors (volumetric, linear and planar interface profiles). Mapping of sourced human data is to a variety of digital content including art-based (music making, digital painting, lighting effects), video games, Virtual Reality and robotic devices. System adaptability promotes participant profile matching e.g. according to desired outcome. All ages and abilities are potential users.
Preceding the commonly known camera-based game controllers such as EyeToy, Wii, and Kinect; the SoundScapes Virtual Interactive Space4 system has been used in institutes, hospitals and clinics to empower people with impairment to unconsciously push their limits of functionality via creative and playful expression. Rehabilitation is less mundane and boring, where variety of ICT-based intervention motivates whilst offering creative opportunities for facilitators. Additionally, in a randomized intervention study with frail elderly patients, Hagedorn and Holm reported significant clinical rehabilitation impact up to 400% in the ICT feedback training specific performance5.
This work highlights how co-informing paradigms between computer and human science and art, games and healthcare, can result in societal impact as well as commercial patented product and industry start-ups. At the core of the research is a rethinking in the way a human interacts with ICT. Current research explores a concept of dynamic air and alternative physical-virtual environments.
Conclusions introduce a suggested need of increased researcher awareness of post-research effect following intervention/trials within healthcare and rehabilitation
1 Brockman, J. (1991) http://www.edge.org/3rd_culture
2 Williams, C. (2013) The latest on human computer interaction and special needs (TESconnect magazine 7th August) http://community.tes.co.uk/
4 Brooks, A.L. (1999) Virtual interactive space (V.I.S.) as a movement capture interface tool giving multimedia feedback for treatment and analysis. Science Links. Japan.
5 Hagedorn, D.K. & Holm, E. (2010) Effects of traditional physical training and visual computer feedback training in frail elderly patients. A randomized intervention study. Eur J Phys Rehabil Med. 46(2):159-68.