Many of our Talking Thinking Teaching Head application are educational in nature. The original concept of the Teaching Head was to turn around our language learning research and the robot world simulations we developed for simulated grounding of our computational natural language learners. The same scenes that are useful for teaching a computer English are also useful for teaching student English – but the task is actually a lot easier. You don't need a complete native speaker competence in the language to teach basic vocabulary and grammar. Moreover, if you don't understand what the student says to you in response to a question, it doesn't matter, because you know what the answer should have been according to the goals of the current lesson and exercise. This fits very nicely with the template approach that underlies most conversational agents, including the default version of our Thinking Heads.
An obvious development from teaching grammar is to teach phonology, or microphonology – the Teaching Head has the ability to show you exactly what you should have said, and how you should have said it, in any arbitrary face and voice – including yours! The concept of mirroring your actual speech as you give an answer with your poor learner's accent, and suspect grammar, followed by repeating back to you the correct answer, with a perfect accent, in your own face and voice – this is a key focus of our current work on the Teaching Head, and should provide a huge improvement in the ability of a student to learn the correct pronuncation and accent, as well as learning the syntax and semantics of the language. Of course, English is not the only language we could teach, and collaborators at TUB, Berlin and BJUT, Beijing are working on German and Chinese speaking versions of the head, as well as being interested in English Teaching Head for German and Chinese students.
However, another twist on the language Teaching Head is to teach English literacy and numeracy to English Speakers, Australians in our case, or indigenous Australians, or new immigrants to Australia. In fact, it was the indigenous Australian communities that got excited about this project: VALIANT.
A further twist on the language Teaching Head is to teach children with disabilities – our AudioVisual Speech Recognition work has shown that we have the potential to distinguish sounds by lipreading, that are traditionally thought to be indistinguishable, to be part of a singe viseme, so teaching lip reading seemed to be a natural extension. However, what the deaf community and their health teams really though was a key need which the Teaching Head could help with, was learning social skills. This very quickly lead to other communities and conditions where teaching social skills is important, and children with Autism Spectrum Disorders are the current focus of this project: AVAST.
This takes us into the area of Assistive Technologies, which is also a focal area within the Medical Device Research Institute. A new teaching head application in the health-oriented assistive and educational technology area is in Motivational Interviewing – at this stage training students in the health sciences through the provision of a simulated patient to interview. Physical and haptic patient simulation is an important aspect of the MDRI Medical Simulation group.
Games are an important tool for learning, both independently and in conjunction with the Thinking Head, and most of the games being developed by our Games, Haptics and Simulation researchers are either assistive or educational in nature - and many both have an assistive character and a training character.
Educational and Emotional Monitoring
Another new technology we are exploring is Audio-Visual Brain Computer Interface technology that can help us understanding where a student is in their learning curve for both physical and mental learning activities, or skill acquisition. This connects also research using the same technologies to monitor the cognitive, motivational and emotional states of a student, including task-related workload and situation awareness.
For More Information...
For more information on this area, including research projects, courses and topics, or scholarships, please contact Professor David Powers.