THE EYEWORK PROJECT

The EYEWORK Project II (2022-2025)

How does amultidisciplinary surgical team perform joint actions?

This is a continuous project of EYEWORK I, and it aims to investigate when members of a surgical team (especially anaesthetists) establish a joint attention at what object, and how members of a surgical team establish common ground for successfully performing joint actions. 

Project Funder: JSPS Grant-in-Aid for Scientists (B) (No. 22H03318, FY2022-2025) website

Events

The 2nd International Workshop on Health Communication and Safety website

The 24th International and Interdisciplinary Conference of Communication, Medicine and Ethics (COMET 2026) website

 

Publications

Books

Tsuchiya, K. (Ed.). (2025). Exploring health and well-being communication in Japanese context: Culture, language and multimodality. Springer.

 

Journal Articles

Akamine, R., Zhang, H., Saitoh, T., & Tsuchiya, K. (2026, March). Joint gaze detection based on head pose and depth estimation using a 360-degree camera. In Seventeenth International Conference on Graphics and Image Processing (ICGIP 2025) (Vol. 14124, pp. 542-549). SPIE.

Miyazaki, A., Coffey, F., Sato, H., Mackenzie, A. K., Nakamura, K., Bise, K., Saitoh, T., Abe, T., Fuyuno, M., Timmons, S., & Tsuchiya, K. (2025). Developing an AI-driven multimodal approach to visualising resilient team performance: Joint attentional engagement with gaze and speech in simulated emergency scenarios. BMJ Open Quality, 14(4), Article e003658.

Miyazaki, A., Fujii, A., Kuwabara, D., Minoguchi, K., Kawakami, H., Nakamura, K., Tsuchiya, K., Abe, T., Nakajima, K., Sato, H., & Goto, T. (2025). Enhancing the quality and safety of central venous catheter insertion using projection mapping: A prospective observational simulation study with eye-tracking glasses. BMJ Open, 15(5), Article e095803. https://doi.org/10.1136/bmjopen-2024-095803

Tsuchiya, K., Sato, H., Nakamura, K., Abe, T., Fujii, A., Miyazaki, A., Okuyama.Y., & Kuwabara, D. (2023). Information presentation and gaze-following for grounding in simulated anaesthesia emergencies: A multimodal analysis. Language and Health, 1(1), 10-31.

 

Conferences

Tsuchiya, K., Nakamura, K., Coffey, F., Mackenzie, A., Sato, H., Miyazaki, A., Saitoh, T., Fuyuno, M., Abe, T., Taneichi, A., Timmons, S., & Chałupnik, M. (2026, August 6). The EYEWORK project: The cross-cultural and interdisciplinary research on healthcare team interactions in the UK and Japan [Conference presentation]. Communication, Medicine and Ethics Conference (COMET 2026).

Coffey, F., Tsuchiya, K., Mackenzie, A., Saitoh, T., Timmons, S., & Chałupnik, M. (2026, April 28). Joint attention episodes in emergency care simulation: A multimodal analysis of team interactions using eye-trackers [Conference presentation]. Royal College of Emergency Medicine (RCEM) Annual Conference 2026.

Tsuchiya, K. (2026, January 9). Multimodal approaches to healthcare team interaction research [Invited talk]. International Symposium for Multimodal Measures in Healthcare 2026.

佐藤仁、中村京太、安部猛、古谷優樹、備瀬和也、齊藤剛史、土屋慶子 (2025年11月). 麻酔科シミュレーションでの共同的かかわりを可視化する：AI技術を用いた麻酔科医-看護師インタラクションでの共同注視・頭部姿勢検出とその相関性 [Conference presentation]. 第20回医療の質・安全学会学術集会.

土屋慶子、フランク・コーフィ、アンドリュー・マッケンジー (2025年9月). 言葉と視線が織りなす共同行為のための規範構築：救急医療シミュレーションでの患者家族・医師・看護師による三者会話のマルチモーダル談話分析 [Conference presentation]. ヘルスコミュニケーションウィーク2025.

Shinno, N., Furuya, Y., Saitoh, T., Zhang, H., Tsuchiya, K., Sato, H., & Coffey, F. (2025, July 26). Gaze attention estimation for medical environments [Conference presentation]. 19th International Conference on Machine Vision Applications (MVA 2025).

Tsuchiya, K., Coffey, F., Mackenzie, A., Timmons, S., & Saitoh, T. (2025, June 25). Joint attention and mutual gaze in team interactions in simulated emergency scenarios: A multimodal discourse analysis with dual eye-tracking data [Conference presentation]. Communication, Medicine and Ethics Conference (COMET 2025).

佐藤仁、中村京太、安部猛、齊藤剛史、古谷優樹、備瀬和也、土屋慶子 (2024年11月29日). 挿管困難シミュレーションでの麻酔科医と看護師の共同視野をとらえる：頭部姿勢推定技術を用いた空間配置描写 [Conference presentation]. 第19回医療の質・安全学会学術集会.

Coffey, F., Mackenzie, A., Bise, K., Saitoh, T., Timmons, S., & Tsuchiya, K. (2024, October 13). Different visual attention patterns between a doctor and a nurse during a simulated emergency: Utilising AI technology for automatic gaze and object detection [Conference presentation]. European Emergency Medicine Congress (EUSEM 2024).

Sato, H., Nakamura, K., Bise, K., & Saitoh, T. (2024, August 27). Joint attention in simulated anaesthesia emergency: A multimodal analysis with eye-tracking devices [Conference presentation]. International Forum on Quality and Safety in Healthcare Hong Kong 2024.

Tsuchiya, K., Coffey, F., Bise, K., & Saitoh, T. (2024, June 12). Analysing gaze behaviours of a doctor and a nurse in simulated emergency: Dialogues between consultants, information engineers and linguists. In K. Tsuchiya (Chair), Different approaches to dialogic research: Analysing a multimodal and multicultural embodiment of joint action in real-life and “non-real-life” interactions [Invited panel]. 7th ESTIDIA Conference.

佐藤仁、中村京太、安部猛、備瀬和也、古谷優樹、齊藤剛史、土屋慶子 (2023年11月25日). AI技術を用いた手術チームの共同行為分析：医療者間共同注視と相互凝視の自動検出方法の検討 [Conference presentation]. 第18回医療の質・安全学会学術集会.

土屋慶子、佐藤仁、中村京太、藤井ありさ、桑原大輔、奥山由佳 (2023年10月2日). 麻酔科シミュレーションでの共同意味付けによる言語身体性の習得：情報提示行為と交互凝視行動のマルチモーダル分析 [Conference presentation]. ヘルスコミュニケーションウィーク2023.

Coffey, F., Reilly, J.-J., Mackenzie, A., Bise, K., Saitoh, T., Megan, M., Lucy, R., Timmons, S., & Tsuchiya, K. (2023, September 27). When a doctor and a nurse share their view in a simulated emergency care interaction: Developing an automatic gaze annotation method for multiple eye-tracking data analysis [Conference presentation]. Royal College of Emergency Medicine (RCEM) Annual Scientific Conference 2023.

Tsuchiya, K., Nakamura, K., & Coffey, F. (2023, July 10). When a proposal is rejected: Distributing deontic rights in emergency care team interactions in Japan and the UK. In K. Tsuchiya & V. Fantasia (Chairs), Emerging otherness in social interactions: Multimodal and multicultural approaches [Symposium]. 18th International Pragmatics Conference.

Bise, K., Saitoh, T., Tsuchiya, K., Sato, H., Nakamura, K., Abe, T.,  Coffey, F. (2023) Joint Attention Detection using First-Person Points-of-View Video. CGIP(Computer Graphics and Image Processing) 2024, Dec 13,  2023, Kyoto.

Furuya, Y., Saitoh, T., Tsuchiya, K., Sato, H., Nakamura, K., Abe, T.,  Coffey, F. (2023) Efficient Construction of Face Image Dataset for Head Pose Estimation. CGIP(Computer Graphics and Image Processing) 2024, Dec 13,  2023, Kyoto.

Tsuchiya, K., Sato, H., Nakamura, K., Fujii, A., Kuwabara, D., Okuyama, Y. (2023) Becoming a linguistic body trough shared sense-making in simulated anaesthesia emergencies: a multimodal analysis of information presentation and gaze alternation. Health Communication Week 2023, Oct 2, 2023

Coffey, F., Reilly, J. J., Mackenzie, A., Bise, K., Saitoh, T., Megan, M., Lucy, R., Timmons, S., Tsuchiya, K. (2023) When a doctor and a nurse share their view in a simulated emergency care interaction: developing an automatic gaze annotation method for multiple eye-tracking data analysis. RCEM (Royal College of Emergency Medicine) Annual Scientific Conference 2023, Sep 27, 2023
 
Sato, H., Nakamura, K., Abe, T., Fujii, A., Miyazaki, A., Fuyuno, M., Blanco Cortes, L. M., Tsuchiya, K. (2022) Developing an immersive VR simulator for learning CVC (central venous catheter) insertion: multimodality and embodied cognition. The 17th Annual Congress of Japanese Society for Quality and Safety in Healthcare, Nov 26, 2022
 
Bise, K., Saitoh, T., Tsuchiya, K., Sato, H., Nakamura, K., Abe, T., Fujii, A., Miyazaki, A. (2022)  Toward a multimodal analysis of anaesthetists’ gaze behaviour: Developing a joint attention detection method using wearable eye-trackers. The 14th Conference of Japanese Association of Health Communication, Oct 2, 2022
 

The EYEWORK Project I (2017-2022)

Gaze in emergency care interaction: a Japan-UK multimodal research project

This project aims to investigate how health care professionals (HCPs) in emergency care achieve intersubjectivity among them, taking emergency care interaction as a social action. To do so, we video-record emergency care interaction in simulation training in Japan and in the UK with video cameras and eye-trackers, focusing on HCPs’ utterances and eye gaze.

Project Funder: JSPS Grant-in-Aid for Scientific Research B (No.17K07448, July 2017-Mar 2021) website

Events

The 1st International Workshop on Health Communication and Safety website

Publications

Books

Tsuchiya, K., Coffey, F., & Nakamura, K. (Eds.) (2023). Multimodal Approaches to Healthcare Communication Research: Visualizing Interactions for Resilient Healthcare in the UK and Japan. Bloomsbury Academics. link

Journal Articles

Cheng, J. T., Gerpott, F. H., Benson, A. J., Bucker, B., Foulsham, T., Lansu, T. A. M., Schülke, O., & Tsuchiya, K. (2022). Eye gaze and visual attention as a window into leadership and followership: A review of empirical insights and future directions. The Leadership Quarterly, 101654. link

Tsuchiya, K., Coffey, F., Nakamura, K., Mackenzie, A., Atkins, S., Chałupnik, M., Whitfield, A., Sakai, T., Timmons. S., Abe, T., Saitoh, T., Taneichi, A., Vernon, M., Crundall, D., & Fuyuno, M. (2022). Action request episodes in trauma team interactions in Japan and the UK. Journal of Pragmatics, 194, 101-118. link

Tsuchiya, K., Coffey, F., Mackenzie, A., Atkins, S., Chalupnik, M., Timmons, S., Whitfield, A., Vernon, M., Crundall, D. (2021) Framing trauma leaders’ request in emergency care interactions – A multimodal analysis using eye-tracking glasses. Communication and Medicine, 17(1), 47-63. link

Nakamura, K., Sakai, T., Abe, T., Saitoh, T., Coffe, F., MacKenzie, A., Taneichi, A., Tsuchiya, K. (2020) A team leader’s gaze before and after making requests in emergency care simulation: a case study with eye-tracking glasses. BMJ Simulation and Technology Enhanced Learning, Online first(6), 369-370. link

Tsuchiya K, Taneichi A, Nakamura K, Sakai T, Abe T, & Saitoh, T. (2019) A leader’s request and rapport in emergency care simulation: a multimodal corpus analysis. The Journal of the Japanese Association of Health Communication. 10(1): 36-41. pdf

Tsuchiya, K., Coffey, F., Timmons, S., Atkins, S., Baxendale, B., & Adolphs, S. (2019 [2015]). Account sequences in emergency care discourse: Comparing conversations with simulated patients and manikins in training sessions. Journal of Applied Linguistics and Professional Practice, 12(1), 72-93. link

Coffey, F., Tsuchiya, K., Timmons, S., Baxendale, B., Adolphs, S., Atkins, S. (2018) Analysing voice quality and pitch in interactions of emergency care simulation. BMJ Simulation & Technology Enhanced Learning 4(4), 196-200. link

Tsuchiya K, Coffey F, Timmons S, Adolphs S, Atkins S. (2017) Communicating with gaze in emergency care: a multimodal analysis. The Journal of the Japanese Association of Health Communication. 8(1): 81-90. pdf

Coffey F, Tsuchiya K, Timmons S, Baxendale B, Adolphs S, Atkins S. (2016) Simulated Patients vs Manikins in Acute Care Scenarios. Clinical Teacher. 13 (4): 257-261. link

 

Conferences

Oral Presentations

Tsuchiya, K., Nakamura, K., Coffey, F. (2023) [Symposium]Emerging otherness in social interactions: Muodal and multicultural approaches (Chairs: Keiko Tsuchiya; )Valentina Fantasia) [Panel] When a proposal is rejected: Distributing deontic rights in emergency care team interactions in Japan and the UK. 18th International Pragmatics Conference, Jul 10, 2023.
 

Tsuchiya, K., Coffey, F., Whitfield, A. (2022) Predictability and coordinated actions in emergency care interactions: trauma leaders’ meta-episodic gaze projection. 20th International and Interdisciplinary Conference on Communication, Medicine and Ethics (COMET), Jul, 2022.

Tsuchiya, K. (2022) [Panel Session] Emancipatory practices in health and well-being communication research: dialogues on multiculturality, multidisciplinarity and multimodality. The 6th ESTIDIA Conference, June 15, 2022.

Tsuchiya, K., Taneichi, A. (2022) Frame Analysis: Gaze and multimodality in emergency care interaction: different frames in trauma leaders’ information sharing practice between UK and Japan. The 6th ESTIDIA Conference, June 15, 2022.

Tsuchiya, K. (2021) Information sharing and reflexive common ground: a multimodal analysis of trauma leaders’ verbal and gaze behaviours in emergency care simulation in Japan and the UK. The Thirty-Ninth Conference of The English Linguistic Society of Japan, Nov 14, 2021.

Tsuchiya, K., Atkins, S. (2021) [Panel Session] The pragmatics for co-constructing healthcare in the global and diverse societies: crossing, or transforming, boundaries in healthcare communication. The17th International Pragmatics Conference, Jul 1, 2021.

Tsuchiya, K. (2020) A leader’s gaze and pointing gestures to request actions in emergency care interactions: describing multimodal gestalts. International Society for Gesture Studies – Hong Kong Online Seminar Series, Nov 4, 2020.

Tsuchiya, K., Taneichi, A., Nakamura, K., Sakai, T., Abe, T., Saitoh, T. (2020) Creating interactional spaces for making requests: a leader’s view and body orientation in emergency care simulation. The 11th Conference of Japanese Association of Health Communication, Sep 26, 2020.

Tsuchiya, K., Taneichi, A., Nakamura, K., Sakai, T., Abe, T., Saitoh, T. (2020) Analysing emergency care team leaders’ eye gaze for understanding non-verbal behaviours in emergency care interaction. Technical Committee on Natural Language Understanding and Models of Communication (NLC), Feb 17, 2020.

Sakai, T., Nakamura, K., Abe, T., Saitoh, T., Takeuchi, I., Tsuchiya, K., Taneichi, A. (2019) Opening communication channels with gaze: an analysis of emergency care interaction with an eye-tracker. The 14th Annual Congress of Japanese Society for Quality and Safety in Healthcare, Nov 30, 2019.

Tsuchiya, K, Taneichi, A. (2019) Request and rapport in emergency care simulation training. The 1st International Workshop of Health Communication and Safety, Sep, 2019.

Tsuchiya, K., Atkins, S., Coffey, F., Timmons, S., Mackenzie, A., Crundall, D. (2019) Projection with gaze: subjectivity and intersubjectivity in emergency care interaction. British Association of Applied Linguistics (BAAL) Conference 2019, Aug, 2019.

Tsuchiya, K., Saitoh, T., Nakamura, K., Sakai, T., Abe, T., Taneichi, A. (2019) Automatic coding of a team leader’s eyegaze in emergency care simulation: developing a multimodal corpus with the sceneAnalysis GUI. The 10th International Corpus Linguistics Conference (CL2019), July, 2019.

Atkins, S., Chalupnik, M., & Tsuchiya, K. (2019) Standardising pragmatic competences in healthcare: Evidence from communication skills training in emergency medicine in the UK and Japan. The16th International Pragmatics Conference, Hong Kong, June 2019.

Atkins, S. & Tsuchiya, K. (2019) [Panel Session] The pragmatics of global healthcare communication: setting communicative standards in diverse contexts. The16th International Pragmatics Conference, Hong Kong, June 2019.

Coffey, F., Tsuchiya, K. Atkins, S., Mackenzie, A., Crundall, D. and Timmons, S. (2018). Projection in emergency care interaction: a leader’s gaze. Association for Simulated Practice in Healthcare (ASPiH) Conference 2018, Southport, November 2018.

Tsuchiya, K., Taneichi, A., Nakamura, K., Sakai, T., Abe, T., and Saitoh, T. (2018). Making requests in emergency care simulation: gaze and politeness strategies as turn allocation devices. The 8th Conference of Japanese Association of Health Communication, Fukuoka, September 2018.

Tsuchiya, K., Coffey, F., Timmons, S., Atkins, S., Adolphs, S. (2016) An analysis of emergency care interactions in simulation training in the UK: focusing on gaze of health care professionals (in Japanese). The 8th Annual Conference of Japan Health Communication Association, Tokyo, September 2016.

Tsuchiya, K., Coffey, F. Timmons, S. and Atkins, S. (2014) ‘I wasn’t in the loop exactly’: comparing medical students’ perceptions of reality in emergency care training with qualified health care professionals using a corpus. British Association of Applied Linguistics (BAAL) Conference 2014, Warwick, September 2014.

Coffey, F., Tsuchiya, K., Timmons, S., Adolphs, S., and Baxendale, B. (2013) Conversation and Touch in Emergency Care Scenarios Involving Simulated Patients (SPs) and Mannequins – A Comparative Analysis. Association for Simulated Practice in Healthcare (ASPiH) Conference 2013, Harrogate, November 2013.

Tsuchiya, K., Coffey, F. and Timmons, S. (2013) Account preface in emergency care discourse: comparing conversations in medical trainings with a simulated patient and a mannequin using a mini-corpus. British Association of Applied Linguistics (BAAL) Conference 2013, Edinburgh, September 2013.

Tsuchiya, K., Coffey, F. Timmons, S. and Adolphs, A. (2013) Use of touch in emergency care: a multimodal corpus-based analysis. The International Conference on Corpus Linguistics (CILC) 2013, Alicante, March 2013.

Poster Presentations

Nakamura, K., Takuma, S., Abe, T., Saitoh, T., Fuyuno, M., Coffey, F., MacKenzie, A., Tsuchiya, K., Taneichi, A. (2021) Joint actions in emergency care team interaction in the UK and Japan － analysing the team leader’s requests using eye-tracking glasses. The 16th Annual Congress of Japanese Society for Quality and Safety in Healthcare, Nov 27, 2021.

Tsuchiya, K., Sato, H., Nakamura, K., Fujii, A., Miyazaki, A., Kuwabara, D., Okuyama, Y., Mackenzie, A., Myers, J., Abe, T., Fuyuno, M. (2021) Information presentation for grounding in interactions in anaesthesia simulation training: a preliminary study towards the development of a virtual reality simulator (in Japanese). The 13th Conference of Japanese Association of Health Communication, Oct 2, 2021.

Nakamura, K., Sakai, T., Abe, T., Saitoh, T., Taneichi, A., Tsuchiya, K. (2019) Capturing a leader’s view in emergency care simulation: developing a GUI for automatic gaze coding. International Forum on Quality and Safety in Healthcare 2019, Sep, 2019.

Tsuchiya, K, Taneichi, A, Sakai, T, Nakamura, K, Abe, T, Saitoh, T. (2019) A multimodal analysis of emegency care interaction with an eye-tracker: members’ prompts and a leader’s requests. The 11th Conference of Japanese Association of Health Communication, Sep, 2019.

Sakai, T., Nakamura, K., Abe, T., Saitoh, T., Taneichi, A. and Tsuchiya, K. (2018). Analysing a leader’s eye gaze in emergency care simulation. International Forum on Quality and Safety in Healthcare 2018, Melbourne, September 2018.

Coffey, F., Tsuchiya, K., Timmons, S. and Adolphs, A. (2013) Comparative Linguistic and Touch Analysis of Emergency Care Scenarios involving SPs and Mannequins. Association of Standard Patient Educators (ASPE) Annual Conference 2013, Atlanta, June 2013.