Original Research
Why surveys are ‘very hard’: exploring challenges and insights for collection of authentic patient experience information with speakers of Australian First Nations languages
AUTHORS
Anne Lowell1 (Australian) PhD, Principal Research Fellow *
Yomei Jones2 Diploma, Program Manager
Robyn Aitken3 PhD, Dean Rural and Remote Health
Dikul R Baker1,4 (Indigenous Australian) Diploma of Indigenous Research, Language and Cultural Consultant
Judith Lovell5,6 PhD, Senior Research Fellow 
Samantha Togni7 MA, Social Research and Evaluation Consultant
Dianne Gon̲d̲arra8 (Indigenous Australian) Master of Indigenous Knowledges (Mawul Rom), Cultural Consultant
Beth Sometimes9 MFA, Interpreter
Margaret Smith10 (Yankunytjatjara woman) Secondary School, Cultural Consultant
Julie Anderson10 (Yankunytjatjara woman) Secondary School, Cultural Consultant
Rachael Sharp11,12 Graduate Certificate in Nursing (Nurse Education), Graduate Certificate in Health Science (Emergency Nursing), Senior Quality and Safety Advisor
Maria Karidakis13 PhD, ESL Lecturer & Convenor, Australia Awards Introductory Academic Program
Sarita Quinlivan14,15 Bachelor, Support Coordinator
Mandy Truong2,16 PhD, Senior Research Officer
Paul Lawton2,17 PhD, Professor/Director of Renal Medicine
AFFILIATIONS
1 Northern Institute, Charles Darwin University, Ellengowan Dr, Darwin, NT 0909, Australia
2 Menzies School of Health Research, PO Box 41096, Casuarina, NT 0811, Australia
3 Flinders University, Rocklands Rd, Tiwi, NT 0810, Australia
4 Present address: Self Employed, 7 Howley Cres., Anula, NT 0812, Australia
5 Charles Darwin University, Central Australian Campus, Alice Springs, NT 0870, Australia
6 Present address: Batchelor Institute, Central Australian Campus, 475 Stuart Hwy, Alice Springs, NT 0873, Australia
7 S2 Consulting, PO Box 137, Alice Springs, NT 0871, Australia
8 Self Employed, 2/116 Gukuda St, Galiwin’ku, NT 0822, Australia
9 Self Employed, 12 Giles St, Alice Springs, NT 0870, Australia
10 Self Employed, 3 Wilkinson St, Alice Springs, NT 0870, Australia
11 Department of Health, Health House, PO Box 41326, Casuarina, NT 0811, Australia
12 Present address: Top End Mental Health Service, RDH Campus, Nightingale Rd, GPO Box 140, Parap, NT 0804, Australia
13 School of Languages and Linguistics, The University of Melbourne, Vic. 3010, Australia
14 The Purple House (Western Desert Nganampa Walytja Palyantjaku Tjutaku Aboriginal Corporation), PO Box 5060, Alice Springs, NT 0871, Australia
15 Present address: Warlukurlangu Artists, Ral Ral Ave, Yuendumu, NT 0872, Australia
16 Present address: Monash Nursing and Midwifery, Monash University, Clayton, Vic. 3800, Australia
17 Present address: The Central Clinical School, Monash University, The Alfred Centre, Melbourne, Vic. 3004, Australia
ACCEPTED: 3 December 2023
early abstract:
Introduction: Health services collect patient experience data to monitor, evaluate and improve services and subsequently health outcomes. Obtaining authentic patient experience information to inform improvements relies on the quality of data collection processes and their responsiveness to the cultural and linguistic needs of diverse populations. This study explores the challenges and considerations in collecting authentic patient experience information through survey methods with Australians who primarily speak First Nations languages.
Methods: First Nations language experts, interpreters, health staff and researchers with expertise in intercultural communication engaged in an iterative process of critical review of two survey tools using qualitative methods. These included a collaborative process of repeated translation and back translation of survey items and collaborative analysis of videorecorded trial administration of surveys with languages experts (who were also receiving dialysis treatment) and survey administrators. All research activities were audio or video recorded and data from all sources were translated, transcribed and inductively analysed to identify key elements influencing acceptability and relevance of both survey process and items as well as translatability.
Results: Serious challenges in achieving equivalence of meaning between English and translated versions of survey items were pervasive. Translatability of original survey items was extensively compromised by the use of metaphors specific to the cultural context within which surveys were developed, English words that are familiar but used with different meaning, English terms with no equivalent in First Nations languages and grammatical discordance between languages. Discordance between survey methods and First Nations cultural protocols and preferences for seeking and sharing information was also important: the lack of opportunity to share the ‘full story’, discomfort with direct questions and communication protocols that preclude negative or critical responses, constrained the authenticity of the information obtained though survey methods. These limitations have serious implications for the quality of information collected and result in frustration and distress for those engaging with the survey.
Conclusion: Profound implications for the acceptability of a survey tool as well as data quality arise from differences between First Nations’ cultural and communication contexts and the cultural context within which survey methods have evolved. When data collection processes are not linguistically and culturally congruent there is a risk that patient experience data is inaccurate, misses what is important to First Nations patients and has limited utility for informing relevant health care improvement. Engagement of First Nations cultural and language experts is essential in all stages of development, implementation and evaluation of culturally safe and effective approaches to support speakers of First Nations languages to share their experiences of health care and influence change.