Development and Validation of a Questionnaire for Assessing Sustainability in Sporting Events in Natural Areas: A Mixed Approach with Qualitative Validation and Preliminary Quantitative Analysis-Journal of Sustainability Research-CSCIED科技核心评价数据库-手机版

Development and Validation of a Questionnaire for Assessing Sustainability in Sporting Events in Natural Areas: A Mixed Approach with Qualitative Validation and Preliminary Quantitative Analysis

Development and Validation of a Questionnaire for Assessing Sustainability in Sporting Events in Natural Areas: A Mixed Approach with Qualitative Validation and Preliminary Quantitative Analysis

ES评分 0 浏览量：214 下载量：0

全文阅读下载引用收藏

DOI	10.20900/jsr20250055
刊名	Journal of Sustainability Research JSR
年，卷(期)	2025, 7(3)
作者	Maira Ulloa-Hernández*,Jordi Seguí-Urbaneja,Estela I. Farías-Torbidoni,
作者单位	National Institut of Physical Education of Catalonia (INEFC), University of Lleida (UdL), Lleida 25003, Spain ;
摘要	This study presents the development and validation of a questionnaire to measure sustainability in the organization of sports events in natural areas. The research was structured into three studies: (i) item generation and validation (ii) pre-testing, and (iii) preliminary reliability assessment. In Study 1, items were generated based on a literature review. A panel of experts evaluated the items to ensure their content validity. In Study 2, cognitive interviews were conducted with sports event organizers to assess the clarity and understanding of the items. In Study 3, a preliminary reliability analysis was carried out to evaluate the internal consistency of the questionnaire. The final result was the validation of 44 items across 7 dimensions. These items were classified into non-mandatory items validated in the qualitative process and non-mandatory items validated in the quantitative process. The questionnaire provides a useful tool for event organizers to assess and improve their sustainability practices.
Abstract	This study presents the development and validation of a questionnaire to measure sustainability in the organization of sports events in natural areas. The research was structured into three studies: (i) item generation and validation (ii) pre-testing, and (iii) preliminary reliability assessment. In Study 1, items were generated based on a literature review. A panel of experts evaluated the items to ensure their content validity. In Study 2, cognitive interviews were conducted with sports event organizers to assess the clarity and understanding of the items. In Study 3, a preliminary reliability analysis was carried out to evaluate the internal consistency of the questionnaire. The final result was the validation of 44 items across 7 dimensions. These items were classified into non-mandatory items validated in the qualitative process and non-mandatory items validated in the quantitative process. The questionnaire provides a useful tool for event organizers to assess and improve their sustainability practices.
关键词	sustainability; sports events; natural areas; event organizers; validation questionnaire
KeyWord	sustainability; sports events; natural areas; event organizers; validation questionnaire
基金项目
页码	-

参考文献
相关文献

1.Malchrowicz-Mośko E, Botiková Z, Poczta J. “Because we don’t want to run in smog”: Problems with the sustainable management of sport event tourism in protected areas (A case study of national parks in Poland and Slovakia). Sustainability. 2019;11(2):325. doi: 10.3390/su11020325.
2.Sumanapala D, Wolf ID. Think globally, act locally: Current understanding and future directions for nature-based tourism research in Sri Lanka. J Hosp Tour Manag. 2020;45:295-308. doi: 10.1016/j.jhtm.2020.08.009.
3.Botella-Carrubi D, Móstoles R, Escriva-Beltran M. Penyagolosa trails: From ancestral roads to sustainable ultra-trail race, between spirituality, nature, and sports. A case of study. Sustainability. 2019;11:6605. doi: 10.3390/su11236605.
4.Newsome D, Lacroix C. Changing recreational emphasis and the loss of 'natural experiences’ in protected areas: An issue that deserves consideration, dialogue, and investigation. J Tour Leis Stud. 2011;17:315-34. doi: 10.6267/JTLS.2011.17(2)9.
5.Heck S. Assessing the ecological impact of ultramarathon events in protected natural sites: ‘Le Grand Raid Réunion’. Heritage. 2019;2(1):621-39. doi: 10.3390/heritage2010048.
6.Graefe A, Mueller J, Taff B, Wimpey J. A comprehensive method for evaluating the impacts of race events on protected lands. Soc Nat Resour. 2019;32(11):1155-70. doi: 10.1080/08941920.2019.1583396.
7.McCullough B, Orr M, Watanabe N. Measuring externalities: The imperative next step to sustainability assessment in sport. J Sport Manag. 2020;1:1-10. doi: 10.1123/jsm.2019-0254.
8.Tomino A, Perić M, Wise N. Assessing and considering the wider impacts of sport-tourism events: A research agenda review of sustainability and strategic planning elements. Sustainability. 2020;12(11):4473. doi: 10.3390/su12114473.
9.Wise N, Perić M, Ðurkin J. Benchmarking service delivery for sports tourism and events: Lessons for Gorski kotar, Croatia from Pokljuka, Slovenia. Eur J Tour Res. 2019;22:107-28.
10.Legido J, Ruiz J, Brito E, Navarro R, Navarro M. Pekín 2008 ¿Juegos Olímpicos verdes? Canarias Med Quirúrg. 2008;6(16):36-46.
11.Fermeglia M. The show must be green: Hosting mega-sporting events in the climate change context. Carbon Clim Law Rev. 2017;11(2):100-9.
12.International Olympic Committee. Olympism365—Strengthening the Role of Sport as An Enabler of the SDGs. Lausanne (Switzerland): International Olympic Committee; 2022. Available from: https://olympics.com/ioc/olympism365. Accessed 24 Jul 2025.
13.United Nations Environment Programme. Sports for Nature: Setting a Baseline—Handbook. Nairobi (Kenya): UNEP; 2022. Available from: https://www.unep.org/resources/publication/sports-nature-setting-baseline-handbook. Accessed 18 May 2025.
14.Vu HM, Ngo VM. Strategy development from triangulated viewpoints for a fast-growing destination toward sustainable tourism development—a case of Phu Quoc Islands in Vietnam. J Tour Serv. 2019;10(18):117-40.
15.Zielińska A. Sustainable development as a determinant of functioning the valuable natural areas. Econ Sociol. 2010;3:161-72. doi: 10.14254/2071-789X.2010/3-1A/11.
16.Scrucca F, Severi C, Galvan N, Brunori A. A new method to assess the sustainability performance of events: Application to the 2014 World Orienteering Championship. Environ Impact Assess Rev. 2016;56:1-11. doi: 10.1016/j.eiar.2015.08.002.
17.Jones C. Assessing the impact of a major sporting event: The role of environmental accounting. Tour Econ. 2008;14:343-60. doi: 10.5367/000000008784460382.
18.Hugaerts I, Scheerder J, Helsen K, Corthouts J, Thibaut E, Könecke T. Sustainability in participatory sports events: The development of a research instrument and empirical insights. Sustainability. 2021;13(16):6034. doi: 10.3390/su13116034.
19.Zhang Y, Park K. How to develop a sustainable and responsible hallmark sporting event?—Experiences from the Tour of Qinghai Lake International Road Cycling Race, using IPA method. Int J Tour Sci. 2015;15:59-69. doi: 10.1080/15980634.2015.1118877.
20.Scott D, Steiger R, Rutty M, Fang Y. The changing geography of the Winter Olympic and Paralympic Games in a warmer world. Curr Issues Tour. 2019;22:1301-11. doi: 10.1080/13683500.2018.1436161.
21.Lim D, Park S. A study of measures for sustainable sport. Sustainability. 2023;15(17):12732. doi: 10.3390/su151712732.
22.Perić M, Đurkin J, Wise N. Leveraging small-scale sport events: Challenges of organising, delivering, and managing sustainable outcomes in rural communities, the case of Gorski Kotar, Croatia. Sustainability. 2016;8(12):1337.
23.Golob A, Lesjak M, Fabjan D, Jere-Jakulin T, Stamenković I. Assessment of sustainability of sports events (Slovenia). Turizam. 2015;19(2):71-83. doi: 10.5937/TURIZAM1502071G.
24.Vrondou O, Dimitropoulos P, Gaitanakis L. International sports bodies’ application of ecological sustainability mechanisms affecting sport tourism related natural environment. In: Katsoni V, Spyriadis T, editors. Smart tourism as a driver for culture and sustainability. Cham (Switzerland): Springer; 2019. p. 373-83. doi: 10.1007/978-3-030-03910-3_33.
25.Trendafilova S, McCullough B, Pfahl M, Nguyen S, Casper J, Picariello M. Environmental sustainability in sport: Current state and future trends. Glob J Adv Pure Appl Sci. 2014;3(1):9-14.
26.Brownlie S, Bull JW, Stubbs D. Mitigating Biodiversity Impacts of Sports Events. Gland (Switzerland): IUCN; 2020. Available from: https://doi.org/10.2305/IUCN.CH.2020.04.en. Accessed 24 Jul 2025.
27.Mallen C, Stevens J, Adams L, McRoberts S. The assessment of the environmental performance of an international multi-sport event. Eur Sport Manag Q. 2010;10:122-97. doi: 10.1080/16184740903460488.
28.Nazari L, Moghaddam K. The relationship between environmental knowledge and sport event organizers’ support for sustainable management in sport. NASS. 2019;1:109-20. doi: 10.22054/NASS.2019.10538.
29.McCullough B. Advancing sport ecology research on sport and the natural environment. Sport Manag Rev. 2023;26:813-33. doi: 10.1080/14413523.2023.2260078.
30.Tashakkori A, Teddlie C. Integrating qualitative and quantitative approaches to research. In: Bickman L, Rog DJ, editors. The SAGE Handbook of Applied Social Research Methods. 2nd ed. Thousand Oaks (CA, US): SAGE Publications, Inc.; 2009. p. 283-317.
31.Lein JK. Futures research and environmental sustainability: Theory and method. Abingdon (UK): Taylor & Francis; 2017.
32.American Educational Research Association, American Psychological Association, National Council on Measurement in Education. The Standards for Educational and Psychological Testing. Washington (DC, US): American Psychological Association; 2014.
33.Ulloa-Hernández M, Farías-Torbidoni EI, Seguí-Urbaneja J. Sustainable practices in the organization of sporting events in protected and unprotected natural areas: A scoping review. Manag Sport Leisure. 2024;1-24. doi: 10.1080/23750472.2024.2381588.
34.Maloney P, Grawitch MJ, Barber LK. Strategic item selection to reduce survey length: Reduction in validity? Consult Psychol J Pract Res. 2011;63(3):162-75.
35.Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best practices for developing and validating scales for health, social, and behavioral research: A primer. Front Public Health. 2018;6:149. doi: 10.3389/fpubh.2018.00149.
36.Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1975;28(4):563-75.
37.Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459-67. doi: 10.1002/nur.20195.
38.Almanasreh E, Moles R, Chen T. Evaluation of methods used for estimating content validity. Res Social Adm Pharm. 2019;15:214-21. doi: 10.1016/j.sapharm.2018.03.066.
39.Kline P. A handbook of psychological testing. 2nd ed. London (UK): Routledge; Taylor & Francis Group; 1993.
40.Schinka JA, Velicer WF, Weiner IR. Handbook of psychology. Vol. 2: Research methods in psychology. Hoboken (NJ, US): John Wiley & Sons, Inc.; 2012.
41.Haynes SN, Richard DCS, Kubany ES. Content validity in psychological assessment: A functional approach to concepts and methods. Psychol Assess. 1995;7(3):238-47. doi: 10.1037/1040-3590.7.3.238.
42.Beatty PC, Willis GB. Research synthesis: The practice of cognitive interviewing. Public Opin Q. 2007;71:287-311. doi: 10.1093/poq/nfm006.
43.Morales Vallejo P. Guide for Constructing Questionnaires and Scales of Attitudes. Guatemala: Universidad Rafael Landívar; 2011. Available from: https://abacoenred.org/wp-content/uploads/2019/02/Construcción-de-cuestionarios-y-escalas-Morales-V.-Pedro-2011.pdf.pdf. Accessed 18 May 2025.
44.Willis GB. Analysis of the cognitive interview in questionnaire design. New York (NY, US): Oxford University Press; 2015.
45.Tourangeau R. Cognitive aspects of survey measurement and mismeasurement. Int J Public Opin Res. 2003;15:3-7. doi: 10.1093/ijpor/15.1.3.
46.Knafl K, Deatrick J, Gallo A, Holcombe G, Bakitas M, Dixon J, et al. The analysis and interpretation of cognitive interviews for instrument development. Res Nurs Health. 2007;30(2):224-34. doi: 10.1002/nur.20195.
47.Aczel B, Szaszi B, Nilsonne G, van den Akker OR, Albers CJ, van Assen MALM, et al. Consensus-based guidance for conducting and reporting multi-analyst studies. eLife. 2021;10:e72185. doi: 10.7554/eLife.72185.
48.Urquidi VAP, Morquecho-Sánchez R, Espejel HAP, Cavazos EAG, Morales-Sánchez V, García JAP. Design and validation of the perceived quality evaluation questionnaire in the management of women's football. Cuad Psicol Deporte. 2024;24(1):200-15.
49.Blázquez A. Design and validation of a questionnaire to analyze quality among employees of public sports services in municipal associations in Extremadura. J Sport Sci. 2011;7(3):181-92.
50.Huang Y, Hsu CM, Zhang JJ. Indicators for measuring effectiveness and impact of international sporting events in Taiwan. Sport Soc. 2024;27(2):260-77. doi: 10.1080/17430437.2023.2221643.
51.Arksey H, O’Malley L. Scoping studies: Towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19-32. doi: 10.1080/1364557032000119616.
52.Blaikie N. Designing social research: The logic of anticipation. Cambridge (UK): Polity Press; 2000.
53.DeVellis RF. Scale development: Theory and applications. 4th ed. Thousand Oaks (CA, US): Sage Publications; 2017.
54.Kiani MS, Nazari L. Sustainable development and environmental protection at international sporting events. J Humanit Insights. 2021;5(3):25-33. doi: 10.22034/JHI.2021.291241.1027.
55.Li X. Critical analysis of the correlation between sport events and the environment. Proc Int Conf Glob Polit Socio-Humanities. 2023;32:37-42. doi: 10.54254/2753-7048/32/20230617.
56.Rozhdestvenskaya L, Cherednichenko L, Malchugova K, Korotenko V. Development of a sustainable environmentally friendly waste management system at large mass and sports events (2023 WJC in Novosibirsk). E3S Web Conf. 2021;296:02010. doi: 10.1051/e3sconf/202129602010.
57.Trail GT, McCullough BP. A longitudinal study of sustainability attitudes, intentions, and behaviors. Sustain Sci. 2021;16:1503-18. doi: 10.1007/s11625-021-00954-7.
58.Morgan H, Bush A, McGee D. The contribution of sport to the sustainable development goals: Insights from Commonwealth Games associations. J Sport Dev. 2021;9(2):14-29.
59.Chirieleison C, Montrone A, Scrucca L. Event sustainability and sustainable transportation: A positive reciprocal influence. J Sustain Tour. 2019;28(2):240-62. doi: 10.1080/09669582.2019.1607361.
60.Wilby RL, Orr M, Depledge D, Giulianotti R, Havenith G, Kenyon JA, et al. The impacts of sport emissions on climate: Measurement, mitigation, and making a difference. Ann N Y Acad Sci. 2023;1519(1):20-33.
61.Farías Torbidoni EI. Minimización de los impactos medioambientales en los eventos deportivos en el medio natural: Las marchas de bicicleta todo terreno. Apunts Educ Fís Deporte. 2015;122(4):68-80. doi: 10.5672/apunts.2014-0983.es.
62.Sánchez-Sáez JA, Segado-Sáegado F, Calabuig-Moreno F, Gallardo Guerrero AM. Measuring residents’ perceptions of corporate social responsibility at small- and medium-sized sports events. Int J Environ Res Public Health. 2020;17(23):8798. doi: 10.3390/ijerph17238798.

引用本文

Maira Ulloa-Hernández*,Jordi Seguí-Urbaneja,Estela I. Farías-Torbidoni. Development and Validation of a Questionnaire for Assessing Sustainability in Sporting Events in Natural Areas: A Mixed Approach with Qualitative Validation and Preliminary Quantitative Analysis [J]. Journal of Sustainability Research. 2025; 7; (3). - .

文献评论

相关学者

相关机构