Strengths and Limitations of an Online Qualitative Survey in Times of Social Crisis: Example of the COVID-19 Pandemic

Beata Bielska; Katarzyna Kalinowska; Sylwia Męcfal; Adrianna Surmiak

doi:10.18778/1733-8077.20.4.04

Authors

Beata Bielska Nicolaus Copernicus University in Toruń, Poland https://orcid.org/0000-0002-5458-2435
Katarzyna Kalinowska Educational Research Institute, Warsaw, Poland; Collegium Civitas, Poland https://orcid.org/0000-0003-2657-6107
Sylwia Męcfal University of Lodz, Poland https://orcid.org/0000-0002-2063-7207
Adrianna Surmiak University of Warsaw, Poland https://orcid.org/0000-0001-5971-8533

DOI:

https://doi.org/10.18778/1733-8077.20.4.04

Keywords:

(Online) Qualitative Survey (OQS), (Qualitative) Questionnaire, Open-Ended Questions, Non-Standardized Qualitative Written Accounts, COVID-19 Pandemic

Abstract

The aim of the article is to argue that an online qualitative survey (OQS) is a useful research technique that is feasible to apply during a social crisis such as the COVID-19 pandemic. An OQS has an unclear status in the spectrum of research techniques, as it combines features of quantitative and qualitative research, and there is little recognition in the literature of its advantages and disadvantages in the context of other research techniques used during a social crisis. We describe our research experiences of using this technique and the experiences of our survey participants. We also compare the strengths and limitations of using an OQS during the COVID-19 pandemic against other techniques used at the time.

Downloads

Download data is not yet available.

Author Biographies

Beata Bielska, Nicolaus Copernicus University in Toruń, Poland

Beata Bielska is a sociologist conducting qualitative and quantitative research, an assistant professor, and has an M.A. in management studies. Her research interests include plagiarism and cheating in higher education, methodological and ethical aspects of social sciences, and the sociology of sexuality.

Katarzyna Kalinowska, Educational Research Institute, Warsaw, Poland; Collegium Civitas, Poland

Katarzyna Kalinowska is a sociologist doing qualitative research and an assistant professor. Her research interests include the sociology of love and emotions, youth studies, and research integrity and ethics.

Sylwia Męcfal, University of Lodz, Poland

Sylwia Męcfal is a sociologist and an assistant professor. Her interests focus on methods of social research (particularly qualitative), research ethics, and media studies.

Adrianna Surmiak, University of Warsaw, Poland

Adrianna Surmiak is a sociologist and social anthropologist and an assistant professor. She is interested in research ethics, qualitative social methodology, the sociology of emotions, and the sociology of morality.

References

Allen, Louisa. 2023. “The Smell of Lockdown: Smellwalks as Sensuous Methodology.” Qualitative Research 23(1):21-37.
Google Scholar DOI: https://doi.org/10.1177/14687941211007663

Aluko, Folake Ruth and Mary Atieno Ooko. 2022. “Enhancing the Digital Literacy Experience of Teachers to Bolster Learning in the 21st Century.” Journal of Learning for Development 9(3):420-35.
Google Scholar DOI: https://doi.org/10.56059/jl4d.v9i3.662

Babbie, Earl. 2014. The Practice of Social Research. Boston: Cengage Learning.
Google Scholar

Boulton, Elicia and Victoria Clarke. 2024. “‘One Dead Bedroom’: Exploring the Lived Experience of Sex and Sexuality for Women with Self-Reported Obsessive-Compulsive Disorder.” Psychology & Sexuality February:1-17.
Google Scholar DOI: https://doi.org/10.1080/19419899.2024.2321147

Bouziane, Zaid et al. 2020. “Teaching Outside Your Area of Expertise: An Opportunity for Professional Development.” Journal of Further and Higher Education 45(5):629-640.
Google Scholar DOI: https://doi.org/10.1080/0309877X.2020.1804538

Börner, Susanne, Peter Kraftl, and Leandro L. Giatti. 2023. “More Than Participatory? From ‘Compensatory’ towards ‘Expressive’ Remote Practices Using Digital Technologies.” Qualitative Research 24(2). doi: https://doi.org/10.1177/14687941231165882.
Google Scholar DOI: https://doi.org/10.1177/14687941231165882

Braun, Virginia, Victoria Clarke, and Debra Gray. 2017. “Innovations in Qualitative Methods.” Pp. 243-266 in The Palgrave Handbook of Critical Social Psychology, edited by B. Gough. London: Palgrave Macmillan.
Google Scholar DOI: https://doi.org/10.1057/978-1-137-51018-1_13

Braun, Virginia, Gemma Tricklebank, and Victoria Clarke. 2013. “‘It Shouldn’t Stick Out from Your Bikini at the Beach’: Meaning, Gender, and the Hairy/Hairless Body.” Psychology of Women Quarterly 37(4):478-493.
Google Scholar DOI: https://doi.org/10.1177/0361684313492950

Braun, Virginia et al. 2020. “The Online Survey as a Qualitative Research Tool.” International Journal of Social Research Methodology 16(1-2):1-16.
Google Scholar

Canda, Edward R., Mitsuko Nakashima, and Leola D. Furman. 2004. “Ethical Considerations about Spirituality in Social Work: Insights from a National Qualitative Survey.” Families in Society 85(1):27-35.
Google Scholar DOI: https://doi.org/10.1606/1044-3894.256

Clarke, Victoria. 2016. “Wearing a Gay Slogan T-Shirt in the Higher Education Classroom: A Cautionary Tale.” Feminism and Psychology 26(1):3-10.
Google Scholar DOI: https://doi.org/10.1177/0959353515613812

Clarke, Victoria and Eleni Demetriou. 2016. “‘Not a Big Deal?’: Exploring the Accounts of Adult Children of Lesbian, Gay and Trans Parents.” Psychology and Sexuality 7(2):131-148.
Google Scholar DOI: https://doi.org/10.1080/19419899.2015.1110195

Creswell, John W. and Vicki L. Plano Clark. 2017. Designing and Conducting Mixed Methods Research. Thousand Oaks, CA: Sage.
Google Scholar

Daniels, Emily, Emily Arden-Close, and Andrew Mayers. 2020. “Be Quiet and Man Up: A Qualitative Questionnaire Study into Fathers Who Witnessed Their Partner’s Birth Trauma.” BMC Pregnancy Childbirth 236. doi: https://doi.org/10.1186/s12884-020-02902-2
Google Scholar DOI: https://doi.org/10.21203/rs.2.16974/v4

Davey, Louise, Victoria Clarke, and Elisabeth Jenkinson. 2019. “Living with Alopecia Areata: An Online Qualitative Survey Study.” British Journal of Dermatology 180(6):1377-1389.
Google Scholar DOI: https://doi.org/10.1111/bjd.17463

Denzin, Norman K. and Michael D. Giardina, eds. 2012. Qualitative Inquiry and the Politics of Advocacy. London, New York: Routledge.
Google Scholar

Doliński, Wojciech and Jerzy Żurko. 2016. “Wybrane problemy statusu poznawczego tekstów pisanych – wprowadzenie [Selected Problems of the Cognitive Status of Written Texts—Introduction].” Pp. 7-30 in Rzeczywistość i zapis. Problemy badania tekstów w naukach społecznych i humanistycznych [Reality and Record: Problems of Textual Research in the Social Sciences and Humanities], edited by W. Doliński et al. Lodz: Wydawnictwo Uniwersytetu Łódzkiego.
Google Scholar DOI: https://doi.org/10.18778/7969-659-8.01

Eggeling, Kristin A. 2023. “Embracing the ‘Inverted Commas,’ or How COVID-19 Can Show Us New Directions for Ethnographic ‘Fieldwork’”. Qualitative Research 23(5):1342-1358.
Google Scholar DOI: https://doi.org/10.1177/14687941221096594

Estrada-Jaramillo, Ana, Mike Michael, and Hannah Farrimond. 2023. “Absence, Multiplicity and the Boundaries of Research? Reflections on Online Asynchronous Focus Groups.” Qualitative Research 23(6):1669-1688.
Google Scholar DOI: https://doi.org/10.1177/14687941221110169

Feijt, Milou et al. 2020. “Mental Health Care Goes Online: Practitioners’ Experiences of Providing Mental Health Care during the COVID-19 Pandemic.” Cyberpsychology, Behavior, and Social Networking 23(12):860-864.
Google Scholar DOI: https://doi.org/10.1089/cyber.2020.0370

Fernholm, Rita et al. 2020. “Patient and Provider Perspectives on Reducing Risk of Harm in Primary Health Care: A Qualitative Questionnaire Study in Sweden.” Scandinavian Journal of Primary Health Care 38(1):66-74.
Google Scholar DOI: https://doi.org/10.1080/02813432.2020.1717095

Frith, Hannah and Kate Gleeson. 2008. “Dressing the Body: The Role of Clothing in Sustaining Body Pride and Managing Body Distress.” Qualitative Research in Psychology 5(4):249-264.
Google Scholar DOI: https://doi.org/10.1080/14780880701752950

Gallant, Agatha, Jennifer Watermeyer, and Cynthia Sawasawa. 2023. “Experiences of South African Speech-Language Therapists Providing Telepractice during the COVID-19 Pandemic: A Qualitative Survey.” International Journal of Language and Communication Disorders 58(5):1468-1480.
Google Scholar DOI: https://doi.org/10.1111/1460-6984.12872

Grogan, Sarah and Jayne Mechan. 2017. “Body Image after Mastectomy: A Thematic Analysis of Younger Women’s Written Accounts.” Journal of Health Psychology 22(11):1480-1490.
Google Scholar DOI: https://doi.org/10.1177/1359105316630137

Groves, Robert M. et al. 2004. Survey Methodology. Hoboken, NJ: John Wiley and Sons.
Google Scholar

Grung, Ina et al. 2022. “Patient Experiences with Depression Care in General Practice: A Qualitative Questionnaire Study.” Scandinavian Journal of Primary Health Care 40(2):253-260.
Google Scholar DOI: https://doi.org/10.1080/02813432.2022.2074069

Hanna, Esmée and Brendan Gough. 2020. “The Social Construction of Male Infertility: A Qualitative Questionnaire Study of Men with a Male Factor Infertility Diagnosis.” Sociology of Health and Illness 42(3):465-480.
Google Scholar DOI: https://doi.org/10.1111/1467-9566.13038

Harvey, Emily et al. 2024. “‘Context and Safety Are Everything’: Exploring How Pansexual Individuals Mark and Express Their Identity.” Journal of Bisexuality July 1:21.
Google Scholar DOI: https://doi.org/10.1080/15299716.2024.2376878

Hayfield, Nikki, Hannah Moore, and Gareth Terry. 2024. “‘Friends? Supported. Partner? Not So Much…’: Women’s Experiences of Friendships, Family, and Relationships during Perimenopause and Menopause.” Feminism & Psychology 34(3):443-463.
Google Scholar DOI: https://doi.org/10.1177/09593535241242563

Howlett, Marnie. 2022. “Looking at the ‘Field’ through a Zoom Lens: Methodological Reflections on Conducting Online Research during a Global Pandemic.” Qualitative Research 22(3):387-402.
Google Scholar DOI: https://doi.org/10.1177/1468794120985691

Jansen, Harrie. 2010. “The Logic of Qualitative Survey Research and Its Position in the Field of Social Research Methods (63 paragraphs).” Forum Qualitative Sozialforschung/Forum: Qualitative Social Research 11(2): Art. 11. Retrieved March 18, 2024 http://nbn-resolving.de/urn:nbn:de:0114-fqs1002110
Google Scholar

Jowett, Adam and Elisabeth Peel. 2009. “Chronic Illness in Non-Heterosexual Contexts: An Online Survey of Experiences.” Feminism and Psychology 19(4):454-474.
Google Scholar DOI: https://doi.org/10.1177/0959353509342770

Kalinowska, Katarzyna et al. 2022. “Czy badać? Co badać? Jak badać? Strategie badawcze w naukach społecznych i humanistycznych w pierwszej fali COVID-19 [To Conduct Research or Not? What Kind of Research? And How? Research Strategies of Social and Humanities Researchers during the First Wave of the COVID-19 Pandemic].” Przegląd Socjologii Jakościowej 18(4):34-59.
Google Scholar DOI: https://doi.org/10.18778/1733-8069.18.4.02

Konecki, Krzysztof T. 2020. “Uwagi na temat tego, co jest postrzegane jako ważne i nieważne w socjologii [Remarks about What Is Considered as Important and Unimportant in Sociology].” Przegląd Socjologii Jakościowej 16(2):188-207.
Google Scholar DOI: https://doi.org/10.18778/1733-8069.16.2.11

Krajewski, Marek et al. 2021. “The Bright Side of the Crisis. The Positive Aspects of the COVID-19 Pandemic according to the Poles.” European Societies 23(1):S777-S790.
Google Scholar DOI: https://doi.org/10.1080/14616696.2020.1836387

LaMarre, Andrea, Kelsey Gilbert, and Pamela A. Scalise. 2023. “What Are We Aiming For? Exploring Tensions in Healthcare Provider Perspectives on and Communications about Eating Disorder Recovery.” Feminism & Psychology 33(4):622-646.
Google Scholar DOI: https://doi.org/10.1177/09593535221141712

Lawrence, Leigh. 2022. “Conducting Cross-Cultural Qualitative Interviews with Mainland Chinese Participants during COVID: Lessons from the Field.” Qualitative Research 22(1):154-165.
Google Scholar DOI: https://doi.org/10.1177/1468794120974157

Lutyński, Jan. 1969. “Analysis and Classification of Data Collecting Techniques.” The Polish Sociological Bulletin 20(1969):70-94.
Google Scholar

Łukianow, Małgorzata et al. 2021. “Poles in the Face of Forced Isolation. A Study of the Polish Society during the COVID-19 Pandemic Based on ‘Pandemic Diaries’ Competition.” European Societies 23(sup1):S844-S858.
Google Scholar DOI: https://doi.org/10.1080/14616696.2020.1841264

Marzi, Sonja. 2023. “Participatory Video from a Distance: Co-Producing Knowledge during the COVID-19 Pandemic Using Smartphones.” Qualitative Research 23(3):509-525.
Google Scholar DOI: https://doi.org/10.1177/14687941211038171

Meskell, Pauline, Catherine Houghton, and Linda Biesty. 2021. “Opening Windows Behind Closed Doors: Reflections on Working Qualitatively during a Pandemic.” International Journal of Qualitative Methods 20:1-4.
Google Scholar DOI: https://doi.org/10.1177/16094069211008313

Męcfal, Sylwia et al. 2020. “Badania społeczne i humanistyczne w czasach pandemii – aspekty etyczno-metodologiczne. Dyskusja podczas ‘Spotkań Badaczek’ [Social and Humanistic Research during the Pandemic—Ethical and Methodological Issues. The Discussion during ‘Spotkania Badaczek’].” Przegląd Socjologiczny 69(3):203-214.
Google Scholar DOI: https://doi.org/10.26485/PS/2020/69.3/10

Opperman, Emily et al. 2014. “‘It Feels So Good It Almost Hurts’: Young Adults’ Experiences of Orgasm and Sexual Pleasure.” The Journal of Sex Research 51(5):503-515.
Google Scholar DOI: https://doi.org/10.1080/00224499.2012.753982

Patton, Michael Q. 2014. Qualitative Research and Evaluation Methods. Thousand Oaks, CA: Sage.
Google Scholar

Peel, Elisabeth. 2010. “Pregnancy Loss in Lesbian and Bisexual Women: An Online Survey of Experiences.” Human Reproduction 25(3):721-727.
Google Scholar DOI: https://doi.org/10.1093/humrep/dep441

Polish Sociological Association. 2012. Kodeks etyki socjologa [The Sociologist’s Code of Ethics]. Retrieved March 18, 2024 http://pts.org.pl/wp-content/uploads/2016/04/kodeks.pdf
Google Scholar

Prosen, Mirko. 2022. “Nursing Students’ Perception of Gender-Defined Roles in Nursing: A Qualitative Descriptive Study.” BMC Nursing 21: Art. 104. doi: https://doi.org/10.1186/s12912-022-00876-4
Google Scholar DOI: https://doi.org/10.1186/s12912-022-00876-4

Radzińska, Jowita. 2022. “Między elastycznością a spójnością – wykorzystanie metod asynchronicznych w jakościowym badaniu podłużnym realizowanym w trakcie pandemii COVID-19 [Between Flexibility and Consistency: Using Asynchronous Methods within a Qualitative Longitudinal Research Conducted during the Pandemic].” Przegląd Socjologii Jakościowej 18(3):10-31.
Google Scholar DOI: https://doi.org/10.18778/1733-8069.18.3.02

Rahman, Syahirah A. et al. 2021. “Resilient Research in the Field: Insights and Lessons from Adapting Qualitative Research Projects during the COVID-19 Pandemic.” International Journal of Qualitative Methods 20. doi: https://doi.org/10.1177/16094069211016106
Google Scholar DOI: https://doi.org/10.1177/16094069211016106

Recall bias. n.d. Retrieved March 18, 2024 https://dimewiki.worldbank.org/Recall_Bias
Google Scholar

Rivano Eckerdal, Johanna and Charlotte Hagström. 2017. “Qualitative Questionnaires as a Method for Information Studies Research.” Information Research 22(1): CoLIS paper 1639. Retrieved March 18, 2024 http://informationr.net/ir/22-1/colis/colis1639.html
Google Scholar

Roy, Rituparna and Shinya Uekusa. 2020. “Collaborative Autoethnography: ‘Self-Reflection’ as a Timely Alternative Research Approach during the Global Pandemic.” Qualitative Research Journal 20(4):383-392.
Google Scholar DOI: https://doi.org/10.1108/QRJ-06-2020-0054

Seixas, Brayan V., Neale Smith, and Craig Mitton. 2018. “The Qualitative Descriptive Approach in International Comparative Studies: Using Online Qualitative Surveys.” International Journal of Health Policy Management 7(9):778-781.
Google Scholar DOI: https://doi.org/10.15171/ijhpm.2017.142

Smith, Emma M. et al. 2022. “Assistive Technology Use and Provision during COVID-19: Results from a Rapid Global Survey.” International Journal of Health Policy and Management 11(6):747-756.
Google Scholar

Surmiak, Adrianna, Beata Bielska, and Katarzyna Kalinowska. 2022. “Social Researchers’ Approaches to Research Ethics During the COVID-19: An Exploratory Study.” Journal of Empirical Research on Human Research Ethics 17(1-2):213-222.
Google Scholar DOI: https://doi.org/10.1177/15562646211055056

Tackie, Hilary N. 2022. “(Dis)Connected: Establishing Social Presence and Intimacy in Teacher-Student Relationships during Emergency Remote Learning.” AERA Open 8. doi: https://doi.org/10.1177/23328584211069525
Google Scholar DOI: https://doi.org/10.1177/23328584211069525

‘t Hart, Dorinda. 2021. “COVID Times Make ‘Deep Listening’ Explicit: Changing the Space between Interviewer and Participant.” Qualitative Research 23(2):306-322.
Google Scholar DOI: https://doi.org/10.1177/14687941211027780

Terry, Gareth and Virginia Braun. 2013. “To Let Hair Be, or to Not Let Hair Be? Gender and Body Hair Removal Practices in Aotearoa/New Zealand.” Body Image 10(4):599-606.
Google Scholar DOI: https://doi.org/10.1016/j.bodyim.2013.07.001

Terry, Gareth and Virginia Braun. 2016. “‘I Think Gorilla-Like Back Effusions of Hair Are Rather a Turn-Off’: ‘Excessive Hair’ and Male Body Hair (Removal) Discourse.” Body Image 17:14-24.
Google Scholar DOI: https://doi.org/10.1016/j.bodyim.2016.01.006

Terry, Gareth and Virginia Braun. 2017. “Short But Often Sweet: The Surprising Potential of Qualitative Survey Methods.” Pp. 15-44 in Collecting Qualitative Data: A Practical Guide to Textual, Media and Virtual Techniques, edited by V. Braun, V. Clarke, and D. Gray. Cambridge: Cambridge University Press.
Google Scholar

Thomas, Samantha L. et al. 2024. “Methodological and Practical Guidance for Designing and Conducting Online Qualitative Surveys in Public Health.” Health Promotion International 39(3): daae061. doi: https://doi.org/10.1093/heapro/daae061
Google Scholar DOI: https://doi.org/10.1093/heapro/daae061

Timans, Rob, Paul Wouters, and Johan Heilbron. 2019. “Mixed Methods Research: What It Is and What It Could Be.” Theory and Society 48:193-216.
Google Scholar DOI: https://doi.org/10.1007/s11186-019-09345-5

Toerien, Merran and Sue Wilkinson. 2004. “Exploring the Depilation Norm: A Qualitative Questionnaire Study of Women’s Body Hair Removal.” Qualitative Research in Psychology 1:69-92.
Google Scholar

Tripp, Jennifer N. and Xiufeng Liu. 2024. “Towards Defining STEM Professional Identity: A Qualitative Survey Study.” Journal for STEM Education Research. doi: https://doi.org/10.1007/s41979-024-00131-2
Google Scholar DOI: https://doi.org/10.1007/s41979-024-00131-2

Turner, Amanda J. and Adrian Coyle. 2000. “What Does It Mean to Be a Donor Offspring? The Identity Experiences of Adults Conceived by Donor Insemination and the Implications for Counselling and Therapy.” Human Reproduction 15(9):2041-2051.
Google Scholar DOI: https://doi.org/10.1093/humrep/15.9.2041

van Prooijen, Jan-Willem and Karen M. Douglas. 2017. “Conspiracy Theories as Part of History: The Role of Societal Crisis Situations.” Memory Studies 10(3):323-333.
Google Scholar DOI: https://doi.org/10.1177/1750698017701615

Whelan, Emma. 2007. “‘No One Agrees Except for Those of Us Who Have It’: Endometriosis Patients as an Epistemological Community.” Sociology of Health and Illness 29(7):957-982.
Google Scholar DOI: https://doi.org/10.1111/j.1467-9566.2007.01024.x

Willis, Rebecca et al. 2023. “Taking Deliberative Research Online: Lessons from Four Case Studies.” Qualitative Research 23(4):921-939.
Google Scholar DOI: https://doi.org/10.1177/14687941211063483