The Possibilities of Using Crowdsourcing in Science to Operationalize a Research Problem in Research on Higher Education
DOI:
https://doi.org/10.18778/1733-8069.20.3.08Keywords:
crowdsourcing, crowdsourcing in science, operationalization, higher education, qualitative researchAbstract
The operationalization of a research problem is a constitutive stage of the process of implementing any scientific research. However, carrying operationalization out is a challenge for the researcher, because it requires good, complete, and up-to-date knowledge of the analyzed issues. Therefore, researchers are increasingly encouraged to look for ways or procedures that make it possible to search, clarify, and understand in a multi-aspect manner phenomena that may become the subject of empirical research. This is particularly important in the context of research on higher education, which requires a qualitative approach. Crowdsourcing in science has entered the popularization phase and seems to be promising in the context of the operationalization of any research problem. The aim of this article is to present a proposal for the use of crowdsourcing in science as an auxiliary (supplementary) procedure at the stage of the operationalization of the research problem and to consider its effectiveness in the context of research on higher education.
Downloads
References
Afuah Allan, Tucci Christopher L. (2012), Crowdsourcing As a Solution to Distant Search, „Academy of Management Review”, vol. 37(3), s. 355–375, https://doi.org/10.5465/amr.2010.0146
Google Scholar
Afuah Allan, Tucci Christopher L., Viscusi Gianluigi (2018), Creating and capturing value through crowdsourcing, London: Oxford University Press.
Google Scholar
Aga Firdissa Jebessa (2022), Determinants of Academic Research Quality: The Case at Three Ethiopian Universities, „SSRN Electronic Journal”, vol. 7(1), https://doi.org/10.2139/ssrn.4248966
Google Scholar
Antonowicz Dominik (2015), Między siłą globalnych procesów a lokalną tradycją, Toruń: Uniwersytet Mikołaja Kopernika.
Google Scholar
Antonowicz Dominik, Donina Davide, Hladchenko Myroslava, Budzanowska Anna (2024), Impact of university councils on the core academic values of Polish universities: limited but benign, „International Journal of Leadership in Education”, s. 1–21, https://doi.org/10.1080/13603124.2024.2302062
Google Scholar
Arditte Kimberly A., Çek Demet, Shaw Ashley M., Timpano Kiara R. (2016), The importance of assessing clinical phenomena in Mechanical Turk research, „Psychological Assessment”, vol. 28(6), s. 684–691, https://doi.org/10.1037/pas0000217
Google Scholar
Barbarosa Ligia, Dwyer Tom (2016), Higher education in crisis: critical voices from emerging countries, [w:] James E. Cote, Andy Furlong (red.), Routledge Handbook of the Sociology of Higher Education, London: Routledge, s. 315–327.
Google Scholar
Barchard Kimberly A., Williams John (2008), Practical advice for conducting ethical online experiments and questionnaires for United States psychologists, „Behavior Research Methods”, vol. 40(4), s. 1111–1128, https://doi.org/10.3758/BRM.40.4.1111
Google Scholar
Baron Nancy (2010), Escape from the Ivory Tower: A Guide to Making Your Science Matter, Washington: Island Press.
Google Scholar
Beck Susanne, Bergenholtz Carsten, Bogers Marcel, Brasseur Tiare-Maria, Conradsen Marie Louise, Di Marco Diletta, Distel Andreas P., Dobusch Leonhard, Dörler Daniel, Effert Agnes, Fecher Benedikt, Filiou Despoina, Frederiksen Lars, Gillier Thomas, Grimpe Christoph, Gruber Marc, Haeussler Carolin, Heigl Florian, Hoisl Karin, Hyslop Katie, Kokshagina Olga, LaFlamme Marcel, Lawson Cornelia, Lifshitz-Assaf Hila, Lukas Wolfgang, Nordberg Markus, Norn Maria Theresa, Poetz Marion, Ponti Marisa, Pruschak Gernot, Pujol Priego Laia, Radziwon Agnieszka, Rafner Janet, Romanova Gergana, Ruser Alexander, Sauermann Henry, Shah Sonali K., Sherson Jacob F., Suess-Reyes Julia, Tucci Christopher L., Tuertscher Philipp, Vedel Jane Bjørn, Velden Theresa, Verganti Roberto, Wareham Jonathan, Wiggins Andrea (2022), The Open Innovation in Science research field: a collaborative conceptualisation approach, „Industry and Innovation”, vol. 29(2), s. 136–185, https://doi.org/10.1080/13662716.2020.1792274
Google Scholar
Belcher Brian M., Rasmussen Katherine E., Kemshaw Matthew R., Zornes Deborah A. (2016), Defining and assessing research quality in a transdisciplinary context, „Research Evaluation”, vol. 25(1), s. 1–17, https://doi.org/10.1093/reseval/rvv025
Google Scholar
Ben Kei Daniel, Bisaso Ronald (red.) (2023), Higher Education in Sub-Saharan Africa in the 21st, Dordrecht: Springer.
Google Scholar
Bouncken Ricarda B., Komorek Malvine, Kraus Sascha (2015), Crowdfunding: The Current State of Research, „International Business & Economics Research Journal (IBER)”, vol. 14(3), s. 407–416, https://doi.org/10.19030/iber.v14i3.9206
Google Scholar
Brem Alexander M., Tucci Christopher L., Brown Terrence, Chen Jin (2023), Guest Editorial: The Age of Crowdsourcing and Crowdfunding for Technological Innovation: Where We Are, and Where to Go?, „IEEE Transactions on Engineering Management”, vol. 70(9), s. 3015–3020, https://doi.org/10.1109/tem.2023.3270022
Google Scholar
Bücheler Thierry, Sieg Jan Henrik (2011), Understanding Science 2.0: Crowdsourcing and Open Innovation in the Scientific Method, „Procedia Computer Science”, no. 7, s. 327–329, https://doi.org/10.1016/j.procs.2011.09.014
Google Scholar
Buhrmester Michael, Kwang Tracy, Gosling Samuel D. (2011), Amazon’s Mechanical Turk: A New Source of Inexpensive, yet High-Quality, Data?: A New Source of Inexpensive, yet High-Quality, Data?, „Perspectives on Psychological Science: A Journal of the Association for Psychological Science”, vol. 6(1), s. 3–5, https://doi.org/10.1177/1745691610393980
Google Scholar
Buhrmester Michael D., Talaifar Sanaz, Gosling Samuel D. (2018), An Evaluation of Amazon’s Mechanical Turk, Its Rapid Rise, and Its Effective Use, „Perspectives on Psychological Science: A Journal of the Association for Psychological Science”, vol. 13(2), s. 149–154, https://doi.org/10.1177/1745691617706516
Google Scholar
Clark Burton (1984), Introduction, [w:] Burton Clark (red.), Perspectives on higher education: Eight disciplinary and comparative views, Berkeley: University of California Press, s. 1–16.
Google Scholar
Cuprjak Magdalena (2019), Dane w badaniach jakościowych. Uwikłanie w kontekst, „Forum Oświatowe”, nr 31(1), s. 111–124, https://doi.org/10.34862/fo.2019.1.7
Google Scholar
Cywińska Maria, Górak-Sosnowska Katarzyna, Markowska-Manista Urszula (2022), Decolonising “Those Who Are Not” in Polish Higher Education Institutions, [w:] Anna Cohen Miller, Tamsin Hinton-Smith, Fawzia Haeri Mazanderani, Napur Samuel (red.), Leading Change in Gender and Diversity in Higher Education from Margins to Mainstream, London: Routledge, s. 208–232.
Google Scholar
Denzin Norman K., Lincoln Yvonna S. (2009), Metody badań jakościowych, t. 1–2, Warszawa: Wydawnictwo Naukowe PWN.
Google Scholar
Drozdowicz Zbigniew (red.) (2009), Uniwersytet. Tradycje, dzień dzisiejszy, przyszłość, Poznań: Wydawnictwo Naukowe Uniwersytetu Adama Mickiewicza.
Google Scholar
Dzogovic Sauda A., Bajrami Vedat (2023), Qualitative Research Methods in Science and Higher Education, „Human Research in Rehabilitation”, vol. 13(1), s. 156–166.
Google Scholar
Ford John B. (2017), Amazon’s Mechanical Turk: A Comment, „Journal of Advertising”, vol. 46(1), s. 156–158, https://doi.org/10.1080/00913367.2016.1277380
Google Scholar
Frankfort-Nachmias Chava, Nachmias David (2001), Metody badawcze w naukach społecznych, Poznań: Wydawnictwo Zysk i S-ka.
Google Scholar
Franzoni Chiara, Sauermann Henry (2014), Crowd science: The organization of scientific research in open collaborative projects, „Research Policy”, vol. 43(1), s. 1–20, https://doi.org/10.1016/j.respol.2013.07.005
Google Scholar
Gerring John (2012), Social Science Methodology: A Criterial Framework, Cambridge: Cambridge University Press, https://doi.org/10.1017/cbo9780511815492
Google Scholar
Geschwind Lars, Broström Anders, Larsen Katarina (red.) (2020), Technical Universities: Past, Present and Future, Cham: Springer International Publishing.
Google Scholar
Ghezzi Antonio, Gabelloni Donata, Martini Antonella, Natalicchio Angelo (2018), Crowdsourcing: A Review and Suggestions for Future Research: Crowdsourcing, „International Journal of Management Reviews”, vol. 20(2), s. 343–363, https://doi.org/10.1111/ijmr.12135
Google Scholar
Górak-Sosnowska Katarzyna, Piwowar-Sulej Katarzyna. (2023), The well-being of female administrative staff in managerial positions in Polish Higher Education Institutions, „Central European Management Journal”, vol. 31(2), s. 207–221, https://doi.org/10.1108/CEMJ-12-2021-0151
Google Scholar
Hammersley Martyn (1997), Qualitative Data Archiving: Some Reflections on Its Prospects and Problems, „Sociology”, vol. 31(1), s. 131–142, https://doi.org/10.1177/0038038597031001010
Google Scholar
Hecker Susanne, Haklay Muki, Bowser Anne, Makuch Zen, Vogel Johannes, Bonn Aletta (2018), Innovation in Open Science, Society and Policy – Setting the Agenda for Citizen Science, [w:] Susanne Hecker, Muki Haklay, Anne Bowser, Zen Makuch, Johannes Vogel, Aletta Bonn, Citizen Science, London: UCL Press, s. 1–24.
Google Scholar
Howe Jeff (2006), The Rise of Crowdsourcing, „Wired”, June 1, https://www.wired.com/2006/06/crowds/ [dostęp: 20.06.2023].
Google Scholar
Howe Jeff (2008), Crowdsourcing: How the Power of the Crowd Is Driving the Future of Business, London: Random House Books.
Google Scholar
Hughson John, Inglis David, Free Marcus (2005), The Uses of Sport. A Critical Study, Abingdon: Routledge.
Google Scholar
Huisman Jeroen (2023), Higher Education and Organizational Theory: Systems, Fields, Markets, and Populations in an Increasingly Global Context’, [w:] Paola Mattei, Xavier Dumay, Eric Mangez, Jacqueline Behrend (red.), The Oxford Handbook of Education and Globalization, https://doi.org/10.1093/oxfordhb/9780197570685.013.31
Google Scholar
Huisman Jeroen, Meek Lynn, Wood Fiona (2007), Institutional Diversity in Higher Education: A Cross-National and Longitudinal Analysis, „Higher Education Quarterly”, vol. 61(4), s. 563–577, https://doi.org/10.1111/j.1468-2273.2007.00372.x
Google Scholar
Jaspers Karl (1946), Die Idee Der Universität, Berlin–Heidelberg: Springer.
Google Scholar
Klenk Tanja, Antonowicz Dominik, Geschwind Lars, Pinheiro Rómulo, Pokorska Anna (2022), Taking women on boards: a comparative analysis of public policies in higher education, „Policy Reviews in Higher Education”, vol. 6(2), s. 128–152, https://doi.org/10.1080/23322969.2022.2066014
Google Scholar
Kuhlmann Stefan, Rip Arie (2018), Next-Generation Innovation Policy and Grand Challenges, „Science & Public Policy”, vol. 45(4), s. 448–454, https://doi.org/10.1093/scipol/scy011
Google Scholar
Lenart-Gansiniec Regina (2019), Organizacyjne uczenie się w organizacjach publicznych – perspektywa crowdsourcingu, Warszawa: Wydawnictwo Naukowe PWN.
Google Scholar
Lenart-Gansiniec Regina (2023), Crowdsourcing naukowy. Perspektywa mikro, Warszawa: Polskie Wydawnictwo Ekonomiczne.
Google Scholar
Lenart-Gansiniec Regina, Czakon Wojciech, Sułkowski Łukasz, Pocek Jasna (2022), Understanding crowdsourcing in science, „Review of Managerial Science”, vol. 17, s. 2797–2830, https://doi.org/10.1007/s11846-022-00602-z
Google Scholar
Liu Wenlong, He Changqing, Jiang Yi, Ji Rongrong, Zhai Xuesong (2020), Effect of Gig Workers’ Psychological Contract Fulfillment on Their Task Performance in a Sharing Economy – A Perspective from the Mediation of Organizational Identification and the Moderation of Length of Service, „International Journal of Environmental Research and Public Health”, vol. 17(7), 2208, https://doi.org/10.3390/ijerph17072208
Google Scholar
Macfarlane Bruce, Grant Barbara (2012), The Growth of higher education studies: from forerunners to pathtakers, „Higher Education Research & Development”, vol. 31(5), s. 621–624, https://doi.org/10.1080/07294360.2012.719283
Google Scholar
Neave Guy (2002), The Stakeholder Perspective Historically Explored [w:] Jürgen Enders, Oliver Fulton (red.), Higher Education in a Globalising World: International Trends and Mutual Observations A Festschrift in Honour of Ulrich Teichler, Dordrecht: Springer Netherlands, s. 17–37.
Google Scholar
Ngo Jenny, Boer Harry de, Enders Jurgen (2014), The way deans run their faculties in Indonesian universities, „Tertiary Education and Management”, vol. 20(1), s. 1–13.
Google Scholar
Nikolic Sasha, Daniel Scott, Haque Rezwanul, Belkina Marina, Hassan Ghulam M., Grundy Sarah, Lyden Sarah, Neal Peter, Sandison Caz (2023), ChatGPT versus engineering education assessment: a multidisciplinary and multi-institutional benchmarking and analysis of this generative artificial intelligence tool to investigate assessment integrity, „European Journal of Engineering Education”, vol. 48(4), s. 559–614, https://doi.org/10.1080/03043797.2023.2213169
Google Scholar
Oppenlaender Jonas, Milland Kristy, Visuri Aku, Ipeirotis Panos, Hosio Simo (2020), Creativity on Paid Crowdsourcing Platforms, [w:] CHI ‘20: CHI Conference on Human Factors in Computing Systems, Honolulu, Association for Computing Machinery, New York, s. 1–14. https://doi.org/10.1145/3313831.3376677
Google Scholar
Paolacci Gabriele, Chandler Jesse (2014), Inside the Turk: Understanding Mechanical Turk as a Participant Pool, „Current Directions in Psychological Science”, vol. 23(3), s. 184–188, https://doi.org/10.1177/0963721414531598
Google Scholar
Parrick Rebecca, Chapman Brendan (2020), Working the crowd for forensic research: A review of contributor motivation and recruitment strategies used in crowdsourcing and crowdfunding for scientific research, „Forensic Science International. Synergy”, vol. 2, s. 173–182, https://doi.org/10.1016/j.fsisyn.2020.05.002
Google Scholar
Pavlidou Ioanna, Papagiannidis Savvas, Tsui Eric (2020), Crowdsourcing: a systematic review of the literature using text mining, „Industrial Management + Data Systems”, vol. 120(11), s. 2041–2065, https://doi.org/10.1108/imds-08-2020-0474
Google Scholar
Pittman Matthew, Sheehan Kim (2016), Amazon’s Mechanical Turk a digital sweatshop? Transparency and accountability in crowdsourced online research, „Journal of Media Ethics”, vol. 31(4), s. 260–262.
Google Scholar
Polanyi Michael (1962), Personal Knowledge: Towards a Post-Critical Philosophy, Chicago: Chicago University Press.
Google Scholar
Pszczołowski Piotr (1978), Mała encyklopedia prakseologii i teorii organizacji, Wrocław: Zakład Narodowy im. Ossolińskich.
Google Scholar
Sadler D. Royce (2016), Three in-course assessment reforms to improve higher education learning outcomes, „Assessment & Evaluation in Higher Education”, vol. 41(7), s. 1081–1099, https://doi.org/10.1080/02602938.2015.1064858
Google Scholar
Salemans Luc, Budding Tjerk (2022), Operationalizing public value in higher education: the use of narratives as an alternative for performance indicators, „Journal of Management & Governance”, vol. 26(2), s. 337–363, https://doi.org/10.1007/s10997-021-09596-4
Google Scholar
Savenye Wilhelmina C., Robinson Rhonda S. (2005), Using qualitative research methods in higher education, „Journal of Computing in Higher Education”, vol. 16(2), s. 65–95, https://doi.org/10.1007/bf02961475
Google Scholar
Schlagwein Daniel, Daneshgar Farhad (2014), User Requirements of a Crowdsourcing Platform for Researchers: Findings from a Series of Focus Groups, PACIS 2014 Proceedings, https://aisel.aisnet.org/pacis2014/195/ [dostęp: 20.06.2023].
Google Scholar
Shin Jung Cheol, Kehm Barbara M. (red.) (2014), Institutionalization of World-Class University in Global Competition, Dordrecht: Springer.
Google Scholar
Sin Cristina, Antonowicz Dominik, Wiers-Jenssen Jannecke (2021), Attracting International Students to Semi-Peripheral Countries: A Comparative Study of Norway, Poland and Portugal, „Higher Education Policy”, vol. 34(1), s. 297–320, https://doi.org/10.1057/s41307-019-00135-3
Google Scholar
Singh Kapil Dev (2015), Creating Your Own Qualitative Research Approach: Selecting, Integrating and Operationalizing Philosophy, Methodology and Methods, „Vision”, vol. 19(2), s. 132–146, https://doi.org/10.1177/0972262915575657
Google Scholar
Sławek Tadeusz (2002), Antygona w świecie korporacji, Katowice: Wydawnictwo Uniwersytetu Śląskiego.
Google Scholar
Sowa Kazimierz (2009), Gdy myślę Uniwersytet…, Kraków: Wydawnictwo Uniwersytetu Jagiellońskiego.
Google Scholar
Stritch Justin M., Pedersen Mogens Jin, Taggart Gabel (2017), The Opportunities and Limitations of Using Mechanical Turk (MTURK) in Public Administration and Management Scholarship, „International Public Management Journal: IPMJ”, vol. 20(3), s. 489–511, https://doi.org/10.1080/10967494.2016.1276493
Google Scholar
Sułkowski Łukasz, Lenart-Gansiniec Regina (2021), Epistemologia, metodologia i metody badań w naukach o zarządzaniu i jakości, Łódź: Wydawnictwo Społecznej Akademii Nauk.
Google Scholar
Surowiecki James (2005), The Wisdom of Crowds: Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economics, Society and Nations, London: Abacus.
Google Scholar
Surowiecki James (2010), Mądrość tłumu: większość ma rację w ekonomii, biznesie i polityce, Gliwice: Wydawnictwo Helion.
Google Scholar
Sztompka Piotr (2005), Socjologia, Kraków: Wydawnictwo Znak.
Google Scholar
Taylor Maureen P., Bloom Allan (1988), The Closing of the American Mind: How Higher Education Has Failed Democracy and Impoverished the Souls of Today’s Students, „Michigan Law Review”, vol. 86(6), 1135–1140, https://doi.org/10.2307/1289159
Google Scholar
Teichler Ulrich (1998), The Transition from Higher Education to Employment in Europe, „Higher Education in Europe”, vol. 23(4), s. 535–558, https://doi.org/10.1080/0379772980230411
Google Scholar
Teichler Ulrich (2014), Teaching and Research in Germany: The Notions of University Professors, [w:] Jung Cheol Shin, Akira Arimoto, William K. Cummings, Ulrich Teichler (red.), Teaching and Research in Contemporary Higher Education, Dordrecht: Springer Netherlands, s. 61–87.
Google Scholar
Teichler Ulrich (2015), Changing Perspectives: The Professional Relevance of Higher Education on the Way towards the Highly-Educated Society: Changing Perspectives: The Professional Relevance of Higher Education on the Way towards the Highly-Educated Society, „European Journal of Education”, vol. 50(4), s. 461–477, https://doi.org/10.1111/ejed.12146
Google Scholar
Tight Malcolm (2020), Higher education: discipline or field of study?, „Tertiary Education and Management”, vol. 26, s. 415–428, https://doi.org/10.1007/s11233-020-09060-2
Google Scholar
Tight Malcolm (2022), Internationalisation of higher education beyond the West: challenges and opportunities – the research evidence, „Educational Research and Evaluation: An International Journal on Theory and Practice”, vol. 27(3–4), s. 239–259, https://doi.org/10.1080/13803611.2022.2041853
Google Scholar
Uhlmann Eric Luis, Ebersole Charles R., Chartier Christopher R., Errington Timothy M., Kidwell Mallory C., Lai Calvin K., McCarthy Randy J., Riegelman Amy, Silberzahn Raphael, Nosek Brian A. (2019), Scientific Utopia III: Crowdsourcing Science, „Perspectives on Psychological Science: A Journal of the Association for Psychological Science”, vol. 14(5), s. 711–733, https://doi.org/10.1177/1745691619850561
Google Scholar
Vermicelli Silvia, Cricelli Livio, Grimaldi Michele (2021), How can crowdsourcing help tackle the COVID‐19 pandemic? An explorative overview of innovative collaborative practices, „R&D Management”, vol. 51(2), s. 183–194.
Google Scholar
Wiggins Andrea, Crowston Kevin (2011), From Conservation to Crowdsourcing: A Typology of Citizen Science, 2011 44th Hawaii International Conference on System Sciences, IEEE.
Google Scholar
Williams Carrie (2007), Research Methods, „Journal of Business & Economic Research”, vol. 5(3), s. 65–72, https://doi.org/10.19030/jber.v5i3.2532
Google Scholar
Xia Huichuan, McKernan Brian (2020), Privacy in Crowdsourcing: a Review of the Threats and Challenges, „Computer Supported Cooperative Work (CSCW)”, vol. 29, s. 263–301.
Google Scholar
Zhao Yuxiang, Zhu Qinghua (2014), Effects of extrinsic and intrinsic motivation on participation in crowdsourcing contest: A perspective of self-determination theory, „Online Information Review”, vol. 38(7), s. 896–917, https://doi.org/10.1108/oir-08-2014-0188
Google Scholar
Downloads
Published
Versions
- 2024-10-14 (2)
- 2024-08-31 (1)
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Funding data
-
Narodowe Centrum Nauki
Grant numbers DEC-2019/35/B/HS4/01446