Selected Problems of Quality Assessment in Internet Surveys – a Statistical Perspective

Aleksandra Kupis-Fijałkowska

doi:10.18778/0208-6018.349.03

Authors

Aleksandra Kupis-Fijałkowska University of Łódź, Faculty of Economics and Sociology, Department of Statistical Methods http://orcid.org/0000-0002-2528-5511

DOI:

https://doi.org/10.18778/0208-6018.349.03

Keywords:

Internet survey, online survey, survey quality, survey error

Abstract

The paper presents selected problems related to the quality assessment from the statistical perspective of survey data based on Internet sources. Internet access is consequently expanding all over the world. In parallel with the running development of other new technologies, it is pervading daily life and business activities more and more. It also has influenced surveys practice to a large extent as a research tool for collecting both primary and secondary data, and it also challenges surveys to research the Internet population. Moreover, as the Internet and its entities are able to register all activities that are performed on the web, issues related to big data and organic data processing as well as their applications arise. As a result of decreasing response rates and increasing survey costs, Internet data collection is constantly growing. Due to many advantages, Internet surveys are used widely and this process seems to be inevitable. However, it needs to be emphasised that Internet surveys are developing in practice faster than the methodology in this area. Hence, a lot of problems can be identified, especially when considering the quality of data based on Internet sources. The following issues are discussed as the most far-reaching in the prism of statistical survey methodology: determination of the sampling frame, self-selection and related estimates bias, as well as under/over-coverage.

Downloads

Download data is not yet available.

References

Beręsewicz M. (2015), On the representativeness of Internet data sources for the real estate market in Poland, “Austrian Journal of Statistics”, vol. 4(2), pp. 45–57. DOI: https://doi.org/10.17713/ajs.v44i2.79

Beręsewicz M. (2017), A Two‑Step Procedure to Measure Representativeness of Internet Data Sources, “International Statistical Review”, vol. 85(3), pp. 473–493. DOI: https://doi.org/10.1111/insr.12217

Beręsewicz M., Szymkowiak M. (2015), Big data w statystyce publicznej – nadzieje, osiągnięcia, wyzwania i zagrożenia, “Ekonometria”, vol. 2(48), pp. 9–21. DOI: https://doi.org/10.15611/ekt.2015.2.01

Bethlehem J. (2009), The Rise of Survey Sampling, Discussion Paper 09015, Statistics Netherlands, The Hague/Heerlen.

Bethlehem J. (2010), Selection bias in web surveys, “International Statistical Review”, vol. 78(2), pp. 161–188. DOI: https://doi.org/10.1111/j.1751-5823.2010.00112.x

Bethlehem J. (2012), Using response probabilities for assessing representativity, Discussion paper 201212, Statistics Netherlands, Voorburg/Heerleen.

Bethlehem J., Biffignandi S. (2011), Handbook of Web Surveys, Wiley, New York. DOI: https://doi.org/10.1002/9781118121757

Callegaro M., Manfreda K., Vehovar V. (2015), Web survey methodology, Sage, London. DOI: https://doi.org/10.4135/9781529799651

Cobben F. (2009), Nonresponse in sample surveys: methods for analysis and adjustment, Statistics Netherlands, The Hague/Heerlen.

Cobben F., Schouten B. (2005), Bias measures for evaluating and facilitating flexible fieldwork strategies, Paper presented at 16th International Workshop on Household Survey Nonresponse, August 28–31, Tällberg.

Cobben F., Schouten B. (2007), An empirical validation of R‑indicators, Discussion paper, Statistics Netherlands, Voorburg.

Cochran W. G. (1977), Sampling Techniques, John Wiley & Sons, New York.

Eurostat (2018), Households – level of internet access, http://appsso.eurostat.ec.europa.eu/nui/show.do?dataset=isoc_ci_in_h&lang=en (accessed: 20.12.2018).

Fielding N. G., Lee R. M., Blank G. (2017), The SAGE Handbook of Online Research Methods, Sage, London. DOI: https://doi.org/10.4135/9781473957992

Fricker R., Schonlau M. (2002), Advantages and disadvantages of internet research surveys: Evidence from the literature, “Field Methods”, no. 15, pp. 347–367. DOI: https://doi.org/10.1177/152582202237725

Gemius S. A. (2018), Wyniki badania Gemius/PBI za listopad 2018, https://www.gemius.pl/reklamodawcy‑aktualnosci/wyniki‑badania‑gemiuspbi‑za‑listopad–2018.html (accessed: 28.12.2018).

Groves R. M., Peytcheva E. (2008), The Impact of Nonresponse Rates on Nonresponse Bias, “Public Opinion Quarterly”, no. 72, pp. 1–23. DOI: https://doi.org/10.1093/poq/nfn011

Kalton G. (2019), Developments in Survey Research over the Past 60 Years: A Personal Perspective, “International Statistical Review”, no. 87(S1), pp. S10–S30. DOI: https://doi.org/10.1111/insr.12287

Leeuw E. D. de (2018), Mixed‑Mode: Past, Present, and Future, “Survey Research Methods”, vol. 12(2), pp. 75–89.

Polish Society of Market and Opinion Researchers (2011), Yearbook of Polish Society of Market and Opinion Researchers 2011/2012, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.

Polish Society of Market and Opinion Researchers (2012), Yearbook of Polish Society of Market and Opinion Researchers 2012/2013, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.

Polish Society of Market and Opinion Researchers (2013), Yearbook of Polish Society of Market and Opinion Researchers 2013/2014, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.

Polish Society of Market and Opinion Researchers (2014), Yearbook of Polish Society of Market and Opinion Researchers 2014/2015, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.

Polish Society of Market and Opinion Researchers (2015), Yearbook of Polish Society of Market and Opinion Researchers 2015/2016, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.

Polish Society of Market and Opinion Researchers (2016), Yearbook of Polish Society of Market and Opinion Researchers 2016/2017, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.

Polish Society of Market and Opinion Researchers (2017), Yearbook of Polish Society of Market and Opinion Researchers 2017/2018, ORA & Funksters, Warszawa.

Polish Society of Market and Opinion Researchers (2018), Yearbook of Polish Society of Market and Opinion Researchers 2018/2019, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.

Schonlau M., Couper M. P. (2017), Options for Conducting Web Surveys, “Statistical Science”, vol. 32(2), pp. 279–292. DOI: https://doi.org/10.1214/16-STS597

Schouten B., Cobben F., Bethlehem J. G. (2009), Indicators for the Representativeness of Survey Response, „Survey Methodology”, vol. 35(1), pp. 101–113.

Schouten B., Bethlehem J., Beullens K., Kleven O., Loosveldt G., Luiten A., Rutar K., Shlomo N. (2012), Evaluating, Comparing, Monitoring and Improving Representativeness of Survey Response Through R‑indicators and Partial R‑indicators, “International Statistical Review”, vol. 80(3), pp. 382–399. DOI: https://doi.org/10.1111/j.1751-5823.2012.00189.x

Shlomo N., Skinner C. J., Schouten B., Bethlehem J., Zhang L. (2008), Statistical Properties of R‑indicators, Work Package 3, Deliverable 3.1, RISQ Project, 7th Framework Programme (FP7) of the European Union.

Skinner C., Shlomo N., Schouten B., Zhang L., Bethlehem J. (2009), Measuring Survey Quality Through Representativeness Indicators Using Sample and Population Based Information, NTTS Conference, 18–20 February 2009, Brussels.

Statistics Poland (2018a), Information society in Poland. Results of statistical surveys in the years 2013–2017, https://stat.gov.pl/en/topics/science‑and‑technology/information‑society/information‑society‑in‑poland‑results‑of‑statistical‑surveys‑in‑the‑years–20132017,1,4.html (accessed: 20.12.2018).

Statistics Poland (2018b), Information society in Poland. Results of statistical surveys in the years 2014–2018, https://stat.gov.pl/en/topics/science‑and‑technology/information‑society/information‑society‑in‑poland‑results‑of‑statistical‑surveys‑in‑the‑years–20142018,1,5.html (accessed: 20.12.2018).

Statistics Poland (2018c), Local Data Bank, https://bdl.stat.gov.pl/BDL/start (accessed: 17.12.2018).

Szreder M. (2015), Big data wyzwaniem dla człowieka i statystyki, “Wiadomości Statystyczne”, vol. 8(651), pp. 1–11. DOI: https://doi.org/10.5604/01.3001.0014.8303

Szreder M. (2017), Nowe źródła informacji i ich wykorzystywanie w podejmowaniu decyzji, “Wiadomości Statystyczne”, vol. 7(674), pp. 5–17. DOI: https://doi.org/10.5604/01.3001.0014.0972

Tourangeau R., Conrad F., Couper M. (2013), The science of web surveys, Oxford University Press, New York. DOI: https://doi.org/10.1093/acprof:oso/9780199747047.001.0001