Selected Problems of Quality Assessment in Internet Surveys – a Statistical Perspective

Aleksandra Kupis-Fijałkowska

doi:10.18778/0208-6018.349.03

Authors

Aleksandra Kupis-Fijałkowska University of Łódź, Faculty of Economics and Sociology, Department of Statistical Methods http://orcid.org/0000-0002-2528-5511

DOI:

https://doi.org/10.18778/0208-6018.349.03

Keywords:

Internet survey, online survey, survey quality, survey error

Abstract

The paper presents selected problems related to the quality assessment from the statistical perspective of survey data based on Internet sources. Internet access is consequently expanding all over the world. In parallel with the running development of other new technologies, it is pervading daily life and business activities more and more. It also has influenced surveys practice to a large extent as a research tool for collecting both primary and secondary data, and it also challenges surveys to research the Internet population. Moreover, as the Internet and its entities are able to register all activities that are performed on the web, issues related to big data and organic data processing as well as their applications arise. As a result of decreasing response rates and increasing survey costs, Internet data collection is constantly growing. Due to many advantages, Internet surveys are used widely and this process seems to be inevitable. However, it needs to be emphasised that Internet surveys are developing in practice faster than the methodology in this area. Hence, a lot of problems can be identified, especially when considering the quality of data based on Internet sources. The following issues are discussed as the most far-reaching in the prism of statistical survey methodology: determination of the sampling frame, self-selection and related estimates bias, as well as under/over-coverage.

Downloads

Download data is not yet available.

References

Beręsewicz M. (2015), On the representativeness of Internet data sources for the real estate market in Poland, “Austrian Journal of Statistics”, vol. 4(2), pp. 45–57.
Google Scholar DOI: https://doi.org/10.17713/ajs.v44i2.79

Beręsewicz M. (2017), A Two‑Step Procedure to Measure Representativeness of Internet Data Sources, “International Statistical Review”, vol. 85(3), pp. 473–493.
Google Scholar DOI: https://doi.org/10.1111/insr.12217

Beręsewicz M., Szymkowiak M. (2015), Big data w statystyce publicznej – nadzieje, osiągnięcia, wyzwania i zagrożenia, “Ekonometria”, vol. 2(48), pp. 9–21.
Google Scholar DOI: https://doi.org/10.15611/ekt.2015.2.01

Bethlehem J. (2009), The Rise of Survey Sampling, Discussion Paper 09015, Statistics Netherlands, The Hague/Heerlen.
Google Scholar

Bethlehem J. (2010), Selection bias in web surveys, “International Statistical Review”, vol. 78(2), pp. 161–188.
Google Scholar DOI: https://doi.org/10.1111/j.1751-5823.2010.00112.x

Bethlehem J. (2012), Using response probabilities for assessing representativity, Discussion paper 201212, Statistics Netherlands, Voorburg/Heerleen.
Google Scholar

Bethlehem J., Biffignandi S. (2011), Handbook of Web Surveys, Wiley, New York.
Google Scholar DOI: https://doi.org/10.1002/9781118121757

Callegaro M., Manfreda K., Vehovar V. (2015), Web survey methodology, Sage, London.
Google Scholar DOI: https://doi.org/10.4135/9781529799651

Cobben F. (2009), Nonresponse in sample surveys: methods for analysis and adjustment, Statistics Netherlands, The Hague/Heerlen.
Google Scholar

Cobben F., Schouten B. (2005), Bias measures for evaluating and facilitating flexible fieldwork strategies, Paper presented at 16th International Workshop on Household Survey Nonresponse, August 28–31, Tällberg.
Google Scholar

Cobben F., Schouten B. (2007), An empirical validation of R‑indicators, Discussion paper, Statistics Netherlands, Voorburg.
Google Scholar

Cochran W. G. (1977), Sampling Techniques, John Wiley & Sons, New York.
Google Scholar

Eurostat (2018), Households – level of internet access, http://appsso.eurostat.ec.europa.eu/nui/show.do?dataset=isoc_ci_in_h&lang=en (accessed: 20.12.2018).
Google Scholar

Fielding N. G., Lee R. M., Blank G. (2017), The SAGE Handbook of Online Research Methods, Sage, London.
Google Scholar DOI: https://doi.org/10.4135/9781473957992

Fricker R., Schonlau M. (2002), Advantages and disadvantages of internet research surveys: Evidence from the literature, “Field Methods”, no. 15, pp. 347–367.
Google Scholar DOI: https://doi.org/10.1177/152582202237725

Gemius S. A. (2018), Wyniki badania Gemius/PBI za listopad 2018, https://www.gemius.pl/reklamodawcy‑aktualnosci/wyniki‑badania‑gemiuspbi‑za‑listopad–2018.html (accessed: 28.12.2018).
Google Scholar

Groves R. M., Peytcheva E. (2008), The Impact of Nonresponse Rates on Nonresponse Bias, “Public Opinion Quarterly”, no. 72, pp. 1–23.
Google Scholar DOI: https://doi.org/10.1093/poq/nfn011

Kalton G. (2019), Developments in Survey Research over the Past 60 Years: A Personal Perspective, “International Statistical Review”, no. 87(S1), pp. S10–S30.
Google Scholar DOI: https://doi.org/10.1111/insr.12287

Leeuw E. D. de (2018), Mixed‑Mode: Past, Present, and Future, “Survey Research Methods”, vol. 12(2), pp. 75–89.
Google Scholar

Polish Society of Market and Opinion Researchers (2011), Yearbook of Polish Society of Market and Opinion Researchers 2011/2012, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.
Google Scholar

Polish Society of Market and Opinion Researchers (2012), Yearbook of Polish Society of Market and Opinion Researchers 2012/2013, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.
Google Scholar

Polish Society of Market and Opinion Researchers (2013), Yearbook of Polish Society of Market and Opinion Researchers 2013/2014, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.
Google Scholar

Polish Society of Market and Opinion Researchers (2014), Yearbook of Polish Society of Market and Opinion Researchers 2014/2015, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.
Google Scholar

Polish Society of Market and Opinion Researchers (2015), Yearbook of Polish Society of Market and Opinion Researchers 2015/2016, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.
Google Scholar

Polish Society of Market and Opinion Researchers (2016), Yearbook of Polish Society of Market and Opinion Researchers 2016/2017, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.
Google Scholar

Polish Society of Market and Opinion Researchers (2017), Yearbook of Polish Society of Market and Opinion Researchers 2017/2018, ORA & Funksters, Warszawa.
Google Scholar

Polish Society of Market and Opinion Researchers (2018), Yearbook of Polish Society of Market and Opinion Researchers 2018/2019, Polskie Towarzystwo Badaczy Rynku i Opinii, Warszawa.
Google Scholar

Schonlau M., Couper M. P. (2017), Options for Conducting Web Surveys, “Statistical Science”, vol. 32(2), pp. 279–292.
Google Scholar DOI: https://doi.org/10.1214/16-STS597

Schouten B., Cobben F., Bethlehem J. G. (2009), Indicators for the Representativeness of Survey Response, „Survey Methodology”, vol. 35(1), pp. 101–113.
Google Scholar

Schouten B., Bethlehem J., Beullens K., Kleven O., Loosveldt G., Luiten A., Rutar K., Shlomo N. (2012), Evaluating, Comparing, Monitoring and Improving Representativeness of Survey Response Through R‑indicators and Partial R‑indicators, “International Statistical Review”, vol. 80(3), pp. 382–399.
Google Scholar DOI: https://doi.org/10.1111/j.1751-5823.2012.00189.x

Shlomo N., Skinner C. J., Schouten B., Bethlehem J., Zhang L. (2008), Statistical Properties of R‑indicators, Work Package 3, Deliverable 3.1, RISQ Project, 7th Framework Programme (FP7) of the European Union.
Google Scholar

Skinner C., Shlomo N., Schouten B., Zhang L., Bethlehem J. (2009), Measuring Survey Quality Through Representativeness Indicators Using Sample and Population Based Information, NTTS Conference, 18–20 February 2009, Brussels.
Google Scholar

Statistics Poland (2018a), Information society in Poland. Results of statistical surveys in the years 2013–2017, https://stat.gov.pl/en/topics/science‑and‑technology/information‑society/information‑society‑in‑poland‑results‑of‑statistical‑surveys‑in‑the‑years–20132017,1,4.html (accessed: 20.12.2018).
Google Scholar

Statistics Poland (2018b), Information society in Poland. Results of statistical surveys in the years 2014–2018, https://stat.gov.pl/en/topics/science‑and‑technology/information‑society/information‑society‑in‑poland‑results‑of‑statistical‑surveys‑in‑the‑years–20142018,1,5.html (accessed: 20.12.2018).
Google Scholar

Statistics Poland (2018c), Local Data Bank, https://bdl.stat.gov.pl/BDL/start (accessed: 17.12.2018).
Google Scholar

Szreder M. (2015), Big data wyzwaniem dla człowieka i statystyki, “Wiadomości Statystyczne”, vol. 8(651), pp. 1–11.
Google Scholar DOI: https://doi.org/10.5604/01.3001.0014.8303

Szreder M. (2017), Nowe źródła informacji i ich wykorzystywanie w podejmowaniu decyzji, “Wiadomości Statystyczne”, vol. 7(674), pp. 5–17.
Google Scholar DOI: https://doi.org/10.5604/01.3001.0014.0972

Tourangeau R., Conrad F., Couper M. (2013), The science of web surveys, Oxford University Press, New York.
Google Scholar DOI: https://doi.org/10.1093/acprof:oso/9780199747047.001.0001