Using Cognitive Interviews in Designing an Interview Questionnaire Based on the Example of a Study into Adult Learning

Abstract

The article presents an analysis of the cognitive interviews that constituted the first stage of the pilot of the interview questionnaire as part of the “Adult Learning in Poland” study. The available results of international studies indicate a relatively low level of adult participation in education in Poland, whilst also pointing to differences in the values of indicators between the studies. From the literature review it can be concluded that these discrepancies result from differences in operationalization, ways of category aggregation, and other factors. It was assumed that the use of cognitive interviews, including the ‘thinking aloud’ and ‘verbal probing’ techniques, would make it possible for the respondents to find ways to interpret concepts and understand questions, as well as enabling the the researchers to identify issues with a high level of sensitivity. A discussion of the analysis of the collected empirical material; the methods of conceptualizing the terms used by the respondents; and the issues causing them discomfort – were all discussed based on the results of the observation conducted during the interviews. The proposed modifications of the interview questionnaire are presented. These changes were implemented in order to reduce the risk of obtaining incorrect results with a high risk of measurement error, and to ensure the well-being of the respondents during the interviews. The conclusions concerning the use of the cognitive interviewing technique as an element of the pilot survey – as well as the methodological conclusions regarding the cognitive interviewing technique – were also presented.