The Effect of Text Authenticity on the Performance of Iranian EFL Students in a C-Test

Karen Kow Yip Cheng; Amir BiglarBaygi; Mesod Solaymani

doi:10.2478/v10015-009-0005-6

Authors

Karen Kow Yip Cheng University of Malaya
Amir BiglarBaygi University of Malaya
Mesod Solaymani University of Malaya

DOI:

https://doi.org/10.2478/v10015-009-0005-6

Keywords:

C-Tests, Authentic texts, Inauthentic texts, Test method facets

Abstract

As part of growing efforts to understand factors affecting c-test this study aims to investigate the effect of text authenticity on the performance of Iranian EFL students in a C-Test. The C-Test is an integrative testing instrument that measures overall language competence, very much like the cloze test. In this study the rule of two has been applied: “the second half of every second word has been deleted, beginning with the second word of the second sentence; the first and last sentences are left intact” (Katona and Dornyei 1993: 35). The research involves 60 college students in their third year, majoring in English Literature at Ershad-Damavand College. This group were randomly selected applying multi-stage sampling. Since the present study intended to investigate the role of two different formats, i.e. authentic and inauthentic texts (text translated from Persian into English), two different tailored C-Tests were made to measure and compare the performances of the participants. Two C-Tests, one with Authentic Text and the other, with Inauthentic Text were administered to this homogenized group comprising 30 subjects. The findings of this study suggest that authenticity has an effect on the performance of learners in c-tests and we should control this variable while devising a c-test.

References

Alderson, J. C. and A. H. Urquhart. 1983. The effect of student background discipline on comprehension: Pilot study. In A. Hughes and D. Porter (eds) Current developments in language testing, (pp. 121-127). London: Academic Press.
Google Scholar

Alderson, J. C. and A. H. Urquhart. 1985a. This test is unfair: I’m not an economist. In P. L. Carrell, J. Devine and D. Eskey (eds) Interactive approaches to second language reading, (pp. 168-182). Cambridge: Cambridge University Press.
Google Scholar

Alderson, J. C. and A. H. Urquhart. 1985b. The effect of students’ academic discipline on their performance on ESP reading tests. Language Testing, 2, 192-204.
Google Scholar

Bachman, L. F. 1990. Fundamental considerations in language testing. Oxford: Oxford University Press.
Google Scholar

Bachman, L. F. 1995. Fundamental Considerations in Language Testing: Third impression. Oxford: Oxford University Press.
Google Scholar

Bachman, L. F. and M. Palmer. 1996. Conceptual bases of test development. Cambridge: Cambridge University Press.
Google Scholar

Beck, I. L. , M. G. McKeown and E. W. Gromoll. 1989. Learning from social studies texts. Cognition and Instruction, 6, 99-158.
Google Scholar

Beck, I. L., McKeown, M. G., Omanson, R. C. and Pople, M. 1984. Improving the comprehensibility of stories: The effects of revisions that improve coherence. Reading Research Quarterly, 19, 263-277.
Google Scholar

Beck, I. L., McKeown, M.G., Sinatra, G. M., and Loxterman, J. A. 1991. Revising social studies text from a text processing perspective: Evidence of improved comprehensibility. Reading Research Quarterly, 26, 251-276.
Google Scholar

Beck, I. L., McKeown, M. G. and Worthy, J. 1995. Giving a text voice can improve students’ understanding. Reading Research Quarterly, 30, 220-238.
Google Scholar

Beck, I. L., Omanson, R. C. and McKeown, M.G. 1982. An instructional redesign of reading lessons: Effects on comprehension. Reading Research Quarterly, 17, 462-481.
Google Scholar

Bernhardt, F. B. 1991. Reading Development in Second Language: Theoretical, Empirical and Classroom Perspectives. New Jersey: Ablex Publishing Corporation
Google Scholar

Brantmeier, C. 2005. Effects of Reader’s Knowledge, Text Type, and Test Type on L1 and L2 Reading Comprehension in Spanish. The Modern Language Journal 89 (1), 37-53.
Google Scholar

Britton, B.K., Van Dusen, L., Gulgoz, S. and Glynn, S.M. 1989. Instructional texts rewritten by five expert teams: Revisions and retention improvements. Journal of Educational Psychology, 81, 226-239.
Google Scholar

Carrell, P. L. and Eisterhold, J. C. 1983. Schema theory and ESL reading pedagogy. TESOL Quarterly, 17, 553-573.
Google Scholar

Clapham, C. 1996. The Development of IELTS: A study of the effect of background knowledge on reading comprehension. Cambridge: Cambridge University Press
Google Scholar

Davison, A. and Kantor, R. 1982. On the failure of readability formulas to define readable texts: A case study from adaptations. Reading Research Quarterly, 17, 187-209.
Google Scholar

Duffy, T.M. and Kabance, P. 1982. Testing a readable writing approach to text revision. Journal of Educational Psychology, 74, 733-748.
Google Scholar

Duffy, T. M., Higgins, L., Mehlenbacher, B., Cochran, C., Wallace, D., Hill. C., Haugen, D., McCaffrey, M., Burnett, R., Sloane, S., and Smith, S. 1989. Models for the design of instructional text. Reading Research Quarterly, 24, 434-457.
Google Scholar

Elmore, P. B. and Headrick, T. C. 2002. A Proposed Number Correct Scoring Procedure Based on Classical True-Score Theory and Multidimensional Item Response Theory. International Journal of Testing, 2(2), 100-112.
Google Scholar

Flesch, R., 1948. A new readability yardstick. Journal of Applied Psychology. 32, 321-333.
Google Scholar

Fountas, I. and Pinell, G.S. 2001. Guiding Readers and Writers Grades 3-6: Teaching Comprehension, Genre, and Content Literacy. Portsmouth, NH: Heinemann.
Google Scholar

Gellerstam, M. 1996. Translation as a source for cross-linguistic studies: Languages in Contrast. Lund: Lund University Press.
Google Scholar

Graves, M.F., Slater, W.H., Roen, D., Redd Boyd, T., Duin, A.H., Furniss, D.W. and Hazeltine, P. 1988. Some characteristics of memorable expository writing: Effects of revisions by writers with different backgrounds. Research in the Teaching of English, 22, 242-280.
Google Scholar

Graves, M.F., Prenn, M.C., Earle, J., Thompson, M., Johnson, V. and Slater, W.H. 1991. Improving instructional texts: Some lessons learned. Reading Research Quarterly, 26, 110-132.
Google Scholar

Harrison, C. and Salinger, T. 1998. Assessing reading: Theory and Practice. London: Routledge.
Google Scholar

Johns, A. 1997. Text, Role, and Context, Cambridge: Cambridge University Press.
Google Scholar

Johnson, P. 1981. Effects on reading comprehension of language complexity and cultural background of a text. TESOL Quarterly, 15, 169-181.
Google Scholar

Johnson, P. 1982. Effects of reading comprehension of building background knowledge. TESOL Quarterly, 16, 503-516.
Google Scholar

Katona, L and Dornyei, Z. 1993. C-test: A teacher friendly way to test language proficiency. English Teaching Forum, 31 (1), 35.
Google Scholar

Klare, G. R. 1985. How to write readable English. London: Hutchinson.
Google Scholar

Kobayashi, M. 2002a. Method effects on reading comprehension test performance: text organization and response format. Language Testing 19(2): 193-220.
Google Scholar

Kobayashi, M. 2002b. Cloze tests revisited: Exploring item characteristics with special attention to scoring methods. Modern Language Journal, 86, 571-586.
Google Scholar

Kobayashi, M. 2004. Investigation of test method effects: text organization and response format: a response to Chen, (2004). Language Testing, 21, 235-244.
Google Scholar

Kobayashi,M. 2005. An investigation of method effects on reading comprehension test performance. Proceedings of the 4th Annual JALT Pan-SIG Conference., Tokyo, May 2005 (p.73) Tokyo, Japan: Tokyo Keizai University.
Google Scholar

Koberl, J. and Sigott, G. 1994. Adjusting the C-Test difficulty in German. In Rudiger Grotjahn (Ed.), Der C-Test. Theoretische Grundlagenund praktische(pp.121-148). Anwoendungen, Bochum: Brockmeyer.
Google Scholar

Klein-Braley, C. 1984. Advance prediction of difficulty with C-tests. In T. Culhane, C. Klein-Braley, and D. K. Stevenson (Eds.) Practice and problems in language testing . Proceedings of the Seventh International Language Testing Symposium of the IUS, Colchester, October 1983 (pp. 97-112). Colchester, England: University of Essex, Dept. of Language and Linguistics.
Google Scholar

Klein-Braley, C. and Raatz, U. 1984. A survey of research on the C-test. Language Testing 1, 134-146.
Google Scholar

Klein-Braley, C. 1997. C-Tests in the context of reduced redundancy testing: an Appraisal. Language Testing 14, pp. 47–84.
Google Scholar

Klein-Braley, C. 1994. Language testing with the C-Test: A linguistic and statistical investigation into the strategies used by C-Test takers, and the prediction of C-Test difficulty. Duisburg: Habilitationsschrift.
Google Scholar

Laviosa-Braithwaite, S. 1997. The English Comparable Corpus (ECC): A resource and a methodology for the empirical study of translation. Manchester: UMIST.
Google Scholar

Mauranen, A. 2000. Corpus-based Approaches to Translation, Strange Strings in Translated Language. A Study on Corpora. Helsinki: University of Tampere.
Google Scholar

McBeath, N. 1990. C-Tests - some words of caution. English Teaching. Forum, 28, 45-46.
Google Scholar

Mohammed, M.A.H. and Swales, J.M. 1984. Factors affecting the successful reading of technical instructions. Reading in a Foreign Language, 2, 206-217.
Google Scholar

Olsen, L.A. and Johnson, R. 1989. A Discourse based approach to the assessment of readability. Linguistics and Education, 1, 207 231.
Google Scholar

Paltridge, B. 1996. Genre and the language-learning classroom. Ann Arbor: University of Michigan Press.
Google Scholar

Paltridge, B. 2001. Genre and the Language Learning Classroom. Pennsylvania State: University of Michigan Press.
Google Scholar

Phillips, Deborah. 2001. Longman complete course for the TOEFL® Test: Preparation for the computer and paper tests (With answer key). New York: Pearson Education: 676.
Google Scholar

Reder, L.M. and Anderson, J.R. 1980. A comparison of texts and their summaries: Memorial consequences. Journal of Verbal Learning and Verbal Behavior, 19, 121 134.
Google Scholar

Salager-Meyer, F. 1991. Reading expository prose at the post-secondary level: The influence of textual variables on L2 reading comprehension (a genre-based approach). Reading in a Foreign Language, 8, 645-662.
Google Scholar

Sigott, G. 1994. Language test validity. AAAA-Arbeiten aus Anglistik und Amerikanistik, 19 (2), 287-294.
Google Scholar

Sigott, G. 1995. The C-test: some factors of difficulty. AAA-Arbeiten aus Anglistik und Amerikanistik, 20 (1), 43-53.
Google Scholar

Siong, K. 2004. Exploring the connection between the testing of reading and literacy, Journal of Language Studies, 4(1) ,78-88.
Google Scholar

Steffensen, M.S. and Joag-Dev, C. 1984. Cultural knowledge and reading. In J.C. Alderson, and A.H. Urquhart, (Eds.), Reading in a Foreign Language (pp.48-61). London: Longman.
Google Scholar

Steffensen, M.S., Joag-Dev, C. and Anderson, R.C. 1979. A cross-cultural perspective on reading comprehension. Reading Research Quarterly, 15, 10-29.
Google Scholar

Trochim, W. M. 2006 The research method knowledge based. www.socialsearchmethod.net
Google Scholar

Ulijn, J.M. and Strother, J.B. 1990. The effect of syntactic simplification on reading EST texts as L1 and L2. Journal of Research in Reading, 13, 38-54.
Google Scholar

Urquhart, A. H. 1984. The effect of rhetorical ordering on readability. In J.C. Alderson, and A.H. Urquhart (Eds.), Reading in a Foreign Language (pp. 160 -175). London: Longman.
Google Scholar

Widdowson, H. G. 1983. Learning purpose and language use. Oxford: Oxford. University Press.
Google Scholar

Woolls, D. and P. King, P. 1999. Creating and using a multilingual parallel. Concordancer, Birmingham: The University of Birmingham.
Google Scholar