Braun Tibor, Schubert András (szerk.): Szakértői bírálat (peer review) a tudományos kutatásban : Válogatott tanulmányok a téma szakirodalmából (A MTAK Informatikai És Tudományelemzési Sorozata 7., 1993)
DOMENIC V. CLCCHETTI: The Reliability of Peer Review for Manuscript and Grant Submissions: A Cross-Disciplinary Investigation
101 CICHETTI: THE RELIABII .ITY OF PEER REVIEW Keferec bias in manuscript review. Journal of Applied Social Psychology 5:187-200. laDVC) Abt, H. A. (1988) What happens to rejected astronomical papers? Publications of the Astronomical Society of the Pacific 100:506-08. (aDVC] Ad Hoc Working Croup for Critical Appraisal of the Medical Literature (1987) A proposal for more informative abstracts of clinical articles. Annals of Internal Medicine 106:598-604. (SPL) Adair. R. K. (1981) Anonymous refereeing. Physics Today 34:13-15. |aDVC] (1982) A physics editor comments on Peters Ac Ceci's peer-review study. Behavioral and Brain Sciences 5:196. (aDVC) Adair, R. K. Ac Trigg. C. L. (1979) Editorial: Should the character of Physical Review Letters be changed? Physical Review Letters 43:196974. (aDVC) Allen, E. M. (1960) Why are research grant applications disapproved? Science 132:1532-34. (aDVC) Amabile, T. M. (1983) Brilliant but cruel: Perceptions of negative evaluators. Journal of Experimental Social Psychology 19:146-56. [RC] American Psychological Association (1983) Publication manual, 3rd ed. (aDVC) American Psychological Association (1985) Standards for educational and psychological testing. (RFB) American Psychologist (1989) Members of underrepresented groups: Reviewers for journal manuscripts wanted. American Psychologist 44:1555. (RC) Anonymous (1987) The publication game: Beyond quality in the search for a lengthy vitae. Journal of Social Behavior and Personality 2:3-12 (RC) Armstrong, J. S. (1980) Unintelligible management research and academic prestige. Interfaces 10:80-86. (aDVC) (1982a) Barriers to scientific contributions: The author's formula. Behavioral and Brain Sciences 5:197-99. (aDVC) (1982b) The ombudsman: Is peer review by peers as fair as it appears? Interfaces 12:62-74. (aDVC, JSA) (1982c) Research on scientific journals: Implications for editors and authors. Journal of Forecasting 1:83-104. (aDVC, JSA) Bailar, J. C., Ill Ac Patterson, K. (1985) Journal peer review: The need for a research agenda. The New England Journal of Medicine 312:65457. (aDVC) Baird, J. C., Green, D. M., and Luce, R. D. (1980) Variability and sequential effects in cross-modality matching of area and loudness. Journal of Experimental Psychology: Human Perception and Performance 6:27789 (DL) Bakanic, V. McPhail, C. Ac Simon, R. J. (1987) The manuscript review and decision-making process. American Sociological Report 52:63142. (aDVC, LJS) Bartko, J. J. (1966) The intraclass correlation coefficient as a measure of reliability. Psychological Reports 19:3-11. (aDVC) (1974) Corrective note to: "The Intraclass Correlation Coefficient as a Measure of Reliability." Psychological Reports 34:418. (aDVC) (1976) On various intraclass correlation reliability coefficients. Psychological Bulletin 83:762-65. (aDVC) Bartko, J. J. Ac Carpenter, W. T. (1976) On the methods and theory of reliability. Journal of Nervous and Mental Disease 163:307-17. (aDVC) Beck, A. T. (1976) Cognitive therapy and the emotional disorders. International Universities Press. (aDVC) Ben well, R. (1979) Authors anonymous? Physics Bulletin 30:288. (aDVC) Berelson, B. (1960) Graduate education in the United States. McGrawHill. (aDVC) Bernstein, G. S. (1984) Scientific rigor, scientific integrity: A comment on Sommer Ac Sommer. American Psychologist 39:1316. (aDVC] Beyer, J. M. (1978) Editorial policies and practices among leading journals in four scientific fields. The Sociological Quarterly 19:68-88. (aDVC) Blashfield, R. K. (1976) Mixture model tests of cluster analysis: Accuracy of four agglomerative hierarchical methods. Psychological Bulletin 83:37788. (rDVC) Bloch, D. A. Ac Kraemer, H. C. (1989) 2X2 kappa coefficients: Measures of agreement or association. Biometrics 45:269-87. (HCK) Boehme, G. (1977) Models for the development of science. In: Science. technology, and society: A cross-disciplinary perspective, ed. I. SpiegelRosing Ac D. de Solla Price. Sage. (aDVC) Boehme, C., van der Daele, W. Ac Krohn, W. (1976) Finalization of science. Social Science Information 15:306-30. (aDVC) Boor, M. (1986) Suggestions to improve manuscripts submitted to professional journals. American Psychologist. 41:721-22. (RC) Bornstein, R. F. (1990) Manuscript review in psychology: An alternative model. American Psychologist 45:67fc-73. (RFB) (in press) Publication politics, experimenter bias, and the replication process in social science research. Journal of Social Behavior and Personality. (RFB) Bowen. D. D., Perloff, R. Ac Jacoby, J. (1972) Improving manuscript evaluation procedures. American Psychologist 25:221-25. (aDVC) Bozarth, H. D. Ac Roberts. R. R. Jr. (1972) Signifying significant significant* American Psychologist 27:774-75. (aDVC) Bradley, J. V. (1981) Pernicious publication practices. Bulletin of the Psychonomic Society 18:31-34. (aDVC) Braida, L. D. Ac Durlach, N. T. (1972) Intensity perception. U. Resolution in one interval paradigms. Journal of the Acoustical Society of America 51:483-502. (DL) Brennan, R. L. Ac Light, R. J. (1974) Measuring agreement when two observers classify people into categories not defined in advance. British Journal of Mathematical and Statistical Psychology 27:154-63. (rDVC) Broad, W. J. (1988) Science can't keep up with the flood of new journals. The New York Times, Feb. 16:C1, CI1. (JF) Brook, R. J. Ac Stirling, W. D. (1984) Agreement between observers when the categories are not specified in advance. British Journal of Mathematical and Statistical Psychology 37:271-82. (rDVC) Byme, C. (1980) Tutor marked assessments at the Open University: A question of reliability. Assessment in Higher Education 5:104-18. (DL) Campbell, J. P. (1982) Some remarks from the outgoing editor. Journal of Applied Psychology 67:691-700. |LLH) Carsrud, K. B. (1984) Out of the frying pan: A reply to Sommer Ac Sommer. American Psychologist 31:1317-18 (aDVC) Ceci, S. J. Ac Peters, D. (1984) How blind is blind review? American Psychologist 39:1491-94. (aDVC) Chalmers, I. (1990) Underreporting research is scientific misconduct. Journal of the American Medical Association 263:1405-08. (SPL) Chalmers, T. C., Frank, C. S. Ac Reitman, D. (1990) Minimizing the three stages of publication bias. Journal of the American Medical Association 263:1392-95. (SPL) Chase, J. M. (1970) Normative criteria for scientific publication. American Sociologist 5:262-65. (aDVC) Chubin, D. E. (1982) Reform of peer review. Science 215:40. (aDVC) Cicchetti, D. V. (1976) Assessing interrater reliability for rating scales: Resolving some basic issues. British Journal of Psychiatry 129:45256. (aDVC) (1980) Reliability of reviews for the American Psychologist: A biostatistical assessment of the data. American Psychologist 35:300-3. [aDVC, LJS) (1981) Testing the normal approximation and minimal sample size requirements of weighted kappa when the number of categories is large. Applied Psychological Measurement 5:101-04. (arDVC) (1982) On peer review: "We have met the enemy and he is us." Behavioral and Brain Sciences 5:205. (arDVC) (1985) A critique of Whitehurst's "Interrater agreement for journal manuscript reviews:" De omnibus, disputandum est. American Psychologist 40:563-68. (aDVC, MED) (1988) When diagnostic agreement is high, but reliability is low: Some paradoxes occurring in independent neuropsychological assessments. Journal of Clinical and Experimental Neuropsychology 10:60522. (aDVC) Cicchetti. D. V. Ac Conn, H. O. (1976) A statistical analysis of reviewer agreement and bias in evaluating medical abstracts. Yale Journal of Biology and Medicine 45:373-83 (aDVC) (1978) Reviewer evaluation of manuscripts submitted to medical journals. Paper presented to the American Statistical Association Meetings, San Diego, CA. (also abstracted in Biometrics (1978) 34:728) (aDVC) Cicchetti, D. V. Ac Eron, L. D. (1979) The reliability of manuscript reviewing for the Journal of Abnormal Psychology. Proceedings of the American Statistical Association (Social Statistics Section) 22:596-600. [aDVC] Cicchetti. D. V. Ac Feinstein, A. R. (1990) High agreement but low kappa: II. Resolving the paradoxes. Journal of Clinical Epidemiology 43:55168. (arDVC) Cicchetti, D. V. Ac Fleiss, J. L (1977) Comparison of the null distributions of weighted kappa and the C ordinal statistic. Applied Psychological Measurement 1:195-201. (aDVC) Cicchetti. D. V. Ac Heavens, R. (1979) RATCAT (Rater Agreement/Categorical Data). American Statistician 33:91. (aDVC) Cicchetti. D. V. Ac Showalter. D. (1988) A computer program for determining the reliability of dimensionally scaled data when the numbers and specific sets of examiners may vary at each assessment. Educational and Psychological Measurement 48:717-20. (aDVC) Cicchetti. D. V. Ac Sparrow, S. S. (1981) Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency 86:12737. [aDVC] Cicchetti, D. V. Ac Tyrer, P. (1988) Reliability and validity of personality assessment. In: Personality disorders : Diagnosis, management and course, ed. P. L. Tyrer. Butterworth Scientific Ltd. [rDVC]