TREND OF USING SITUATIONAL JUDGEMENT TEST ON SCHOOL TEACHERS: A SYSTEMATIC LITERATURE REVIEW

Authors

  • Azad Iqram Nadmilail
  • Mohd Effendi Ewan Mohd Matore

Keywords:

Situational Judgement Tests; School Teachers; Country-of-origin; Time Trends; Systematic Literature Review

Abstract

Situational Judgement Tests (SJTs) have become progressively famous instruments that have been utilized in various fields, especially for personnel selection, promotion, and recruitment. There have been several research studies conducted on school teachers. However, there is an absence of attention in such studies regarding the analysis of the country-of-origin and time trends of SJTs in research. This review will turn out to be more gainful for the educational researcher to enhance their insight and comprehension of the research trend for further studies. Hence, this study aims to review country-of-origin trends and time trends of SJTs research on school teachers. This study employed a Systematic Literature Review (SLR) as a research method which comprises a review protocol that specifies the topic to be investigated and the method customized in conducting the review. It has significant benefits to detect relevant literature review and how information is acquired from the primary study. Planning, conducting, and reporting the review are phases of the SLR method. This study found that the SJTs on school teachers are most widely utilized in European countries and have grown dramatically by 27.78 percent for over the past ten years throughout the world. This study recommends several active researchers as an expert and their research practices that can be referred to. Detailed empirical studies should be conducted to see the purpose of the studies practiced and the characteristics of the attributes and competencies being measured. Sifting articles can be improved the research by using non-common languages, utilizing a more extensive database, and exploring other research features through in-depth research.

Downloads

Download data is not yet available.

References

Al Hashmi, W., & Klassen, R. M. (2019). Developing a situational judgement test for admission into initial teacher education in Oman: An exploratory study. International Journal of School and Educational Psychology, 8(1), 187–198. https://doi.org/10.1080/21683603.2019.1630042

Aldrup, K., Carstensen, B., Köller, M. M., & Klusmann, U. (2020). Measuring Teachers’ Social-Emotional Competence: Development and Validation of a Situational Judgment Test. Frontiers in Psychology, 11, 892. https://doi.org/10.3389/fpsyg.2020.00892

Bardach, L., Rushby, J. V., Kim, L. E., & Klassen, R. M. (2020). Using video- and text- based situational judgement tests for teacher selection: a quasi-experiment exploring the relations between test format, subgroup differences, and applicant reactions. European Journal of Work and Organizational Psychology. https://doi.org/10.1080/1359432X.2020.1736619

Beauchamp, G., Clarke, L., Hulme, M., & Murray, J. (2013). Research and Teacher Education: The BERA-RSA inquiry. Policy and Practice within the United Kingdom. In The BERA-RSA Inquiry: Vol. Taylor. http://www.bera.ac.uk/resources/research-and- teacher-education-bera-rsa-inquiry

Breen, R., & Lindsay, R. (2020). Different Disciplines Require Different Motivations for Student Success. Research in Higher Education, 43, 693–725. https://doi.org/10.1023/a:1020940615784

Carneiro, I., Howard, N., & Bailey, L. (2011). Introduction to Epidemiology. United Kingdom: Open University Press.

Chao, T. Y., Sung, Y. T., & Huang, J. L. (2019). Construction of the situational judgment tests for teachers. Asia-Pacific Journal of Teacher Education, 48(4), 355–374. https://doi.org/10.1080/1359866X.2019.1633621

Dinnie, K. (2004). Country-of-Origin 1965-2004: A Literature Review. Journal of Customer Behaviour, 3(2), 165–213.

Durksen, T. L., & Klassen, R. M. (2018). The development of a situational judgement test of personal attributes for quality teaching in rural and remote Australia. Australian Educational Researcher, 45(2), 255–276. https://doi.org/10.1007/s13384-017-0248-5

Elliott, J. G., Stemler, S. E., Sternberg, R. J., Grigorenko, E. L., & Hoffman, N. (2011). The

socially skilled teacher and the development of tacit knowledge. British Educational Research Journal, 37(1), 83–103. https://doi.org/10.1080/01411920903420016

Erickson, A., & Herbst, P. (2018). Will Teachers Create Opportunities for Discussion when Teaching Proof in a Geometry Classroom? International Journal of Science and Mathematics Education, 16(1), 167–181. https://doi.org/10.1007/s10763-016-9764-4

Feranchak, B., & Deiger, M. (2017). Development of a Situational Judgment Task for Assessing Teacher Leadership in Mathematics. AERA Online Paper Repository. https://doi.org/10.302/1181287

Feuer, M. J., Floden, R. E., Chudowsky, N., & Ahn, J. (2013). Evaluation of teacher preparation programs : purposes, methods, and policy options. Washington, D.C., United States: National Academy of Education.

Finger, J. D., Busch, M. A., Heidemann, C., Lange, C., Mensink, G. B. M., & Schienkiewitz, A. (2019). Time trends in healthy lifestyle among adults in Germany: Results from three national health interview and examination surveys between 1990 and 2011. PLOS ONE, 14(9), 1–16. https://doi.org/10.1371/journal.pone.0222218

Gold, B., & Holodynski, M. (2015). Development and Construct Validation of a Situational Judgment Test of Strategic Knowledge of Classroom Management in Elementary Schools. Educational Assessment, 20(3), 226–248. https://doi.org/10.1080/10627197.2015.1062087

Gold, B., & Holodynski, M. (2017). Using digital video to measure the professional vision of elementary classroom management: Test validation and methodological challenges. Computers and Education, 107, 13–30. https://doi.org/10.1016/j.compedu.2016.12.012

Gold, B., Pfirrmann, C., & Holodynski, M. (2020). Promoting Professional Vision of Classroom Management Through Different Analytic Perspectives in Video-Based Learning Environments. Journal of Teacher Education, 1-17. https://doi.org/10.1177/0022487120963681

Golubovich, J., Lake, C. J., Anguiano-Carrasco, C., & Seybert, J. (2020). Measuring Achievement Striving via a Situational Judgment Test: The Value of Additional Context. Revista de Psicologia Del Trabajo y de Las Organizaciones, 36(2), 157–167. https://doi.org/10.5093/jwop2020a15

Golubovich, J., Seybert, J., Martin-Raugh, M., Naemi, B., Vega, R. P., & Roberts, R. D. (2017). Assessing Perceptions of Interpersonal Behavior with a Video-Based Situational Judgment Test. International Journal of Testing, 17(3), 191–209. https://doi.org/10.1080/15305058.2016.1194275

Gusenbauer, M. (2019). Google Scholar to overshadow them all? Comparing the sizes of 12 academic search engines and bibliographic databases. Scientometrics., 118(1), 177– 214. https://doi.org/https://doi.org/10.1007/s11192-018-2958-5

Jeff A. Weekley, & Robert E. Ployhart. (2013). An Introduction to Situational Judgement Testing. In J. A. Weekley & R. E. Ployhart (Eds.), Situational Judgment Tests: Theory, Measurement and Application (pp. 1–10). New Jersey: Psychology Press. https://doi.org/10.4324/9780203774878

Jelsma, J. G. M., Gale, J., Loyen, A., van Nassau, F., Bauman, A., & van der Ploeg, H. P. (2019). Time trends between 2002 and 2017 in correlates of self-reported sitting time in European adults. PLOS ONE., 14(11), 1–15. https://doi.org/10.1371/journal.pone.0225228

Karabulut-Ilgu, A., Jaramillo Cherrez, N., & Jahren, C. T. (2018). A systematic review of research on the flipped learning method in engineering education. British Journal of Educational Technology, 49(3), 398–411. https://doi.org/10.1111/bjet.12548

Kim, L. E., & Klassen, R. M. (2018). Teachers’ cognitive processing of complex school- based scenarios: Differences across experience levels. Teaching and Teacher Education, 73, 215–226. https://doi.org/10.1016/j.tate.2018.04.006

Klassen, R. M., Durksen, T. L., Al Hashmi, W., Kim, L. E., Longden, K., Metsäpelto, R. L., Poikkeus, A. M., & Györi, J. G. (2018). National context and teacher characteristics: Exploring the critical non-cognitive attributes of novice teachers in four countries. Teaching and Teacher Education, 72, 64–74. https://doi.org/10.1016/j.tate.2018.03.001

Klassen, R. M., Durksen, T. L., Kim, L. E., Patterson, F., Rowett, E., Warwick, J., Warwick, P., & Wolpert, M. (2016). Developing a Proof-of-Concept Selection Test for Entry into Primary Teacher Education Programs. International Journal of Assessment Tools in Education, 4(2), 96–114. https://doi.org/10.21449/ijate.275772

Klassen, R. M., Durksen, T., Rowett, E., & Patterson, F. (2014). Applicant Reactions to a Situational Judgment Test used for Selection into Initial Teacher Training. International Journal of Educational Psychology, 3(2), 104–124. https://doi.org/10.4471/ijep.2014.07

Klassen, R. M., & Kim, L. E. (2019). Selecting teachers and prospective teachers: A meta- analysis. Educational Research Review, 26, 32–51. https://doi.org/10.1016/j.edurev.2018.12.003

Klassen, R. M., Kim, L. E., Rushby, J. V., & Bardach, L. (2020). Can we improve how we screen applicants for initial teacher education? Teaching and Teacher Education, 87, 1–11. https://doi.org/10.1016/j.tate.2019.102949

Li, K., Rollins, J., & Yan, E. (2017). Web of Science use in published research and review papers 1997–2017: A selective, dynamic, cross-domain, content-based analysis. Scientometrics, 115(1), 1–20. https://doi.org/10.1007/s11192-017-2622-5

Lievens, F., & Patterson, F. (2011). The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection. The Journal of Applied Psychology, 96(5), 927–940. https://doi.org/10.1037/a0023496

Lievens, Filip, & Coetsier, P. (2002). Situational Tests in Student Selection: An Examination of Predictive Validity, Adverse Impact, and Construct Validity. International Journal of Selection and Assessment, 10(4), 245–257. https://doi.org/10.1111/1468-2389.00215

Lievens, Filip, Peeters, H., & Schollaert, E. (2008). Situational judgment tests: A review of recent research. Personnel Review, 37(4), 426–441. https://doi.org/10.1108/00483480810877598

Matošková, J., & Kovářík, M. (2017). Development of a Situational Judgment Test as a Predictor of College Student Performance. Journal of Psychoeducational Assessment, 35(8), 768–784. https://doi.org/10.1177/0734282916661663

Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Journal of Clinical Epidemiology, 62(10), 1006–1012. https://doi.org/10.1016/j.jclinepi.2009.06.005

Motowidlo, S. J., & Beier, M. E. (2010). Differentiating specific job knowledge from implicit trait policies in procedural knowledge measured by a situational judgment test. Journal of Applied Psychology, 95(2), 321–333. https://doi.org/10.1037/a0017975

Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2006). Implicit policies about relations between personality traits and behavioral effectiveness in situational judgment items. Journal of Applied Psychology, 91(4), 749–761. https://doi.org/10.1037/0021- 9010.91.4.749

National Research Council. (2015). Situations and Situational Judgment Tests. In National Research Council (Ed.), Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession (pp. 187–199). National Academies Press. https://doi.org/10.17226/19017

O’Connell, M. S., Hartman, N. S., McDaniel, M. A., Grubb, W. L., & Lawrence, A. (2007). Incremental Validity of Situational Judgment Tests for Task and Contextual Job Performance. International Journal of Selection and Assessment, 15(1), 19–29. https://doi.org/10.1111/j.1468-2389.2007.00364.x

Patterson, F., Prescott-Clements, L., Zibarras, L., Edwards, H., Kerrin, M., & Cousans, F. (2016). Recruiting for values in healthcare: a preliminary review of the evidence. Advances in Health Sciences Education, 21(4), 859–881. https://doi.org/10.1007/s10459-014-9579-4

Patterson, F., & Driver, R. (2018). Situational Judgement Tests (SJTs). In F. Patterson & L. Zibarras (Eds.), Selection and Recruitment in the Healthcare Professions: Research, Theory and Practice (pp. 79–112). Palgrave Macmillan. https://doi.org/10.1007/978-3- 319-94971-0

Patterson, Fiona, Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016). How effective are selection methods in medical education? A systematic review. Medical Education, 50(1), 36–60. https://doi.org/10.1111/medu.12817

Pavlidou, K., & Alevriadou, A. (2020). An Assessment of General and Special Education Teachers’ and Students’ Interpersonal Competences and Its Relationship to Burnout. International Journal of Disability, Development and Education, 1-15. https://doi.org/10.1080/1034912X.2020.1755425

Pavlidou, K., Alevriadou, A., & Antoniou, A. S. (2020). Professional burnout in general and special education teachers: the role of interpersonal coping strategies. European Journal of Special Needs Education, 1-18.

https://doi.org/10.1080/08856257.2020.1857931

Petticrew, M., & Roberts, H. (2006). Systematic Reviews in the Social Sciences. Blackwell Publishing Ltd. https://doi.org/10.1002/9780470754887

Ryan, A. M., & Ployhart, R. E. (2014). A century of selection. Annual Review of Psychology, 65(1), 693–717. https://doi.org/https://doi.org/10.1146/annurev-psych-

-115134

Schleicher, A. (Ed.). (2014). Equity, Excellence and Inclusiveness in Education. Paris: OECD Publishing. https://doi.org/10.1787/9789264214033-en

Scully, D., Pitsia, V., & Karakolidis, A. (2019). Exploring the interpersonal dimension of teaching in an Irish post-primary context. Irish Educational Studies, 39(3), 355–374. https://doi.org/10.1080/03323315.2019.1697947

Shaffril, H. A. M., Samsuddin, S. F., & Samah, A. A. (2020). The ABC of systematic literature review: the basic methodological guidance for beginners. Quality & Quantity, 1-28.https://doi.org/https://doi.org/10.1007/s11135-020-01059-6

Sheridan, L., Durksen, T. L., & Tindall-Ford, S. (2019). Understanding the reasoning of pre-service teachers: a think-aloud study using contextualised teaching scenarios. Teacher Development, 23(4), 425–446.

https://doi.org/10.1080/13664530.2019.1640281

Wernimont, P. F., & Campbell, J. P. (1968). Signs, samples, and criteria. Journal of Applied Psychology, 52(5), 372–376. https://doi.org/10.1037/h0026244

Whetzel, D. L., & McDaniel, M. A. (2009). Situational judgment tests: An overview of current research. Human Resource Management Review, 19(3), 188–202. https://doi.org/10.1016/j.hrmr.2009.03.007

Whetzel, D., Sullivan, T., & McCloy, R. (2020). Situational Judgment Tests: An Overview of Development Practices and Psychometric Characteristics. Personnel Assessment and Decisions, 6(1), 1–16. https://doi.org/10.25035/pad.2020.01.001

Zakaria, M. H., Yatim, B., & Ismail, S. (2014). Implementation of graduate employability skills SJT instrument in Universiti Utara Malaysia. AIP Conference Proceedings, 1635, 962–965. https://doi.org/10.1063/1.4903698

Zhu, J., & Liu, W. (2020). A tale of two databases: the use of Web of Science and Scopus in academic papers. Scientometrics, 123(1), 321–335. https://doi.org/https://doi.org/10.1007/s11192-020-03387-8

Downloads

Published

2021-04-30

How to Cite

Nadmilail, A. I. ., & Matore, M. E. E. M. . (2021). TREND OF USING SITUATIONAL JUDGEMENT TEST ON SCHOOL TEACHERS: A SYSTEMATIC LITERATURE REVIEW. The Journal of Contemporary Issues in Business and Government, 27(2), 6117–6141. Retrieved from https://cibgp.com/au/index.php/1323-6903/article/view/1501

Issue

Vol. 27 No. 2 (2021): The journal of contemporary issues in business and government

Section

Articles

License

You are free to:

  1. Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
  2. Adapt — remix, transform, and build upon the material for any purpose, even commercially.
  3. The licensor cannot revoke these freedoms as long as you follow the license terms.

Under the following terms:

  1. Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  2. No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

Notices:

You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .

No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.