Psychometric evaluation of an Indonesian version of the Brief Self-Control Scale: Item calibration using polytomous Rasch models

Diana Mutiah; Bobby Suwandi; Muhammad Dwirifqi Kharisma Putra

doi:10.19090/pp.v18i2.2559

Authors

Diana Mutiah Faculty of Psychology, Universitas Islam Negeri Syarif Hidayatullah Jakarta, Indonesia https://orcid.org/0000-0002-4934-6825
Bobby Suwandi Faculty of Psychology, Universitas Pancasila, Indonesia https://orcid.org/0009-0002-1961-3002
Muhammad Dwirifqi Kharisma Putra Faculty of Psychology, Universitas Gadjah Mada, Indonesia https://orcid.org/0000-0002-9383-7904

DOI:

https://doi.org/10.19090/pp.v18i2.2559

Keywords:

BSCS, calibration, self-control, partial credit model, Rasch model, validation

Abstract

This study aimed to evaluate the psychometric properties of the 10-item Indonesian version of the Brief Self-Control Scale (BSCS). It used the polytomous Rasch model, which enables more detailed analysis, including differential item functioning (DIF) analysis. The participants in this study were 1001 Indonesian high school students. We found that the partial credit model (PCM) was a better fit than the rating scale model. Furthermore, the unidimensionality, local independence, and monotonicity assumptions of the PCM were valid for the BSCS. Q5 was the only item that did not fit the PCM. The step parameters of the BSCS functioned well, with values ranging from low to high, as expected, for all items, indicating monotonicity. Person separation reliability was 0.71, indicating that the BSCS has good internal consistency. The DIF analysis showed that item Q5 functioned differently across genders. In general, the remaining nine items of the BSCS have good psychometric properties for measuring self-control.

Metrics

Metrics Loading ...

References

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573. https://doi.org/10.1007/BF02293814

Andrich, D. (2013). An expanded derivation of the threshold structure of the polytomous Rasch model that dispels any “threshold disorder controversy”. Educational and Psychological Measurement, 73(1), 78–124. https://doi.org/10.1177/0013164412450877

Andrich, D., & Marais, I. (2019). A course in rasch measurement theory: measuring in the educational, social and health sciences. Springer Nature Singapore Pte Ltd. https://doi.org/10.1007/978-981-13-7496-8

Arifin, H., & Milla, M. (2020). Adaptasi dan properti psikometrik skala kontrol diri ringkas versi Indonesia. Jurnal Psikologi Sosial, 18(2), 179-195. https://doi.org/10.7454/jps.2020.18

Asgarian, F. S., Namdari, M., & Soori, H. (2020). Reliability and validity of Persian version of Brief Self-Control Scale (BSCS) in motorcyclists. International Journal of Psychiatry in Clinical Practice, 24(2), 176–182. https://doi.org/10.1080/13651501.2019.1711423

Bertrams, A., & Dickhäuser, O. (2009). High-school students' need for cognition, self-control capacity, and school achievement: Testing a mediation hypothesis. Learning and Individual Differences, 19(1), 135–138. https://doi.org/10.1016/j.lindif.2008.06.005

Boone, W. J. (2020). Rasch basics for the novice. In M. S. Khine (Ed.), Rasch measurement: Applications in quantitative educational research (pp. 9-30). Springer. https://doi.org/10.1007/978-981-15-1800-3_2

Brevers, D., Foucart, J., Verbanck, P., & Turel, O. (2017). Examination of the validity and reliability of the French version of the Brief Self-Control Scale. Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement, 49(4), 243–250. https://doi.org/10.1037/cbs0000086

Chen, W., Zhang, G., Tian, X., & Zhao, S. (2022). Factor structure and longitudinal measurement invariance of the Tangney's Brief Self-Control Scale in Chinese adolescents. Frontiers in Public Health, 10, Article 802448. https://doi.org/10.3389/fpubh.2022.802448

Chiesi, F., Bonacchi, A., Lau, C., Tosti, A. E., Marra, F., & Saklofske, D. H. (2020). Measuring self-control across gender, age, language, and clinical status: A validation study of the Italian version of the Brief Self-Control Scale (BSCS). PLoS ONE, 15(8), e0237729. https://doi.org/10.1371/journal.pone.0237729

Cobb-Clark, D. A., Kong, N., & Schildberg-Hörisch, H. (2023). The stability of self-control in a population-representative study. Journal of Economic Psychology, 95, 1–10. https://doi.org/10.1016/j.joep.2022.102599

de Ridder, D. T. D., De Boer, B. J., Lugtig, P., Bakker, A. B., & van Hooft, E. A. J. (2011). Not doing bad things is not equivalent to doing the right thing: Distinguishing between inhibitory and initiatory self-control. Personality and Individual Differences, 50(7), 1006-1011. https://doi.org/10.1016/j.paid.2011.01.015

DeMars, C. (2010). Item response theory. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195377033.001.0001

Duckworth, A. L., & Kern, M. L. (2011). A meta-analysis of the convergent validity of self-control measures. Journal of Research in Personality, 45(3), 259–268. https://doi.org/10.1016/j.jrp.2011.02.004

Fekih-Romdhane, F., Postigo, Á., González-Nuevo, C., Dabbous, M., Malaeb, D., Obeid, S., & Hallit, S. (2022). Psychometric properties of the Arabic version of the Oviedo Grit Scale (A‑EGO) in non-clinical adults from the general population. BMC Psychiatry, 22(1), 792. https://doi.org/10.1186/s12888-022-04466-1

Ferrari, J. R., Stevens, E. B., & Jason, L. A. (2009). The role of self-regulation in abstinence maintenance: Effects of communal living on self-regulation. Journal of Groups in Addiction & Recovery, 4(1–2), 32–41. https://doi.org/10.1080/15560350802712371

Fung, S., Kong, C. Y. W., & Huang, Q. (2020). Evaluating the dimensionality and psychometric properties of the brief self-control scale amongst Chinese University Students. Frontiers in Psychology, 10, 2903. https://doi.org/10.3389/fpsyg.2019.02903

García-Castro, F. J., Bendayan, R., & Blanca, M. J. (2024). Validity evidence for the Brief Self-Control Scale in the Spanish adult population: A systematic study. Journal of Personality Assessment, 106(2), 208-217. https://doi.org/10.1080/00223891.2023.2220403

Gibson, C. L., Ward, J. T., Wright, J. P., Beaver, K. M., & Delisi, M. (2010). Where does gender fit in the measurement of self-control? Criminal Justice and Behavior, 37(8), 883–903. https://doi.org/10.1177/0093854810369082

Gillebaart, M. (2018). The ‘operational’ definition of self-control. Frontiers in Psychology, 9, 1231. https://doi.org/10.3389/fpsyg.2018.01231

Gori, A., Topino, E., Svicher, A., Schuldberg, D., & Di Fabio, A. (2022). Insight orientation scale: A promising tool for organizational outcomes–A psychometric analysis using item response theory. Frontiers in Psychology, 13, 987931. https://doi.org/10.3389/fpsyg.2022.987931

Hagger, M., Zhang, C.-Q., Kangro, E.-M., Ries, F., Wang, J. C. K., Heritage, B., & Chan, D. K. C. (2021). Trait self-control and self-discipline: Structure, validity, and invariance across national groups. Current Psychology, 40(3), 1015-1030. https://doi.org/10.1007/s12144-018-0021-6

Holster, T. A., & Lake, J. (2016). Guessing and the Rasch model. Language Assessment Quarterly, 13(2), 124–141. https://doi.org/10.1080/15434303.2016.1160096

Irribarra, D. T., & Freund, R. (2024). Package ‘WrightMap’. Retreived from https://cran.r-project.org/web/packages/WrightMap/WrightMap.pdf

Jo, Y., & Bouffard, L. (2014). Stability of self-control and gender. Journal of Criminal Justice, 42(4), 356–365. https://doi.org/10.1016/j.jcrimjus.2014.05.001

Karabatsos, G. (2000). A critique of Rasch residual fit statistics. Journal of Applied Measurement, 1(2), 152–176.

Kupper, N., Duijndam, S., & Karreman, A. (2020). Emotion expressivity in the Dutch: Validation of the Dutch translation of the Berkeley Expressivity Questionnaire. Psychological Assessment, 32(5), 28–34. https://doi.org/10.1037/pas0000812

Linacre, J. (1992). Why fuss about statistical sufficiency? Rasch Measurement Transactions, 6(3), 230. https://www.rasch.org/rmt/rmt63c.htm

Linacre, J. M. (2013). Differential item functioning (DIF) sample size nomogram. Rasch Measurement Transactions, 26(4), 1391. https://www.rasch.org/rmt/rmt264a.htm

Linacre, J. M. (2021). Winsteps® Rasch measurement computer program user's guide (Version 5.1.4). Winsteps.com.

Liu, X., & Boone, W. J. (2023). Introduction to advances in applications of Rasch measurement in science education. In X. Liu, & W. J. Boone (Eds.), Advances in applications of Rasch measurement in science education (pp. 1-18). Springer. https://doi.org/10.1007/978-3-031-28776-3_1

Mair, P. (2018). Modern psychometrics with R. Springer International Publishing AG. https://doi.org/10.1007/978-3-319-93177-7

Maloney, P. W., Grawitch, M. J., & Barber, L. K. (2012). The multi-factor structure of the Brief Self-Control Scale: Discriminant validity of restraint and impulsivity. Journal of Research in Personality, 46(1), 111–115. https://doi.org/10.1016/j.jrp.2011.10.001

Manapat, P. D., Edwards, M. C., MacKinnon, D. P., Poldrack, R. A., & Marsch, L. A. (2021). A psychometric analysis of the Brief Self-Control Scale. Assessment, 28(2), 395-412. https://doi.org/10.1177/1073191119890021

Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149–174. https://doi.org/10.1007/BF02296272

Milyavskaya, M., Berkman, E. T., & de Ridder, D. T. D. (2019). The many faces of self-control: Tacit assumptions and recommendations to deal with them. Motivation Science, 5(1), 79–85. https://doi.org/10.1037/mot0000108

Muthén, L. K., & Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9(4), 599–620. https://doi.org/10.1207/S15328007SEM0904_8

Nebioglu, M., Konuk, N., & Eroglu, Y. (2012). The investigation of validity and reliability of the Turkish version of the Brief Self-Control Scale. Klinik Psikofarmakoloji Bülteni-Bulletin of Clinical Psychopharmacology, 22(4), 340-351. https://doi.org/10.5455/bcp.20120911042732

Ozaki, Y., Goto, T., Kobayashi, M., & Kutsuzawa, G. (2016). Reliability and validity of the Japanese translation of Brief Self-Control Scale (BSCS-J). Shinrigaku Kenkyu: The Japanese Journal of Psychology, 87(2), 144-154. https://doi.org/10.4992/jjpsy.87.14222

Papanikolopoulos, P., Mastrotheodoros, S., Papanikolopoulou, S. Eleni Parlapani, E., & Kaprinis, S. G. (2022) The brief self-control scale: Dimensionality and psychometric properties in Greek young adults. European Journal of Developmental Psychology, 19(6), 925-937. https://doi.org/10.1080/17405629.2021.1964070

Paramitha, D. S., & Ariani, L. (2024). Hubungan kontrol diri dengan stress kerja pada bidan di rumah sakit Banjarmasin. MANUJU: Malahayati Nursing Journal, 6(6), 2415-2425. https://doi.org/10.33024/mnj.v6i6.11124

Pechorro, P., DeLisi, M., Gonçalves, R. A., Quintas, J., & Hugo Palma, V. (2021). The brief self-control scale and its refined version among incarcerated and community youths: Psychometrics and measurement invariance. Deviant Behavior, 42(3), 425–442. https://doi.org/10.1080/01639625.2019.1684942

Pilcher, J. J., Morris, D. M., & Erikson, D. N. (2023). Self-control measurement methodologies: An integrative approach. Psychological Reports, 126(3), 1108–1129. https://doi.org/10.1177/00332941211067969

Qonita, M., & Herdi, H. (2023). Asesmen kontrol diri peserta didik dan implikasinya terhadap program bimbingan dan konseling di SMA. Jurnal Mahasiswa Bimbingan dan Konseling, 9(2), 331-341. http://dx.doi.org/10.31602/jmbkan.v9i2.11257

Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Danish Institute for Educational Research.

Rusch, T., Lowry, P. B., Mair, P., & Treiblmaier, H. (2017). Breaking free from the limitations of classical test theory: Developing and measuring information systems scales using item response theory. Information & Management, 54(2), 189-203. https://doi.org/10.1016/j.im.2016.06.005

Saggino, A., Molinengo, G., Rogier, G., Garofalo, G., Loera, B., Tommasi, M., & Velotti, P. (2020). Improving the psychometric properties of the dissociative experiences scale (DES-II): A Rasch validation study. BMC Psychiatry, 20, 8. https://doi.org/10.1186/s12888-019-2417-8

Smith, E. (2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3(2), 205–231.

Smith, R. M. (1994). Detecting item bias in the Rasch Rating Scale Model. Educational and Psychological Measurement, 54(4), 886-896. https://doi.org/10.1177/0013164494054004004

Stavrova, O., Ren, D., & Pronk, T. (2022). Low self-control: A hidden cause of loneliness? Personality and Social Psychology Bulletin, 48(3), 347-362. https://doi.org/10.1177/01461672211007228

Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004). High self-control predicts good adjustment, less pathology, better grades, and interpersonal success. Journal of Personality, 72(2), 271–322. https://doi.org/10.1111/j.0022-3506.2004.00263.x

Tennant, A., & Küçükdeveci, A. A. (2023). Application of the Rasch measurement model in rehabilitation research and practice: early developments, current practice, and future challenges. Frontiers in Rehabilitation Sciences, 4, Article 1208670. https://doi.org/10.3389/fresc.2023.1208670

Welter, V. D. E., Dawborn-Gundlach, M., Großmann, L., & Krell, M. (2024). Adapting a self-efficacy scale to the task of teaching scientific reasoning: Collecting evidence for its psychometric quality using Rasch measurement. Frontiers in Psychology, 15, Article 1339615. https://doi.org/10.3389/fpsyg.2024.1339615

Wind, S. A. (2023). Detecting rating scale malfunctioning with the Partial Credit Model and Generalized Partial Credit Model. Educational and Psychological Measurement, 83(5), 953-983. https://doi.org/10.1177/00131644221116292

Wright, B. D., & Stone, M. (1999). Measurement essentials (2nd ed.). Wide Range, Inc.

Wu, M., Tam, H. P., & Jen, T.-H. (2016). Educational measurement for applied researchers: theory into practice. Springer Nature Singapore Pte Ltd.

Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8(2), 125-145. https://doi.org/10.1177/014662168400800201

Youngerman, E., Dahl, L. S., & Mayhew, M. J. (2021). Examining the psychometric properties of a New Integrative Learning Scale. Research in Higher Education, 62(6), 829-854. https://doi.org/10.1007/s11162-021-09623-1

Zwagery, R. V., Erlyani, N., Mayangsari, M. D., & Sugma, K. A. A. (2023). Kontrol diri dan perilaku pro-lingkungan. Psibernetika, 16(2), 63-69. http://dx.doi.org/10.30813/psibernetika.v16i2.3654