Services on Demand
Article
Indicators
Related links
-
Cited by Google
-
Similars in Google
Share
South African Journal of Education
On-line version ISSN 2076-3433
Print version ISSN 0256-0100
S. Afr. j. educ. vol.43 n.4 Pretoria Nov. 2023
http://dx.doi.org/10.15700/saje.v43n4a2289
ARTICLES
Teachers' mathematics pedagogical content knowledge and quality of early mathematics instruction in Turkey
Maide Orcan-KacanI; Neslihan Dedeoglu-AktugI; Muhammet M. AlpaslanII
IDepartment of Early Childhood Education, Faculty of Education, Mugla Sitki Kocman University, Mugla, Turkey ndedeoglu@mu.edu.tr
IIDepartment of Science Education, Faculty of Education, Mugla Sitki Kocman University, Mugla, Turkey
ABSTRACT
It is a well-known fact that societies today need to provide quality mathematics education to individuals from their early years in order to compete on a global scale. Although there is a growing interest in early mathematics, there are still some obstacles regarding quality mathematics instruction. Two of the most important obstacles are the mathematics pedagogical content knowledge (MPCK) and early mathematics teacher qualification of pre-school teachers. The purpose of this study was to evaluate the relationship between pre-school teachers' classroom mathematics practices and their MPCK. The study included 55 pre-school teachers. Classroom Observation of Early Mathematics - Environment and Teaching (COEMET) was adapted into Turkish. The teachers' MPCK was assessed using the Survey of Pedagogical Content Knowledge in Early Childhood Mathematics (SPECKECM). The results show that the teachers' MPCK was at a medium level, being most successful regarding shapes and least in patterns. The COEMET scores were positively and statistically significantly correlated to the total score of the SPECKECM. Moreover, teachers' pedagogical content knowledge (PCK) scores successfully predicted the total COEMET scores.
Keywords: early mathematics; instructional quality; pedagogical content knowledge
Introduction
Global competition in the 21st century is based on a productive and innovative economy. An innovative economy demands a competent and satisfactory workforce that excel in mathematics (National Research Council [NRC], 2009). In this sense, mathematics is critical for all members of all societies in the world.
The National Council of Teachers of Mathematics (NCTM) and the National Association for the Education of Young Children (NAEYC) report that high-quality, challenging, and accessible mathematics education for children aged 3 to 6 is vital for future mathematics learning (NAEYC & NCTM, 2002/2010). Also, many studies show that early mathematics learning experiences contribute to children's learning and later achievement, in many fields, especially in mathematics (Bailey, Siegler & Geary 2014; Claessen & Engel, 2013; Ten Braak, Lenes, Purpura, Schmitt & Sterksen, 2022; Watts, Duncan, Siegler & Davis-Kean, 2014).
Early mathematics education should include stimulating activities and learning environments that offer experiences to expand children' s knowledge and develop mathematical concepts and skills. Thus, mathematics education is linked to the child, teacher, and environment in which teaching and learning opportunities take place (Björklund, Van den Heuvel-Panhuizen & Kullberg, 2020).
Literature Review
International assessment and evaluation examinations, such as the Program for International Student Assessment (PISA) of the Organisation for Economic Co-operation and Development (OECD), are conducted to provide countries with comparative data on their education systems. PISA measures the mathematical literacy, science literacy, and reading skills of 15-year-old students in 3-year cycles. PISA 2018 results indicate that Turkey's average score in mathematics had increased by 34 points compared to 2015 and reached 454. Turkey's success rate in mathematics literacy was 48.7% in PISA 2015. It has increased to 63.4% in the PISA 2018 report. According to the PISA 2018 results Turkey is the country that has increased its score the most, but still remained below the OECD average (OECD average = 489) in mathematics (Millî Eğitim Bakanlığı, 2019).
Current studies in the field of early mathematics show that Turkey has some issues with teachers' pedagogical content knowledge (PCK) and mathematics teaching. Some of these issues are that teachers do not have sufficient knowledge of mathematical concepts and skills (Pekince & Avcı, 2016). Most teachers think that early mathematics cover only numbers (Fırat & Dinçer, 2018) and shapes (Yazlik & Öngören, 2018). Teachers experience difficulties in planning mathematics activities (Pekince & Avcı, 2016), and they do not sufficiently include mathematical activities in their daily plans (Pekince & Avcı, 2016). The mathematics activities they plan are mostly teacher centred (Erincik, 2020) and at anti-participation level (Pekince & Avcı, 2016). Teachers evaluate whether students have learned mathematical concepts but cannot do the evaluation systematically (Tarim & Bulut, 2006). They are weak in evaluating mathematics activities in general (Erincik, 2020; Koç, 2017) and they have limited knowledge in mathematics teaching methods (Koç, 2017). Furthermore, they do not find their own education sufficient for pre-school mathematics teaching (Tarim & Bulut, 2006), and need support in mathematics education (Koç, 2017). The research findings presented above show that pre-school and kindergarten teachers working in Turkey experience difficulties regarding both content and strategies in teaching mathematics. This can lead to serious obstacles in teaching early mathematics effectively.
Early mathematics knowledge is the strongest predictor of children's mathematics achievement in later school life (Watts et al., 2014). Despite the importance of the subject, research on the relationship between early childhood teachers' PCK in mathematics and the quality of instruction is quite limited (Corrigendum, 2015). To fill this gap in the literature, we investigated whether there was a significant relationship between teachers' mathematics pedagogical content knowledge (MPCK) and the quality of instruction. Teachers' PCK is evaluated according to certain indicators, such as how they teach content like number sense, patterns, ordering, shapes, spatial sense, and comparisons. The quality of instruction, however, is evaluated with indicators such as the characteristics of class culture and specific mathematical activities. Examining teachers' PCK of mathematics and the quality of instruction with these indicators can shed light on the characteristics of teachers' mathematics teaching and how young children's understanding of mathematics can be supported better.
Our literature review revealed that there was no valid and reliable tool to observe the quality of early mathematics practices in Turkey. Therefore, the quality of early mathematics practices in Turkey has not been investigated thus far. To close this gap in research, the Classroom Observation of Early Mathematics - Environment and Teaching (COEMET) has been adapted into Turkish as part of this study. There are four important reasons for using COEMET. The first is based on research. COEMET was created based on a body of research on the characteristics and teaching strategies of effective teachers of pre-school mathematics (Clements, Sarama & DiBiase, 2004; Sarama, Clements, Wolfe & Spitler, 2016). Another powerful feature is that other measurement tools like High-Impact Strategies for Early Mathematics ([HIS-EM] The Early Math Collaborative, 2011) evaluate only mathematics activity, while COEMET is a more holistic observation tool that evaluates class elements, class culture and special mathematics activity. COEMET also allows data collection with on-site observation. The last reason is that COEMET is not related to any specific curriculum (Kilday & Kinzie, 2009).
Among others, one goal of teacher education is to develop teachers' PCK because it has been associated with teaching quality. Studies addressing PCK in educational studies have assumed that the more teachers have PCK the more appropriate educational methods and practices they employ in classroom settings (Kulgemeyer & Riese, 2018). Additionally, Gropen, Kook, Hoisington and Clark-Chiarelli (2017) show that teachers with higher PCK tend to assess children's learning better, promote the use of scientific inquiry and plan in-depth investigation in science learning in early childhood classrooms. Evidence from these studies indicate that teachers' PCK is an indicator of their teaching quality.
To summarise, current literature shows significant problems in the field of pre-school mathematics in Turkey. Despite the importance of the issue, the number of studies is quite limited in Turkey and the rest of the world. The most prominent of these issues is what and how teachers teach mathematics. In addition, no study that evaluated the quality of the mathematics environment and activities offered by early childhood teachers in Turkey, and the teachers' PCK on mathematics, could be found (Bağci & Ivrendi, 2016; Çiltas, Güler & Sözbilir, 2012; Yıldız Altan, Genç Çopur & Dağlıoğlu, 2021).
In this context, it was thought that the results of observational research were especially needed for teachers who worked in early childhood classrooms to support children' s mathematical skills. In addition, it was also thought that the findings of this study would contribute significantly, not only to early childhood mathematics practices but also to early childhood teacher education. Three research questions guided our study:
1) Is the Turkish translation of COEMET a valid and reliable tool to measure the quality of mathematics teaching in pre-school classrooms?
2) Is there a significant relationship between pre-school teachers' classroom mathematics practices and their PCK scores?
3) What proportion of variance in the quality of mathematics instruction can be accounted for by PCK in early childhood classrooms?
Theoretical Framework
Young children are born mathematicians (NAEYC, 2014). They can construct some mathematical ideas and strategies by themselves. However, they cannot excel in mathematics without deliberate and high-quality education (Clements, 2001; Ginsburg & Ertle, 2008). One of the critical elements for high-quality mathematics education is teachers' PCK (Gervasoni, Hunter, Bicknell & Sexton, 2012; MacDonald, Davies, Dockett & Perry, 2012). According to Ginsburg and Amit (2008), pre-school teachers who have a deep understanding of mathematics and PCK can provide mathematics education that will help children to think mathematically in their daily activities.
The PCK concept was proposed by Shulman in 1986. It is defined as knowing what to teach to which age group and integrating it with the knowledge of how to teach. To establish a solid mathematical foundation in children, teachers should have deep knowledge and experience of mathematics, as well as knowing what and how children can learn mathematics (Zhang, 2015).
Therefore, an effective mathematics education begins with teachers having a good level of PCK (Bukova-Güzel, Canturk-Günhan, Kula, Özgür & Elçi, 2013; Jang, 2013). Effective teachers are knowledgeable about child development, learning styles, and effective teaching strategies, and they use these in designing learning environments (Copple & Bredekamp, 2009).
Researchers draw attention to the connection between young children's curiosity, meaningful learning, and achievement in mathematics with their teachers' pedagogical approach and the quality of teaching (Katz, 2015). Clements and Sarama (2002) also claim that mathematics should be rooted in and developed from children' s activities. Early mathematics education often takes place in natural learning environments, that is, it is embedded in what children are already doing (Gasteiger, 2012; Van Oers, 2010). In this respect, early mathematics education is different from school mathematics education. Early mathematics teaching requires encouraging children to recognise and think about numbers and mathematical structures in daily life, capturing the mathematics-related clues in children' s actions and speech, and providing learning experiences by transforming these everyday situations into mathematically appropriate learning opportunities (Ginsburg, Lee & Boyd, 2008; McCray & Chen, 2012). In societies where early childhood education is regarded as an integral part of the education system, the attention has shifted to its quality (Cerezci, 2020). High-quality early mathematics teaching and learning experiences can only be provided by qualified teachers (Sarama et al., 2016). What and how the teacher teaches early mathematics is one of the important indicators that determines the quality of the teacher (Gervasoni et al., 2012; MacDonald et al., 2012). Therefore, early childhood teachers should spontaneously promote mathematical learning processes in these informal learning situations.
Methodology
In this study, quantitative methods were used. The data were collected through observing and surveying the 55 pre-school classrooms/teachers. Rasch analysis, Pearson correlation analysis, and regression analysis were used to analyse the data.
Participants
Fifty-five female pre-school teachers participated in the study. The 55 classrooms were clustered in 20 schools within one urban and one suburban school district in one of the Aegean region provinces of Turkey.
All participating teachers were female, ranging in age between 25 and 51 years: 41 years old and above (45.50%), 36 to 40 years old (38.20%), 31 to 35 years old (8.50%), and 25 to 30 years old (6.50%). Regarding education, 89.00% held a bachelor's degree; 63.00% held a bachelor's degree in early childhood education, and 26.00% held a bachelor's degree in child development). There were 16 to 20 children in 65.50%, 10 to 15 children in 21.80%, and 21 and above children in 12.70% of the observed classrooms. There were no assistant teachers in 91.00% of the classes. Half of the classes consisted of 4-year-olds and the other half consisted of 5- to 6-year-old children.
Instruments
Three data collection tools were used in this study: 1) a demographic information survey (developed by the researchers); 2) a questionnaire (the Survey of Pedagogical Content Knowledge in Early Childhood Mathematics - SPECKECM); 3) an observation form (Classroom Observation of Early Mathematics - Environment and Teaching - COEMET).
The demographic information survey consists of a set of questions (items) to gain background information of the participant teachers and their classrooms, such as their gender, age, graduation degree, teaching experience, type of school, location of the school, classroom size and children's age groups. Teachers were requested to complete the survey prior to the classroom observation.
SPECKECM was developed by Smith (1998) to measure early childhood teachers' PCK in mathematics on six sub-category areas including number sense, ordering, shapes, pattern, spatial sense, and comparison. It has 15 multiple-choice items. Each item consists of three possible answers, one correct and two incorrect. Smith (2000) reported a good range of reliability (Cronbach's alpha = .70) and validity for SPECKECM by administering the survey to 400 early childhood teachers. SPECKECM was adapted into Turkish by Aksu and Kul (2017). Aksu and Kul (2017) reported KR-20 reliability scores as .71. In addition, confirmatory factor analysis was done to determine its validity. The results were x2 (75) = .95, RMSEA = .00, CFI = .99. For our study, the KR-20 reliability score was computed as .73. Therefore, the instrument was regarded as a reliable tool to measure pre-school teachers' PCK of mathematics.
COEMET was developed by Sarama and Clements (2007) to assess the quality of mathematics instruction including characteristics and teaching strategies of effective teachers in early childhood mathematics from pre-K to Grade 2. It is a classroom observation tool that evaluates classroom culture and the use of mathematics activities and is not connected to any curriculum (Clements & Sarama, 2008). It includes 28 items about how the teacher interacts with the children and uses teachable mathematics moments, how mathematics is displayed in the classroom, how confident the teacher appears in teaching mathematics. More specifically, it consists of four main sections: a) classroom elements, b) classroom culture, c) specific mathematics activities and d) other classroom elements.
The section on classroom elements includes four items about the general structure of the classroom (e.g., the number of running computers, the number of mathematics activities and their duration). The classroom culture is about the characteristics of the interaction among students and teachers, their knowledge about mathematics, enthusiasm for mathematics ideas and teachable moments in the classroom. It consists of two subsections, namely, environment and interaction (an example item: teacher used teachable moments) and personal attributes of teachers (example item: the teacher seems knowledgeable and confident in mathematics). The specific mathematics activities are about children sharing their ideas, mathematical focus, and teachers facilitating their responses, expectations and supporting their conceptual understanding. It comprises seven sub-sections as mathematical focus (example item: the mathematics activity is developmentally appropriate), organisation, teaching approaches and interaction (example item: the pace of activity is suitable for children's needs and levels), expectations (example item: the teacher has big and realistic expectations regarding children's mathematics ideas), eliciting children's solution methods (example item: the teacher facilitated children's responses), supporting children's conceptual understanding (example item: the teacher supported the listener's understanding), extending children's mathematical thinking (example item: the teacher elaborated on children's ideas) and assessment and instructional adjustment (example item: the teacher listened to children and took notes). The other classroom elements are non-scored items dealing with the number of students, adults and volunteers. The items in the COEMET were in a 5-point Likert scale (1: strongly disagree, to 5: strongly agree) except those in the classroom environments and the other classroom elements.
For research purposes, we translated COEMET into Turkish. Back-translations of all translations were done by two experts working in the field of educational sciences and English language to ensure that the quality of the translations was good. Based on the reviews and opinions of the experts, the final Turkish version of the COEMET was constructed. After constructing the final version, the first author ran five pilot observations in five classes. Because there was only one observer (rater) and video recording in the classroom was not allowed, the intra-rater reliability coefficient was calculated to determine the reliability of COEMET. To calculate the intra-rater coefficient, the five observations in the pilot study were used because the same classrooms were included in the data collection. As the COEMET has Likert-type items, the weighted Cohen's Kappa coefficient, which takes the magnitude of disagreement between the scores, was calculated as .89.
Previous studies in which the COEMET was used reported its reliability score as .70 cut-off value (e.g., Cronbach alpha as .97 in Clements & Sarama, 2008). Detailed information about the COEMET can be found in Sarama and Clements (2007).
Data Collection
The first author collected the observational data via COEMET since she was well experienced and trained by the developers of the tool to use the COEMET. The observations were conducted while the teachers were leading the mathematics activities. Each observation session took at least 3 class hours (150 minutes or more). The observer arrived in the classroom before class started and minimised her participation in order not to disturb the class culture. All observations were conducted over a period of 2.5 months (from 25 February to 15 May 2019).
The first two main sections of the COEMET were assessed once for each observation. The third main section was assessed for each mathematics activity.
Data related to the SPECKECM were collected via a paper-pencil form. Before observing the classroom, the SPECKECM form was handed out to each teacher who was given 10 minutes to complete it.
Data Analysis
To investigate the first research question (to measure the validity and reliability of the Turkish translation of COEMET), Rasch analysis was used. Unlike classical test theory, Rasch analysis uses logits rather than raw scores (Rasch, 1961). Logit is the unit of Rasch measurement that indicates the ratio of probability to give a correct response (responder's trait/ability level) (Bond & Fox, 2015). In Rasch measurement it is argued that most of affective variables in educational research are treated as an interval scale (Likert-scale items, strongly disagree etc.) which depends on the responder's understanding of strongly disagree (Bond & Fox, 2015). Thus, in the Rasch measurement model it is argued that Likert-scale items should be treated as an ordinal scale (Alpaslan, Özgür & Rıdvan, 2021).
In Rasch analysis, raw ordinal scores are transformed to the logits that indicate the item's difficulty in an linear scale (Elhan & Atakurt, 2005). A negative value for logits shows that the item is very easy to agree with (or easy item) whereas a positive value is for a difficult item (Bond & Fox, 2015). All analysis was run in Winsteps 3.80 software.
To address the second research question, Pearson correlation analysis was used. Firstly, we checked the normality of the data by examining the skewness and kurtosis values and results from the Shapiro-Wilk normality tests. For all sub-factors, kurtosis ranged from -0.99 to .12 and skewness from -0.48 to .0.37. Also, Shapiro-Wilk yielded a non-significant difference from the normality, which indicated the data had a normal distribution. For the third research question, regression analysis was used to test how much variance of COEMET could be explained by teachers' PCK scores.
Results
The purpose of this study was to examine the relationship between teachers' PCK (the SPECKECM scores) and the quality of mathematics teaching (the COEMET scores) and to understand how much variance of the COEMET scores is explained by teachers' PCK scores.
The results of the study are arranged under three headings: (a) Rasch analysis of the Turkish version of the COEMET (cf. Table 1 and Figure 1); (b) correlation between the COEMET and SPECKECM (cf. Tables 2 and 3); (c) regression between the COEMET and SPECKECM (cf. Table 4).
Findings regarding Research Question 1: Validity and Reliability Results of COEMET
Rasch analysis of the COEMET
Rasch analysis is a useful tool to examine the construct validity and reliability of a measurement. The fit of the items to the other items and responders was examined using Rasch analysis. Rasch fit statistics provide various useful information on detecting irrelevant items and items that are consistent with the underlying constructs. Point measure correlations in Rasch statistics in Table 1, for example, show whether items work together as a single construct. This demonstrates whether items correlate with their level of agreeability, and also, the magnitude of the correlations shows which items contribute more to the construct and which ones less (Planinic, Ivanjek & Susac, 2010). In addition, item infit/outfit mean square (MNSQ) and separation coefficients indicate items measuring a concept other than that estimated by the construct (Planinic et al., 2010).
Person reliability was .88 and item reliability was .92 for the COEMET. Rasch analysis provides a useful tool including a measure table and a Wrigth map which locates the items and person in the same interval scale. Table 1 represents the measure table of the Rasch analysis for COEMET. Figure 1 shows the Wrigth map of the COEMET. The measure table includes useful information about agreeability or attitudes of teachers and classroom culture in pre-school classrooms. In Table 1, the measure column indicates the degree of agreement or disagreement. For instance, item 27 measured the degree to which the teacher took notes and listened to the children (strongly disagree was graded as 1 and strongly agree was 5). Positive value indicates that the observer was less likely to agree that teachers took notes and listened to the children. Item 4 and item 5B were out of the scale on the positive side, which indicates that the observer did not note that children used mathematics software (item 4) and the mathematics area/centre had three sides (item 5B). Infit MNSQ and outfit MNSQ values indicate how well the data fit the Rasch model (Boone, Staver & Yale, 2013). Suggested values should be between .5 and 1.5 logits. As seen in Table 1, except for item 4 and item 5B, items fitted well in the Rasch model. For construct validity, correlation between items should be higher than .30 (Alpaslan et al., 2021). As seen in Table 1, the point measurement correlations between items in the COEMET were higher than the .30 cut-off point, except for item 5A, item 5B, item 4, and SBM.
In Figure 1, the frequency of the observations regarding the items in the COEMET decreases from bottom to top. The least observed items were item 5A, item 5B, item 4 and SBM and the most observed items were 11, 13, 7 and 10 respectively. Item 5B could not be included in the analysis since none of the observed classrooms had a three-sided mathematics centre (measure = 6.61). In addition, it was observed that very few pre-school classrooms had mathematics centres (measure = 3.36). Moreover, it was determined that the use of smart boards for mathematics (SBM) was exceedingly rare (measure = 3.33). It was found that the variety of materials in mathematics centres was quite low (measure = 2.63). It was observed that children rarely used mathematics centres to play games (measure = 2.49) and that these were not developmentally appropriate (measure = 2.32). The teachers rarely observed and listened to the children, or took notes (took notes in small groups only; measure = 2.18).
The teachers seldom asked children to share, clarify, and justify their ideas (measure = .79). The teachers supported the children's understanding moderately (measure = .30). The teachers did not adapt tasks and discussions to accommodate the range of children's abilities and development (measure = .12).
The teachers did not have high or realistic mathematical expectations of the children (measure = .00) at a high level. They sometimes encouraged mathematical reflection (measure = -.03). The teachers' and other staff's involvement in the activity was low (measure = -.12 and measure = -.05). The teachers also actively interacted with and was responsive to the children (measure = -0.11). The teachers' involvement in the activity was low. The teachers sometimes facilitated children's responses (measure = -.12).
The teachers sometimes encouraged children to listen to and evaluate others' thinking/ideas (measure = -.26) and elicited key mathematics ideas during and/or towards the end of the activity. The teachers sometimes built on and/or elaborated on children's mathematical ideas and strategies (measure = -.32). The teachers used teachable moments as they occurred to develop mathematical ideas (measure = -.36). The environment showed signs of mathematics (measure = -.44). Children's mathematics work and/or other signs of mathematical thinking were on display. It can be said that the children' s mathematics activities were exhibited in the classroom (measure = -.46). The teachers showed curiosity and/or enthusiasm for mathematical ideas and or connections to other ideas or real-world situations (measure = -.36). The teachers supported the describer's thinking (measure = -.44). They began the mathematics activities by engaging and focusing on children's mathematical thinking (measure = -.66). The teachers showed that they believed that mathematics learning could and should be enjoyable (measure = -.74). The teachers' management strategies enhanced the quality of the activity (measure = -.83). The teaching strategies used were appropriate for the development levels/needs of the children and the purposes of the activity (measure = -1.03). The teachers provided "just enough" support (measure = -1.07). The teachers acknowledged and/or reinforced children's efforts, persistence and/or concentration (measure = -1.14).
The teachers facilitated children's actions at an appropriate level, providing adequate, not too little and not too much, help or information. They also displayed an understanding of mathematics concepts (measure = -1.18). They appeared to be knowledgeable about mathematics (measure = -1.15). It was determined that the pace of the teachers was appropriate for the pace of the children (measure = -1.68). The mathematical content was appropriate for the developmental levels of the children in the class. Teachers mostly performed developmentally appropriate practices (measure = -1.81).
Findings regarding Research Question 2: Relationship between COEMET and SPECKECM In Table 2, descriptive statistics of the COEMET and SPECKECM are given. Also, reliability values of Cronbach's alpha for the COEMET and KR-20 for the SPECKECM are displayed. The reliability values indicate that all sub-factors are above the cutoff value of .70, which is the recommended cut-off values for an acceptable reliability. As seen in Table 2, the highest mean value was found in the mathematical focus sub-factor, indicating that the teachers tended to conduct the activities that were appropriate to children's developmental level. However, the lowest mean value was in the assessment and instructional adjustment sub-factor, implying that the teachers were not likely to make any change or adjustment during their activities based on the children' needs. For the SPECKECM, the teachers were most successful with shapes (1.77 out of 3.00) and least successful with patterns (1.00 out of 3.00).
Pearson correlations were computed to examine the relations between the SPECKECM and COEMET dimensions and are presented in Table 3. For the COEMET sub-factors, all correlations were positive and significant. The strongest correlation was between the personal attributes of teachers and the organisation, teaching approaches and interaction (r = .72, p < .01), implying that the higher the personal attributes of teachers were, so were the organisation, teaching approaches and interaction. The second strongest correlation was between supporting children's conceptual understanding and extending children's mathematical thinking (r = .71, p < .01), implying that the more the teachers supported children's conceptual understanding the more they extended children's mathematical thinking. The third strongest correlation was between the expectations and eliciting children's solution methods (r = .70, p < .01). The lowest correlation coefficient was between the expectations and assessment and instructional adjustment (r = .27, p < .05). As for the SPECKECM, some of the correlations were significant and others were not. The highest correlation coefficient was between spatial sense and ordering (r = .34, p < .05) and comparisons and spatial sense (r = .34, p < .05), implying that the knowledge on spatial sense and ordering and comparisons was related to each other. It was followed by spatial sense and pattern (r = .33, p < .05) and shapes and number (r = .31, p < .05).
As for the correlations between the COEMET and SPECKECM, it was found that some of the correlation coefficients were statistically significant, but some were not. Except for environment and interaction, organisation, teaching approaches and interaction, and expectations, dimensions of the COEMET were positively and statistically significantly correlated to the total point of the SPECKECM. This shows that the teachers' PCK was associated with their practices of the COEMET. The strongest correlation was between the total score of SPECKECM and assessment and instructional adjustment (r = .45, p < .01). Also, the dimension, assessment and instructional adjustment, was related to all the dimensions of the SPECKECM, except shapes. This result implies that when the teachers' PCK had increased they were more likely to adjust the assessment and instructional practices based on the children's needs. Given that assessment and instructional adjustment was the least observed COEMET dimension in the sample of this study, it can be said that this may be because of teachers' unsatisfactory PCK. Extending children's mathematical thinking was also related to the total scores of the SPECKECM (r = .34, p < .05), indicating that the more mathematics knowledge teachers had the more they extended children's mathematical thinking. Environment and interaction and organisation, teaching approaches and interaction were not significantly correlated to any dimension of the SPECKECM.
Findings regarding Research Question 3: Regression Analysis between SPECKECM and COEMET
To test how much variance of COEMET could be explained by teachers' PCK scores, a regression analysis was run. The analysis shows that teachers' PCK successfully predicted the total COEMET score (F(1,53) = 5.41, p < .05). A 10% variance in COEMET was explained by teachers' PCK (R2 = .10). The standardised regression coefficient showed that the PCK positively contributed to the COEMET score (ß = .34), indicating that a higher PCK score resulted in a higher COEMET score.
Discussion
The first research question of the study was: Is the Turkish translation of COEMET a valid and reliable tool to measure the quality of mathematics teaching in pre-school classrooms? To examine the first research question, 55 teachers were observed and the fit of items to the other items and responders was examined using the Rasch analysis. All the items in COEMET, except item 4 and item 5B, fitted well in the Rasch model with .88 person reliability and .92 item reliability. Therefore, those items were removed from the final analysis.
Computers have become a well-known tool in pre-school education; a tool that can support the teaching and learning process (Clements & Sarama, 2003). Studies also indicate that pre-school children are successful and eager to use educational software and that they benefit from these activities to enhance their own learning (Clements & Nastasi, 1993; Clements & Sarama, 2003; Wang & Ching, 2003).
Studies in the United States of America (USA) show that teachers use mathematics software in their classroom activities at a rate of 33% (Sarama, 2002; Sarama & DiBiase, 2004). However, there were no computers for teachers and children to use mathematics software and apps in any of the observed classrooms. It was thus clear that computers and mathematics software and apps, which are important educational materials of the 21st century classrooms, were not used in the Turkish pre-school and kindergarten classrooms. As for the use of smart boards (SBs) in mathematics activities (SBM), the data show that even if there was a smart board in the classroom, teachers almost never used it for mathematics activities. Hacısalihoğlu Karadeniz (2014) had similar findings and states that although pre-school teachers generally had positive attitudes towards the use of technology in mathematics, they could not use technology sufficiently during mathematics activities and they usually focused on teacher-centred methods. Orçan-Kaçan and Kimzan (2017) also state that the use of technological tools in pre-school education varies depending on the school's technological infrastructure and teacher competencies. The lack of early mathematics software and applications available in Turkish is regarded as another reason for not using computers and smart boards in pre-school education (Kol, 2012).
It was observed that very few of the classrooms had mathematics centres (item 5). It was also found that most of the available mathematics centres were physically and developmentally unsuitable for children to play in and that the level of diversity of the material was not ideal. Although the National Pre-school Education Programme implemented in Turkey emphasises the importance of learning centres in pre-school classrooms and lists that several learning centres are required, mathematics centres are not among them (Millî Eğitim Bakanlığı, 2013). This inadequacy of the national programme seems to constitute the general basis of the findings in our research. Because of large class sizes and having no mathematics centres and no teacher aides in the pre-school classrooms, learning activities mostly took place in large groups in Turkey. Therefore, the children in these classrooms had little chance to practise their mathematical thinking individually or in small groups. Other studies delivered similar results. For example, Büyüktaşkapu Soydan (2019) examined the types of activities (individual-small/large groups) that pre-school teachers included in their daily plans. The research revealed that the planned mathematics activities were mostly large group activities and there were far less individual and small group mathematics activities. Different reasons are given why teachers prefer large group activities to small group and individual activities. Sadik and Dikici-Siğirtmaç (2016) state that teachers find individual and small group activities more difficult to handle compared to large group activities. Dogan-Burc (2006) and Öztürk and Gangal (2016) also claim that teachers prefer large group activities as a way to manage the class, to cope with undesirable behaviour and to maintain silence in the classroom. However, in small groups children can receive individualised attention and instruction that may not be possible in large group activities. Teachers can also better observe how individual children perform tasks and how they interact with other children (Wasik, 2008). For a counting activity that requires the teacher to ask each child to count and demonstrate one-to-one correspondence, for example, a group of three to four children is best (Klein, Wirth & Linas, 2004).
The teachers participating in this study seemed to believe that learning mathematics could and should be enjoyable. Pre-school teachers' thoughts and feelings about mathematics and mathematics education play a vital role in their teaching. Therefore, teachers who think that mathematics is fun and give positive messages about it in the classroom, can be more successful in using natural learning environments that can be associated with daily situations (Gasteiger, 2014; Van Oers, 2010).
One of the biggest obstacles in introducing mathematical concepts to children is that teachers usually do not have the necessary mathematical knowledge to teach the mathematics concepts (Dombro, Jablon & Stetson, 2011; NRC, 2009). We observed that the teachers appeared to be highly knowledgeable about mathematics, displayed a remarkably high level of understanding of mathematical concepts and were also very good at appropriating the mathematical content to the developmental level of the children in the classrooms. Although the participant teachers seemed to have a good command of the concepts of mathematics and could adapt the content in accordance with the children's level, our and other studies conducted in Turkey show that pre-school teachers' mathematics PCK is low (e.g., Dagli, 2018). Also, research findings show that pre-school teachers understand a limited number of mathematical concepts (e.g., Firat & Dinçer, 2018). Based on these findings, it becomes clear that since teachers are constantly teaching these limited numbers of concepts, they become competent in teaching them and appropriating their teaching strategies to the developmental level and needs of the children.
By asking the right mathematical questions, the teacher can also create a supportive atmosphere in which the children further develop their mathematical thinking and start thinking like mathematicians (Mason, 2000). In a kindergarten context, Carlsen, Erfjord and Hundeland (2010) found that the kindergarten teachers' frequent use of questions enabled children's participation in the learning activities. The participant teachers in this study began mathematics activities by engaging and focusing children's mathematical thinking. Although the teachers presented this behaviour, their scores on this item were relatively lower compared to other items further down the Wright map (cf. Figure 1). Considering the importance of teachers' interest in children' s mathematical thoughts for learning, the teacher should have shown more of this behaviour since early mathematics learning is related to the quality of mathematics experiences in the environment (Klibanoff, Levine, Huttenlocher, Vasilyeva & Hedges, 2006). Despite factors such as large class sizes and the absence of assistant teachers in the classrooms, teachers planned and implemented mathematics activities that were suitable for the children' s pace and developmental levels. Although it was observed that teachers were competent in their practices related to mathematics, they remained weak in observing and listening to children and taking appropriate notes (they took notes only in small group activities). It was also observed that teachers did not encourage children to share their ideas and talk about their ideas. The teacher's management strategies, on the other hand, enhanced the quality of the activity. This finding suggests that the teachers' use of effective classroom management strategies support effective mathematics practices.
In addition, it was also observed that teachers interacted with children and used teachable moments to improve children' s mathematical thinking moderately. Some other studies also show that the level of child participation in mathematics activities was usually at the non-participation level (Pekince & Avcı, 2016). The teachers used traditional teacher-centred methods in implementing mathematics activities instead of active learning methods based on new approaches (Baki & Hacisalihoğlu Karadeniz, 2013). They usually assume an explanatory role and they cannot keep children cognitively active. According to Kaya and Aytar (2012), there is a gap between pre-school teachers' thoughts (self-perception) about using a child-centred approach and their actual practices.
The teachers in this study did not support the children's mathematical thinking by asking them to share, clarify, and justify their ideas and facilitate their responses at a high level. The teachers did not encourage children to listen to and evaluate others'
thinking/ideas either. Bağci and Ivrendi (2016) conducted a study on pre-school teachers' opinions about teacher competencies and in-service training needs and found that pre-school teachers were highly competent in terms of teaching profession special area competencies. Kök, Çiftçi and Ayik (2011) also found similar results. However, these were self-report studies. Observational studies, however, show that teachers need to be supported in following and implementing the programme (Aysu & Aral, 2016), and the teachers' quality should be increased by arranging seminars, courses and in-service training programmes related to the pre-school education programme (Köksal, Balaban Dağal & Duman, 2016).
The best way to support children's learning and development is to observe the details of both the planned and the child-initiated learning processes and to use the observations to enhance classroom practices (Neaum, 2016). Observing children's in-class activities and taking notes regarding these observations are important for evaluating and supporting their learning and development (Gullo & Hughes, 2011). The teachers in this study, however, missed an important opportunity to improve the quality of mathematics activities by not spending enough time to observe, listen and provide feedback about the children's learning and discussing mathematical concepts with them as suggested by Gifford (2004).
One of the roles of an effective pre-school teacher is to provide children with the necessary support when they need it (Copple & Bredekamp, 2009). The teachers in this study provided "just enough" support to facilitate children's actions at the appropriate level. This was done by providing adequate (not too little, not too much) help or information. On the other hand, the teachers' level of elaborating on children's mathematical ideas and strategies was not high. There is evidence in the literature that mathematical thinking and competencies are not developed without the provision of a learning opportunity (Bergqvist & Lithner, 2012; Bobis, Clarke, Clarke, Thomas, Wright, Young-Loveridge & Gould, 2005). If children have access to a guide, they are more likely to advance in their mathematical thinking, especially if the guide asks key questions (Laine, Näveri, Pehkonen, Ahtee & Hannula, 2018; Van Oers, 2010). The teachers in this study also did not encourage mathematical reflections at a high level. Literature recommends that pre-school teachers support children's mathematical thinking by making connections, modelling, posing questions like, what would happen if, and providing children with regular and meaningful opportunities to gain experience and use mathematics (Frye, Baroody, Burchinal, Carver, Jordan & McDowell, 2013). However, the participant teachers did not pay enough attention to using these types of instructional skills in their classrooms. It was also revealed that in almost none of the classrooms the teachers listened to the children's answers and took notes regarding the teaching-learning processes. The teachers' not observing, listening, and recording children's learning enough might be as a result of the large class sizes in Turkey. Research on class size (and ratio) produced inconsistent findings; many studies found no significant associations between class size and child outcomes (Burchinal, Zaslow, Tarullo, Votruba-Drzal & Miller, 2016; Howes, Burchinal,
Pianta, Bryant, Early, Clifford & Barbarin, 2008). However, when evaluating these studies, it should be taken into count that an average pre-school classroom in the USA consists of 20 students with a 1:10 teacher-child ratio (Barnett, Vasileiou, Djemil, Brooks & Young, 2011). The situation is quite different in Turkish pre-school classrooms. Although the Regulation Regarding Preschool Education and Primary Education Institutions of the Ministry of National Education emphasises that the number of children in a pre-school classroom should be between 10 and 20, it is also stated in the same document that more students can be admitted if needed, without specifying a maximum limit (Millî Eğitim Bakanlığı, 2015). The regulation leads to an increase in the number of children in pre-school education classrooms in a way that is not conducive for the developmental and learning needs of the children. For example, Borland, Howsen and Trawick (2005) state that in classrooms with large numbers of children teachers' teaching skills and time need to be divided among many children and this decreases student achievement because teacher-student interaction is less. The current practices regarding class sizes in Turkey appear to reduce the children's developmental and learning opportunities.
The second research question was, "Is there a significant relationship between pre-school teachers' classroom mathematics practices and their PCK scores?" For the effective implementation of the pre-school mathematics curriculum, pre-school teachers should have certain competencies. Shulman (1986) defined PCK as the transformation of content knowledge into teaching knowledge. In this context, PCK has been regarded as a basic prerequisite for effective mathematics teaching for many years. In this study, the MPCK of the teachers was found to be at a medium level. This finding is also supported by previous research. For example, Bilgen (2018) examined the MPCK of in-service and pre-service pre-school teachers. It was found that both in-service and pre-service pre-school teachers had a medium level of MPCK, and the in-service teachers scored slightly higher than the pre-service teachers. While the PCK levels of the in-service teachers differed depending on the years of service, there was a significant difference in the MPCK of the teacher candidates based on gender, grade level, academic achievement, taking a mathematics education course, and believing in the necessity of mathematics education in the pre-school period. Both in-service and pre-service pre-school teachers considered mathematics education necessary in the pre-school period to prepare for primary (elementary) education and to acquire basic mathematics skills. These skills include number, counting, operation, pattern, matching and concrete-based activities in pre-school mathematics. In addition, in-service teachers considered themselves more competent in pre-school mathematics than teacher candidates.
The teachers' medium level MPCK can be explained by their attitudes towards mathematics and how much importance they attach to mathematics. Kowalski, Pretti-Frontczak and Johnson (2001) and Lee (2006), for example, claim that teachers consider developing socio-emotional skills more important than developing early academic skills, including mathematics. The previous research finding also supports the idea that the teachers should encourage children's natural tendency towards mathematics in their daily lives (Baroody, 2000; Clements & Sarama, 2007). In Millî Eğitim Bakanlığı's programme book (2013), the importance of developing mathematical inquiry skills in children by way of mathematics activities is also underlined and to do that it is recommended that children should be given examples that they may encounter in daily life.
It was also revealed in this research that there was a strong relationship between teachers' MPCK and their personal attributes, mathematical focus, supporting children' s conceptual understanding, and the dimensions of environment and interaction. Our finding is supported by those of previous studies (Askew, 1999; Baumert, Kunter, Blum, Brunner, Voss, Jordan, Klusmann, Krauss, Neubrand & Tsai, 2010; Ma, 1999; Monk, 1994; Nye, Konstantopoulos & Hedges, 2004) showing the existence of a strong relationship between pre-school teachers' MPCK and the quality of their mathematics teaching practices. However, these studies have been carried out with different age groups that included elementary and secondary education. A limited number of studies included pre-school teachers. In their studies, McCray (2008) and McCray and Chen (2012) found that the mathematics PCK of pre-school teachers was positively correlated with teaching practices and children's mathematical outcomes. However, in these studies, the quality of mathematics instruction was examined only through "maths-related teacher language." In our study, the quality of mathematics instruction was examined through classroom observation by means of a research-based measurement tool.
It is known that teachers' mathematical PCK is an important variable for their practices in the classroom (Ball, Lubienski & Mewborn, 2001; Shulman, 1987). Therefore, teachers with higher MPCK have a high chance of performing quality mathematics practices. Pedagogical competence is the teacher' s ability to manage learning, which consists of planning, implementing, and evaluating student learning outcomes. If the teachers want to fulfil their professional role, they must have these capabilities (Rahman, 2014). The NCTM (2022) also states that the teachers should actively introduce children to mathematical concepts, methods, and language through a variety of appropriate experiences and research-based teaching strategies. They should guide children in seeing connections with other topics, and encourage them to communicate and explain their thoughts while interacting with mathematics in depth and on an ongoing basis. However, both past and current research studies revealed that most of the pre-school teachers did not possess a high level of MPCK to provide quality learning opportunities for young learners (Ball, 1990; Hill, Schilling & Ball, 2004) and they often found that their knowledge and skills were not adequate to teach mathematics (Copley, 2004; Li, 2021; Wilkins, 2008).
The studies conducted in Turkey also provided similar results. For example, Köksal et al. (2016) examined the opinions of pre-school teachers about the pre-school education programme. It was found that the teachers' views on the implementation of the pre-school education programme varied according to the level of the programme they graduated from (associate degree, bachelor' s degree, or postgraduate degree), their professional seniority, the type of school they worked at and the in-service training they had received. We also claim that the functionality of the programme will increase as teachers' ability to conduct the pre-school education programme improves by means of seminars, courses, and in-service training programmes. By including technology in the pre-school programme its effectiveness will improve qualitatively as well as quantitatively. Moreover, Özsirkinti, Akay and Yilmaz-Bolat (2014) evaluated the opinions of pre-school teachers about the pre-school education programme, and it was found that there were problems in putting together learning centres in the classrooms due to the physical structure of the classrooms and the number of children. Although teachers displayed positive attitudes towards the changes in the programme, they were not provided with in-service training to help them implement these better.
In summary, as Clements and Sarama (2015) state, mathematics, which is at the centre of cognition, is today also the main component of innovative educational approaches such as science, technology, engineering, and mathematics (STEM). Societies that offer qualified mathematics education to individuals from the early years will be among the leading societies. Undoubtedly, qualified teachers are the most important element of qualified early mathematics teaching. The most important indicator of teacher qualification is the level of teachers' PCK. In this study, it was seen that teachers' MPCK was moderate. Although it seems that some of the existing problems related to the quality of early mathematics education can be solved by providing quality education to enhance teachers' MPCK both in pre-service and in-service years, a more comprehensive approach is needed to rectify the structural problems (e.g., large classes, lack of assistant teachers, inadequate materials and technological tools for instruction) affecting the quality of education. Only in this way can we raise individuals who possess the required 21st century skills.
Conclusion
In this study, it was found that computers were not used in observed mathematics activities and that few classrooms had mathematics learning centres. These findings show that standards regarding physical organisation should be improved in pre-school education classrooms in Turkey. In addition, it was observed that despite their positive attitude towards mathematics, pre-school teachers did not transfer their positive beliefs to their classroom practices. Moreover, teachers' MPCK was found to be at a moderate level. To increase teachers' MPCK to a higher level, supportive education is needed both for pre-service and in-service teachers. Pre-school teachers are the key to effective and high-quality mathematics education in pre-school classrooms.
Authors' Contributions
MOK collected data and co-authored the manuscript. NDA wrote the manuscript, except the data analysis section. MMA conducted all statistical analyses and wrote the data analysis section.
Notes
i. Published under a Creative Commons Attribution Licence.
References
Aksu Z & Kul Ü 2017. Turkish adaptation of the Survey of Pedagogical Content Knowledge in Early Childhood Mathematics education. International Journal of Eurasia Social Sciences, 8(30): 1832-1848. Available at https://openaccess.artvin.edu.tr/xmlui/bitstream/handle/11494/4165/zeki_aksu.pdf?sequence=1&isAllowed=y. Accessed 30 November 2023. [ Links ]
Alpaslan MM, Özgür U & Rıdvan A 2021. Adaptation of Technological Pedagogical Content Knowledge Scale into Turkish Culture within the scope of 21st century skills. Psycho-Educational Research Reviews, 10(1):77-91. Available at https://openaccess.biruni.edu.tr/xmlui/bitstream/han dle/20.500.12445/2936/document%20%2812%29.pdf?sequence=1&isAllowed=y. Accessed 30 November 2023. [ Links ]
Askew M 1999. It ain't (just) what you do: Effective teachers of numeracy. In I Thompson (ed). Issues in teaching numeracy in primary schools. Buckingham, England: Open University Press. [ Links ]
Aysu B & Aral N 2016. Okul öncesi öğretmenlerinin öğrenme merkezleri hakkındaki görüş ve uygulamalarının incelenmesi [An investigation of the preschool teachers' views and practices on learning centers]. Kastamonu Eğitim Dergisi, 24(5):2561-2574. Available at https://dergipark.org.tr/tr/pub/kefdergi/issue/27735/318061. Accessed 30 November 2023. [ Links ]
Bağci B & Ivrendi A 2016. Türkiye' de okul öncesi dönem matematik becerileri ve eğitimi araştırmaları: Sentez çalışması [Preschool math skills and training research in Turkey: Synthesis study]. Necatibey Eğitim Fakültesi Elektronik Fen ve Matematik Eğitimi Dergisi, 10(2):391-425. https://doi.org/10.17522/balikesirnef.278430 [ Links ]
Bailey DH, Siegler RS & Geary DC 2014. Early predictors of middle school fraction knowledge. Developmental Science, 17(5):775-785. https://doi.org/10.1111/desc.12155 [ Links ]
Baki A & Hacisalihoğlu Karadeniz M 2013. Okul öncesi eğitim programının matematik uygulama sürecinden yansımalar [Reflections from in-class mathematics applications in pre-school educational curriculum]. Kastamonu Eğitim Dergisi, 21(2):619-636. Available at https://search.trdizin.gov.tr/tr/yayin/detay/147862/. Accessed 30 November 2023. [ Links ]
Ball DL 1990. The mathematical understandings that prospective teachers bring to teacher education. The Elementary School Journal, 90(4):449-466. https://doi.org/10.1086/461626 [ Links ]
Ball DL, Lubienski ST & Mewborn DS 2001. Research on teaching mathematics: The unsolved problem of teachers' mathematical knowledge. In V Richardson (ed). Handbook of research on teaching (4th ed). Washington, DC: American Educational Research Association. [ Links ]
Barnett J, Vasileiou K, Djemil F, Brooks L & Young T 2011. Understanding innovators' experiences of barriers and facilitators in implementation and diffusion of healthcare service innovations: A qualitative study. BMC Health Services Research, 11:342. https://doi.org/10.1186/1472-6963-11-342 [ Links ]
Baroody AJ 2000. Does mathematics instruction for three- to five-year-olds really make sense? Young Children, 55(4):61-67. [ Links ]
Baumert J, Kunter M, Blum W, Brunner M, Voss T, Jordan A, Klusmann U, Krauss S, Neubrand M & Tsai YM 2010. Teachers' mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47(1):133-180. https://doi.org/10.3102/0002831209345157 [ Links ]
Bergqvist T & Lithner J 2012. Mathematical reasoning in teachers' presentations. The Journal of Mathematical Behavior, 31 (2):252-269. https://doi.org/10.1016/jjmathb.2011.12.002 [ Links ]
Bilgen Z 2018. Investigating preschool teachers' and preservice teachers' pedagogical content knowledge in preschool mathematics. Master's thesis. Çanakkale, Turkey: Çanakkale Onsekiz Mart University. [ Links ]
Björklund C, Van den Heuvel-Panhuizen M & Kullberg A 2020. Research on early childhood mathematics teaching and learning. ZDM Mathematics Education, 52:607-619. https://doi.org/10.1007/sll858-020-01177-3 [ Links ]
Bobis J, Clarke B, Clarke D, Thomas G, Wright R, Young-Loveridge J & Gould P 2005. Supporting teachers in the development of young children's mathematical thinking: Three large scale cases. Mathematics Education Research Journal, 16(3):27-57. https://doi.org/10.1007/BF03217400 [ Links ]
Bond TG & Fox CM 2015. Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed). New York, NY: Routledge. [ Links ]
Boone WJ, Staver JR & Yale MS 2013. Rasch analysis in the human sciences. Dordrecht: Springer. https://doi.org/10.1007/978-94-007-6857-4 [ Links ]
Borland MV, Howsen RM & Trawick MW 2005. An investigation of the effect of class size on student academic achievement. Education Economics, 13(1):73-83. https://doi.org/10.1080/0964529042000325216 [ Links ]
Bukova-Güzel E, Canturk-Günhan B, Kula S, Özgür Z & Elçi AN 2013. Scale development for pre-service mathematics teachers' perceptions related to their pedagogical content knowledge. South African Journal of Education, 33(2):Art. #690, 21 pages. https://doi.org/10.15700/saje.v33n2a690 [ Links ]
Burchinal M, Zaslow M, Tarullo L, Votruba-Drzal E & Miller P 2016. Quality thresholds, features, and dosage in early care and education: Secondary data analyses of child outcomes. Monographs of the Society for Research in Child Development, 81(2):1-126. [ Links ]
Büyüktaşkapu Soydan S 2019. Okul öncesi eğitim etkinlik planlarının etkinlik çeşidi ve bireysel-küçük/büyük grup olarak planlanması açısından incelenmesi [The analysis of activity plans of preschool education in terms of kinds of activity and ways of practices (individual - small / large group)]. Kastamonu Eğitim Dergisi, 27(3):1081-1092. https://doi.org/10.24106/kefdergi.2585 [ Links ]
Carlsen M, Erfjord I & Hundeland PS 2010. Orchestration of mathematical activities in the kindergarten: The role of questions. In V Durrand-Guerrier, S Soury-Lavergne & F Arzarello (eds). Proceedings of the Sixth Congress of the European Society for Research in Mathematics Education. Lyon, France: Institut National de Recherche Pédagogique. Available at https://hal.science/hal-02182374/. Accessed 30 November 2023. [ Links ]
Cerezci B 2020. The impact of the quality of early mathematics instruction on mathematics achievement outcomes. Journal of Childhood, Education & Society, 1(2):216-228. https://doi.org/10.37291/2717638X.20201248 [ Links ]
Çiltas A, Güler G & Sözbilir M 2012. Türkiye'de matematik eğitimi araştırmaları: Bir içerik analizi çalışması [Mathematics education research in Turkey: A content analysis study]. Kuram ve Uygulamada Eğitim Bilimleri, 12(1):565-580. Available at https://avesis.atauni.edu.tr/yayin/24931b6f-bc3f-488e-bacb-ed454a7cd3c6/mathematics-education-research-in-turkey-a-content-analysis-study. Accessed 30 November 2023. [ Links ]
Claessen A & Engel M 2013. How important is where you start? Early mathematics knowledge and later school success. Teachers College Record, 115(6):1-29. https://doi.org/10.1177/016146811311500603 [ Links ]
Clements D 2001. Mathematics in the preschool. Teaching Children Mathematics, 7(5):270-275. https://doi.org/10.5951/TCM.7.5.0270 [ Links ]
Clements D & Sarama J 2015. Discussion from a mathematics education perspective. Mathematical Thinking and Learning, 17(2-3):244-252. https://doi.org/10.1080/10986065.2015.1016826 [ Links ]
Clements DH & Nastasi BK 1993. Electronic media and early childhood education. In B Spodek (ed). Handbook of research on the education of young children. New York, NY: Macmillan. [ Links ]
Clements DH & Sarama J 2002. Effects of a preschool mathematics curriculum: Research on the NSF-funded Building Blocks project. Available at https://www.mbschicago.net/a-pdf-trial/Building_Blocks_Research_Summary%5B1%5D.pdf. Accessed 30 November 2023. [ Links ]
Clements DH & Sarama J 2003. Young children and technology: What does the research say? Young Children, 58(6):34-10. [ Links ]
Clements DH & Sarama J 2007. Effects of a preschool mathematics curriculum: Summary research on the Building Blocks project. Journal for Research in Mathematics Education, 38(2):136-163. https://doi.org/10.2307/30034954 [ Links ]
Clements DH & Sarama J 2008. Experimental evaluation of the effects of a research-based preschool mathematics curriculum. American Educational Research Journal, 45(2):443-494. https://doi.org/10.3102/0002831207312908 [ Links ]
Clements DH, Sarama J & DiBiase AM (eds.) 2004. Engaging young children in mathematics: Standards for early childhood mathematics education. Mahwah, NJ: Lawrence Erlbaum Associates. [ Links ]
Copley JV 2004. The early childhood collaborative: A professional development model to communicate and implement the standards. In DH Clements, J Sarama & AM DiBiase (eds). Engaging young children in mathematics: Standards for early childhood mathematics education. Mahwah, NJ: Lawrence Erlbaum Associates. [ Links ]
Copple C & Bredekamp S (eds.) 2009. Developmentally appropriate practice in early childhood programs serving children from birth through age 8 (3rd ed). Washington, DC: National Association for the Education of Young Children. [ Links ]
Corrigendum 2015. Journal of Research in Childhood Education, 29(4):583. https://doi.org/10.1080/02568543.2015.1081807 [ Links ]
Dagli H 2018. An analysis of the predictive roles of the preschool teachers' pedagogical content knowledge regarding mathematics in children's mathematical skill and their liking of mathematics. PhD thesis. Ankara, Turkey: Gazi University. [ Links ]
Dogan-Burc E 2006. The proficiency of the primary school teachers in classroom management in elementary schools. Master's thesis. Bolu, Turkey: Abant Izzet Baysal University. [ Links ]
Dombro AL, Jablon JR & Stetson C 2011. Powerful interactions: How to connect with children to extend their learning (2nd ed). Washington, DC: National Association for the Education of Young Children (NAEYC). [ Links ]
Elhan AH & Atakurt Y 2005. Ölçeklerin değerlendirilmesinde niçin Rasch analizi kullanılmalıdır? [Why is it necessary to use Rasch analysis when evaluating measures?] Ankara Üniversitesi Tıp Fakültesi Mecmuası, 58:47-50. Available at https://cms.galenos.com.tr/Uploads/Article_18722/AUTFM-58-47-En.pdf. Accessed 30 November 2023. [ Links ]
Erincik G 2020. Okul öncesi öğretmenlerinin matematik eğitimi sürecinde kullandıkları matematik dilinin incelenmesi [Examination of the mathematics language used by preschool teachers in the mathematics education process]. Master's thesis. Kütahya, Turkey: Kütahya Dumlupınar Üniversitesi. [ Links ]
Firat ZS & Dinçer Ç 2018. Okul öncesi öğretmenlerin doğal matematiksel dil kullanımlarının incelenmesi [Examining the use of mathematical language of preschool teachers]. Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 18(2):895-914. https://doi.org/10.17240/aibuefd.2018..-396525 [ Links ]
Frye D, Baroody AJ, Burchinal M, Carver SM, Jordan NC & McDowell J 2013. Teaching math to young children: A practice guide (NCEE 2014-4005). Washington, DC: National Center for Education Evaluation and Regional Assistance (NCEE), Institute of Education Sciences, U.S. Department of Education. Available at https://files.eric.ed.gov/fulltext/ED544376.pdf. Accessed 30 November 2023. [ Links ]
Gasteiger H 2012. Fostering early mathematical competencies in natural learning situations- Foundation and challenges of a competence-oriented concept of mathematics education in kindergarten. Journal für Mathematik-Didaktik, 33(2):181-201. https://doi.org/10.1007/s13138-012-0042-x [ Links ]
Gasteiger H 2014. Professionalization of early childhood educators with a focus on natural learning situations and individual development of mathematical competencies: Results from an evaluation study. In U Kortenkamp, B Brandt, C Benz, G Krummheuer, S Ladel & R Vogel (eds). Early mathematics learning: Selected papers of the POEM 2012 conference. New York, NY: Springer. https://doi.org/10.1007/978-1-4614-4678-1_17 [ Links ]
Gervasoni A, Hunter R, Bicknell B & Sexton M 2012. Powerful pedagogical actions in mathematics education. In B Perry, T Lowrie, T Logan, A MacDonald & J Greenlees (eds). Research in mathematics education in Australasia 2008-2011. Rotterdam, The Netherlands: Sense. [ Links ]
Gifford S 2004. A new mathematics pedagogy for the early years: In search of principles for practice. International Journal of Early Years Education, 12(2):99-115. https://doi.org/10.1080/0966976042000225507 [ Links ]
Ginsburg HP & Amit M 2008. What is teaching mathematics to young children? A theoretical perspective and case study. Journal of Applied Developmental Psychology, 29(4):274-285. https://doi.org/10.1016/j.appdev.2008.04.008 [ Links ]
Ginsburg HP & Ertle B 2008. Knowing the mathematics in early childhood mathematics. In ON Saracho & B Spodek (eds). Contemporary perspectives on mathematics in early childhood education. Charlotte, NC: Information Age Publishing. [ Links ]
Ginsburg HP, Lee JS & Boyd JS 2008. Mathematics education for young children: What it is and how to promote it. Social Policy Report, 22(1):3-24. Available at https://files.eric.ed.gov/fulltext/ED521700.pdf. Accessed 30 November 2023. [ Links ]
Gropen J, Kook JF, Hoisington C & Clark-Chiarelli N 2017. Foundations of Science Literacy: Efficacy of a preschool professional development program in science on classroom instruction, teachers' pedagogical content knowledge, and children's observations and predictions. Early Education and Development, 28(5):607-631. https://doi.org/10.1080/10409289.2017.1279527 [ Links ]
Gullo DF & Hughes K 2011. Reclaiming kindergarten: Part I. Questions about theory and practice. Early Childhood Education Journal, 38(5):323-328. https://doi.org/10.1007/s10643-010-0429-6 [ Links ]
Hacısalihoğlu Karadeniz M 2014. Okul öncesi öğretmenlerinin matematik eğitiminde teknolojiden yararlanma durumlarının belirlenmesi [Determining pre-school teachers' use of technology in mathematics education]. Adıyaman University Journal of Educational Sciences, 4(2): 119-144. https://doi.org/10.17984/adyuebd.57328 [ Links ]
Hill HC, Schilling SG & Ball DL 2004. Developing measures of teachers' mathematics knowledge for teaching. The Elementary School Journal, 105(1):11-30. https://doi.org/10.1086/428763 [ Links ]
Howes C, Burchinal M, Pianta R, Bryant D, Early D, Clifford R & Barbarin O 2008. Ready to learn? Children's pre-academic achievement in pre-Kindergarten programs. Early Childhood Research Quarterly, 23(1):27-50. https://doi.org/10.1016/j.ecresq.2007.05.002 [ Links ]
Jang YJ 2013. Perspectives on mathematics education for young children. PhD dissertation. Champaign, IL: University of Illinois Urbana-Champaign. Available at https://www.proquest.com/docview/1517984340?porigsite=gscholar&fromopenview=true&sourcetype=Dissertations%20&%20Theses. Accessed 30 November 2023. [ Links ]
Katz LG 2015. Lively minds: Distinctions between academic versus intellectual goals for young children. Jamaica Plain, MA: Defending the Early Years. Available at https://files.eric.ed.gov/fulltext/ED609199.pdf. Accessed 30 November 2023. [ Links ]
Kaya ÖM & Aytar AG 2012. Okul öncesi eğitim öğretmenlerinin çocuk merkezli yaklaşım uygulamalarının değerlendirilmesi [Evaluation of the child-centered approach applied by pre-school education teachers]. Akademik Araçtirmalar Dergisi, 14(53):27-75. Available at https://earsiv.anadolu.edu.tr/xmlui/bitstream/handle/11421/15315/15315pdf?sequence=1&isAllowed=y. Accessed 30 November 2023. [ Links ]
Kilday CR & Kinzie MB 2009. An analysis of instruments that measure the quality of mathematics teaching in early childhood. Early Childhood Education Journal, 36:365-372. https://doi.org/10.1007/s10643-008-0286-8 [ Links ]
Klein TP, Wirth D & Linas K 2004. Play: Children's context for development In D Koralek (ed). Spotlight on young children and play. Washington, DC: National Association for the Education of Young Children. [ Links ]
Klibanoff RS, Levine SC, Huttenlocher J, Vasilyeva M & Hedges LV 2006. Preschool children's mathematical knowledge: The effect of teacher "math talk." Developmental Psychology, 42(1):59-69. https://doi.org/10.1037/0012-1649.42.L59 [ Links ]
Koç D 2017. Okul öncesi dönemde matematik eğitimi: Öğretmen uygulamaları ve görüşleri üzerine bir durum çalışması [Mathematics education in preschool: A case study on teacher practices and opinions]. Master's thesis. Bursa, Turkey: Uludag University. Available at https://acikerisim.uludag.edu.tr/server/api/core/bitstreams/d2922429-6cd2-47e6-b65d-3f85e99a5ed3/content. Accessed 30 November 2023. [ Links ]
Kök M, Çiftçi M & Ayik A 2011. Öğretmenlik mesleği özel alan yeterliklerine ilişkin bir inceleme (okul öncesi öğretmenliği örneği) [An examination on teachers competencies in their branches (sample of early childhood teacher's)]. Atatürk Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, 15(1):169-183. Available at https://dergipark.org.tr/tr/pub/ataunisosbil/issue/2827/38293. Accessed 30 November 2023. [ Links ]
Köksal O, Balaban Dağal A & Duman A 2016. Okul öncesi öğretmenlerinin okul öncesi eğitim programi hakkindaki görüşlerinin belirlenmesi [The determination of pre-school teaching program in accordance with pre-school teacher opinions]. International Journal of Social Science, 46:379-394. https://doi.org/10.9761/JASSS3395 [ Links ]
Kol S 2012. Development of attitude scale devoted to the usage of technology in pre-school education. Kastamonu Education Journal, 20(2):543-554. [ Links ]
Kowalski K, Pretti-Frontczak K & Johnson L 2001. Preschool teachers' beliefs concerning the importance of various developmental skills and abilities. Journal of Research in Childhood Education, 16(1):5-14. https://doi.org/10.1080/02568540109594970 [ Links ]
Kulgemeyer C & Riese J 2018. From professional knowledge to professional performance: The impact of CK and PCK on teaching quality in explaining situations. Journal of Research in Science Teaching, 55(10):1393-1418. https://doi.org/10.1002/tea.21457 [ Links ]
Laine A, Näveri L, Pehkonen E, Ahtee M & Hannula MS 2018. Connections of primary teachers' actions and pupils' solutions to an open problem. International Journal of Science and Mathematics Education, 16(5):967-983. https://doi.org/10.1007/s10763-017-9809-3 [ Links ]
Lee JS 2006. Preschool teachers' shared beliefs about appropriate pedagogy for 4-year-olds. Early Childhood Education Journal, 33(6):433-141. https://doi.org/10.1007/s10643-006-0059-1 [ Links ]
Li X 2021. Investigating U.S. preschool teachers' math teaching knowledge in counting and numbers. Early Education and Development, 32(4):589-607. https://doi.org/10.1080/10409289.2020.1785226 [ Links ]
Ma L 1999. Knowing and teaching elementary mathematics: Teachers ' understanding of fundamental mathematics in China and the United States. Mahwah, NJ: Lawrence Erlbaum Associates. [ Links ]
MacDonald A, Davies N, Dockett S & Perry B 2012. Early childhood mathematics education. In B Perry, T Lowrie, T Logan, A MacDonald & J Greenlees (eds). Research in mathematics education in Australasia 2008-2011. Rotterdam, The Netherlands: Sense. https://doi.org/10.1007/978-94-6091-970-1_9 [ Links ]
Mason M 2000. Teachers as critical mediators of knowledge. Journal of Philosophy of Education, 34(2):342-343. https://doi.org/10.1111/1467-9752.00177 [ Links ]
McCray JS 2008. Pedagogical content knowledge for preschool mathematics: Relationships to teaching practices and child outcomes. PhD dissertation. Chicago, IL: Loyola University Chicago. Available at https://www.proquest.com/docview/3045579417pqorigsite=gscholar&fromopenview=true&sourcetype =Dissertations%20&%20Theses. Accessed 30 November 2023. [ Links ]
McCray JS & Chen JQ 2012. Pedagogical content knowledge for preschool mathematics: Construct validity of a new teacher interview. Journal of Research in Childhood Education, 26(3):291-307. https://doi.org/10.1080/02568543.2012.685123 [ Links ]
Millî Eğitim Bakanlığı 2013. Okul öncesi eğitim programı[National Preschool Education Program]. Ankara, Turkey: Author. Available at http://tegm.meb.gov.tr/dosya/okuloncesi/ooproram.pdf. Accessed 30 November 2023. [ Links ]
Millî Eğitim Bakanlığı 2015. Okul öncesi eğitim ve ilköğretim kurumları yönetmeliği [The regulation regarding pre-school education and primary education institutions]. [ Links ]
Millî Eğitim Bakanlığı 2019. PISA 2018 Türkiye ön raporu [PISA 2018 Türkiye preliminary report). Ankara, Turkey: Author. Available at https://www.meb.gov.tr/meb_iys_dosyalar/2019_12/03105347_pisa_2018_turkiye_on_raporu.pdf. Accessed 30 November 2023. [ Links ]
Monk DH 1994. Subject area preparation of secondary mathematics and science teachers and student achievement. Economics of Education Review, 13(2):125-145. https://doi.org/10.1016/0272-7757(94)90003-5 [ Links ]
National Association for the Education of Young Children 2014. Preschoolers are natural mathematicians. Teaching Young Children, 8(1):23. Available at https://www.naeyc.org/system/files/mib_oct2014.pdf. Accessed 30 November 2023. [ Links ]
National Association for the Education of Young Children (NAEYC) and National Council of Teachers of Mathematics (NCTM) (2002/2010). Early childhood mathematics: Promoting good beginnings. Available at https://www.naeyc.org/sites/default/files/globally-shared/downloads/PDFs/resources/position-statements/psmath.pdf. Accessed 30 November 2023. [ Links ]
National Council of Teachers of Mathematics 2022. Mathematics in early childhood learning. Available at https://www.nctm.org/Standards-and-Positions/Position-Statements/Mathematics-in-Early-Childhood-Learning/. Accessed 30 November 2023. [ Links ]
National Research Council 2009. Learning science in informal environments: People, places, and pursuits. Washington, DC: The National Academies Press. [ Links ]
Neaum S 2016. School readiness and pedagogies of Competence and Performance: Theorizing the troubled relationship between early years and early years policy. International Journal of Early Years Education, 24(3):239-253. https://doi.org/10.1080/09669760.2016.1205970 [ Links ]
Nye B, Konstantopoulos S & Hedges LV 2004. How large are teacher effects? Educational Evaluation and Policy Analysis, 26(3):237-257. https://doi.org/10.3102/01623737026003237 [ Links ]
Orçan-Kaçan M & Kimzan I 2017. Öğretmenlerin okul öncesi eğitimde teknoloji kullanimina ilişkin görüşlerinin incelenmesi [Investigation of teacher's interviews on the use of technology in preschool education]. Uluslararası Eğitim Bilimleri Dergisi, 4(12):203-215. https://doi.org/10.16991/INESJOURNAL.1464 [ Links ]
Özsirkinti D, Akay C & Yilmaz Bolat E 2014. Okul öncesi öğretmenlerinin okul öncesi eğitim programı hakkındaki görüşleri (Adana ili örneği) [The opinions of preschool teachers concerning preschool education programme (Adana sample)]. Ahi Evran Üniversitesi Kırşehir Eğitim Fakültesi Dergisi (KEFAD), 15(1):313-331. Available at https://dergipark.org.tr/tr/download/article-file/1490434. Accessed 30 November 2023. [ Links ]
Öztürk Y & Gangal M 2016. Okul öncesi eğitim öğretmenlerinin disiplin, sınıf yönetimi ve istenmeyen davranışlar hakkındaki inançları [Preschool teachers' beliefs about discipline, classroom management, and disruptive behaviors]. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 31(3):593-608. https://doi.org/10.16986/HUJE.2016015869 [ Links ]
Pekince P & Avcı N 2016. Okul öncesi öğretmenlerinin erken çocukluk matematiği ile ilgili uygulamaları: Etkinlik planlarına nitel bir bakış [Pre-school teachers' applications related to early childhood mathematics: A qualitative look at activity plans]. Kastamonu Eğitim Dergisi, 24(5):2391-2408. Available at https://dergipark.org.tr/tr/download/article-file/309265. Accessed 30 November 2023. [ Links ]
Planinic M, Ivanjek L & Susac A 2010. Rasch model-based analysis of the Force Concept Inventory. Physical Review Special Topics-Physics Education Research, 6(1):010103. https://doi.org/10.1103/PhysRevSTPER.6.010103 [ Links ]
Rahman MH 2014. Professional competence, pedagogical competence and the performance of junior high school of science teachers. Journal of Education and Practice, 5(9):75-80. [ Links ]
Rasch G 1961. On general laws and the meaning of measurement in psychology. In J Neyman (ed). Proceedings of the fourth Berkeley Symposium on Mathematical Statistics and Probability (Vol. IV). Los Angeles, CA: University of California Press. Available at https://digitalassets.lib.berkeley.edu/math/ucb/text/math_s4_v4_article-22.pdf. Accessed 30 November 2023. [ Links ]
Sadik F & Dikici-Siğirtmaç A 2016. Investigating the views of pre-school teachers about classroom management skills and practices. Turkish Studies, 11(14):631-664. https://doi.org/10.7827/TurkishStudies.9630 [ Links ]
Sarama J 2002. Listening to teachers: Planning for professional development. (Early Childhood Corner). Teaching Children Mathematics, 9(1):36-39. [ Links ]
Sarama J & Clements DH 2007. Manual for classroom observation (COEMET) Version 3. [ Links ]
Sarama J, Clements DH, Wolfe CB & Spitler ME 2016. Professional development in early mathematics: Effects of an intervention based on learning trajectories on teachers' practices. Nordic Studies in Mathematics Education, 21(4):29-55. Available at https://ncm.gu.se/wp-content/uploads/2020/06/21_4_029056_sarama.pdf . Accessed 30 November 2023. [ Links ]
Sarama J & Dibiase AM 2004. The professional development challenge in preschool mathematics. In DH Clements, J Sarama & AM DiBiase (eds). Engaging young children in mathematics: Standards for early childhood mathematics education. Mahwah, NJ: Lawrence Erlbaum Associates. [ Links ]
Shulman L 1987. Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1):1-23. https://doi.org/10.17763/HAER.57.LJ463W79R56455411 [ Links ]
Shulman LS 1986. Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2):4-14. https://doi.org/10.3102/0013189X015002004 [ Links ]
Smith KH 1998. The construction of a survey of pedagogical content knowledge in early childhood mathematics. [ Links ]
Smith KH 2000. Early childhood teachers' pedagogical knowledge in mathematics: A quantitative study. PhD dissertation. Atlanta, GA: Georgia State University. [ Links ]
Tarım K & Bulut MS 2006. Okulöncesi öğretmenlerinin matematik ve matematik öğretimine ilişkin algı ve tutumları [Preschool teachers' perceptions and attitudes towards mathematics and mathematics teaching]. Çukurova Üniversitesi Eğitim Fakültesi Dergisi, 3(32):152-164. [ Links ]
Ten Braak D, Lenes R, Purpura DJ, Schmitt SA & St0rksen I 2022. Why do early mathematics skills predict later mathematics and reading achievement? The role of executive function. Journal of Experimental Child Psychology, 214:105306. https://doi.org/10.1016/jjecp.2021.105306 [ Links ]
The Early Math Collaborative 2011. High impact strategies in early mathematics. [ Links ]
Van Oers B 2010. Emergent mathematical thinking in the context of play. Educational Studies in Mathematics, 74(1):23-37. https://doi.org/10.1007/s10649-009-9225-x [ Links ]
Wang XC & Ching CC 2003. Social construction of computer experience in a first-grade classroom: Social processes and mediating artifacts. Early Education and Development, 14(3):335-362. https://doi.org/10.1207/s15566935eed1403_4 [ Links ]
Wasik B 2008. When fewer is more: Small groups in early childhood classrooms. Early Childhood Education Journal, 35(6):515-521. https://doi.org/10.1007/s10643-008-0245-4 [ Links ]
Watts TW, Duncan GJ, Siegler RS & Davis-Kean PE 2014. What's past is prologue: Relations between early mathematics knowledge and high school achievement. Educational Researcher, 43(7):352-360. https://doi.org/10.3102/0013189X14553660 [ Links ]
Wilkins JLM 2008. The relationship among elementary teachers' content knowledge, attitudes, beliefs, and practices. Journal of Mathematics Teacher Education, 11:139-164. https://doi.org/10.1007/s10857-007-9068-2 [ Links ]
Yazlık DÖ & Öngören S 2018. Okul öncesi öğretmenlerinin matematik etkinliklerine ilişkin görüşlerinin ve sınıf içi uygulamalarının incelenmesi [Examination of preschool teachers' views on mathematical activities and classroom practices]. Ahi Evran Universitesi Kirsehir Egitim Fakultesi Dergisi, 19(2): 1264-1283. https://doi.org/10.29299/kefad.2018.19.02.005 [ Links ]
Yıldız Altan R, Genç Çopur H & Dağlıoğlu HE 2021. Türkiye'de okul öncesi dönemde matematik alanında yapılan çalışmalara ilişkin bir içerik analizi [A content analysis on studies conducted on math education in preschool in Turkey]. OPUS International Journal of Society Researches, 17(33):619-653. https://doi.org/10.26466/opus.778998 [ Links ]
Zhang Y 2015. Pedagogical content knowledge in early mathematics: What teachers know and how it associates with teaching and learning. PhD dissertation. Chicago, IL: Loyola University Chicago. Available at https://ecommons.luc.edu/luc_diss/1499. Accessed 30 November 2023. [ Links ]
Received: 21 October 2021
Revised: 7 February 2023
Accepted: 21 August 2023
Published: 30 November 2023