Standards-Based Grading and College/University Admissions (Summary)

Two articles were published in the February 2018 issue of School Administrator (AASA) describing university admissions office perspectives on standards-based grading (SBG).  The full e-edition is available online and brief summary of each article is below.

High school students experiencing SBG receive a fair shot at higher education admissions

The authors interviewed admissions folks at several Midwestern universities with the purpose of determining if high school students experiencing standards-based grading receive a fair shot in the university admissions process.  Three key findings emerged.

  1. Letter grades and transcripts based on standards are acceptable, if not preferable, by admissions folks, with a few caveats.
  2. When universities receive profiles/transcripts from schools with alternative grading/reporting systems, these students receive equal consideration.
  3. Due to limited personnel in the admissions office, grades and standardized tests are the most trusted measures.

Buckmiller, T., & Peters, R. (2018). Getting a fair shot?. School Administrator, 75(2), 22-25. [Available online]

University admissions offices are aware of SBG and preparing to adapt, as needed.

Voices from university admissions administrators across the country share their experiences with class rank, standards-based grading, and alternative reporting measures.  For example, Paul Seegert, director of admissions at the University of Washington, says he does not believe students currently applying under a standards-based are at a disadvantage in the admissions process.  If/when high school transcripts change, the general consensus shared is that admissions offices will need to be better prepared.  However, the “fact that college admissions offices will have to make some adjustments should not deter high schools from pursuing meaningful reforms in the way they teach and evaluate students” (p. 29).

Riede, P. (2018). Making the call inside admissions offices. School Administrator, 75(2), 26-29.

Mastery-minded grading in secondary schools

I was invited to share our district’s standards-based grading journey with the national superintendents’ professional organization, AASA.  A brief summary:

In Solon, Iowa, teachers’ gradebooks describe students’ current levels of learning without the customary array of A’s and C’s or numerical grades. The small district is at the forefront of a new assessment movement in some local schools known as standards-based grading.

Read the entire February 2018 e-edition of AASA’s School Administrator publication or access the individual article here.

Top 5 pitfalls to avoid in a standards-based grading system shift

Are you thinking about making the shift to standards-based grading in your building or district?  Based upon hundreds of phone calls, consultations, workshops and emails, here’s a list of five pitfalls I have observed that school leaders should avoid.

  1. Use exceeds as a descriptor in the grade book at the secondary level.
    Nothing frustrates Sally and her parents more than realizing the teacher taught the class how to learn the concept in class, but in order to get the highest mark in the grade book, Sally must come up with some type of application or knowledge beyond what was taught on the assessment.  Instead, consider removing “exceeds” and replacing it with “understands the standards” for the top indicator.
  2. Fail to communicate the standards-based grading shift.
    Traditional grading has been around for over one hundred years, so there’s reason to believe a shift to something new or different will require communicating a solid rationale and plan, repeated multiple times in multiple mediums.  Of McRel’s twenty-one leadership responsibilities, communication is one that takes a hit during second order change (and yes, standards-based grading is likely a second order change for many teachers, parents and students in your district).  Tell ’em. Tell ’em what you told ’em. And tell ’em again.
  3. Do not report practice in the online grade book at the secondary level.
    We know that reporting academics separate from work habits is a cornerstone of standards-based grading/reporting.  At the secondary level, the standards (rather than quiz and test numbers) are often reported through an online grade book , leaving little, if any room to document work habits.  Whether it’s retrofitting a grade book designed for traditional grading practices, or using a grade book more in tune with standards-based grading practices, it only makes sense to continue reporting levels of homework completion to parents, despite these assignments not counting towards the final academic grade calculation.
  4. Forget to tell stakeholders what is staying the same during the shift in grading practices.
    If your middle school is switching to a standards-based report card, be sure to let parents know you will continue to host parent-teacher conferences twice per year.  If your high school is shifting to a standards-based grade book, parents will want to know final course grades are still reported on the transcript, and that grade point average will be communicated with university admissions offices.  In addition to communicating what’s changing, don’t forget to let them know what will remain the same.
  5. Inconsistent implementation
    During the first year of standards-based grading implementation, we surveyed parents and students to find out their perception of this change.  Frustrated Roger = Frustrated Roger’s mom and dad, and one of the biggest sources of this angst was inconsistent implementation.  While we had an agreed upon purpose of grading and board-approved grading guidelines, we relied on (often inconsistent) institutional knowledge rather than a documented tight and loose implementation guide for our teachers to operationalize the tenets of SBG.  Somewhere between “every teacher for his/her own” and a lockstep approach is usually a good place to land.  Ensuring teachers are supported to implement agreed upon standards-based grading non-negotiables, will help students and parents adapt more quickly to the change, because they’re seeing it in multiple courses and/or grade levels.

What other pitfalls would you add to this list?

Recommended reading:

Frankin, A., Buckmiller, T., & Kruse, J. (2016). Vocal and vehement: Understanding parents’ aversion to standards-based grading. International Journal of Social Science Studies, 4(11), 19-29. [Available online]

Peters, R., Kruse, J., Buckmiller, T., & Townsley, M. (2017) “It’s just not fair!” Making sense of secondary students’ resistance to a standards-based grading initiative in the midwestern United States. American Secondary Education, 45(3), 9-28.

Peters, R. & Buckmiller, T. (2014). Our grades were broken: Overcoming barriers and challenges to implementing standards-based grading. Journal of Educational Leadership in Action2(2), [Available online]

Swan, G.M., Guskey, T.R., & Jung, L.A. (2014). Parents and teachers’ perceptions of standards-based and traditional report cards. Educational Assessment, Evaluation and Accountability, 26(3), 289-299.

Urich, L.J. (2012). Implementation of standards-based grading at the middle school level (Doctoral dissertation). Retrieved from http://lib.dr.iastate.edu/etd/12492

“It’s just not fair!” Making sense of secondary students’ resistance to a standards-based grading initiative

A new peer-reviewed article I co-authored is now available in your local academic database!

Peters, R., Kruse, J., Buckmiller, T., & Townsley, M. (2017). “It’s just not fair!” Making sense of secondary students’ resistance to a standards-based grading initiative. American Secondary Education, 45(3), 9-28.

 

 

How does standards-based grading affect standardized test scores?

A teacher from a school in Iowa recently contacted me with an inquiry,

Is there any research indicating students going through a standards based grading system show improved standardized test scores  or college readiness compared to students that go through a traditional grading school?

Context: What we know about educational research

This is an excellent question that comes up often when educators and their school systems are considering a shift towards standards-based grading. Based upon my knowledge of research methodology, it would be challenging (but not impossible) to conduct a study truly isolating standards-based grading as a single variable influencing a school’s student achievement data. In other words, we know that in any educational study, limitations exist (i.e. fidelity of implementation, additional initiatives simultaneously assisting or hindering test scores, the alignment between state standards taught and standards assessed, and any placebo effect).  Finally, any experienced educational researcher will readily admit the challenge of generalizing study results outside of the original context.

How does standards-based grading affect standardized test scores?

I scoured the literature as part of my recent dissertation and found only a few quantitative studies that consider this type of question (How does SBG affect standardized test scores?), some of which look at an entire school and others that look at a smaller section of a school, such as an individual classroom. Each has clearly stated the study limitations.  Here’s a quick copy/paste from my dissertation:

The impact of standards-based grading on external achievement measures is mixed. While some studies indicate a significant statistical difference in one or more content areas (e.g. Haptonstall, 2010; Pollio & Hochbein, 2015), others have not (e.g. Rosales, 2013; Welsh, D’Agostino, & Kaniskan, 2013).

To add additional clarity, I’ve added more detail below related to each of the aforementioned citations.

Haptonstall (dissertation): From the abstract of the study, emphasis mine:

This study examined the correlation between the grades a student earns in his or her classroom and the scores that each student earned on the Colorado Student Assessment Program tests, in Reading, Writing, Math, and Science. The study also examined the mean scores of varying sub-groups to determine if certain sub-groups demonstrated higher means, dependent of the school districts that they were enrolled. While all the school districts that participated in the study showed a significant level of correlation between grades and test scores, Roaring Fork School District Re-1, using a standards- based grading model demonstrated both higher correlations and higher mean scores and grades across, the overall population and sub-groups.

Pollio & Hochbein: From the abstract of the study:

Results indicated that the rate of students earning an A or B in a course and passing the state test approximately doubled when utilizing standards-based grading practices. In addition, results indicated that standards-based grading practices identified more predictive and valid assessment of at-risk students’ attainment of subject knowledge.

Rosales: From the dissertation study, emphasis mine:

This study seeks to determine whether standards-based grading has the same effect on students at the high school level (grades 9-12) by comparing end-of-course test scores and posttest scores of Algebra 2 students enrolled in a standards-based graded classroom with to those enrolled in a traditionally-graded classroom. Two teachers each taught two classes of Algebra 2 and graded one class using standards-based grading and one class using traditional grading methods. Students at both the honors level and the regular level of mathematics were included in the study.
Honors students performed better than regular students on both assessments, but no significant difference was found between the performance of traditionally-graded students and the students who were graded with standards-based grading.  The results of this study indicate that standards-based grading may offer improved methods of communication between teachers, parents, and students and may give students a new perception of learning.

Welsh, et al.: From the abstract, emphasis mine:

Standards-based progress reports (SBPRs) require teachers to grade students using the performance levels reported by state tests and are an increasingly popular report card format. They may help to increase teacher familiarity with state standards, encourage teachers to exclude nonacademic factors from grades, and/or improve communication with parents. The current study examines the SBPR grade–state test score correspondence observed across 2 years in 125 third and fifth grade classrooms located in one school district to examine the degree of consistency between grades and state test results. It also examines the grading practices of a subset of 37 teachers to determine whether there is an association between teacher appraisal style and convergence rates. A moderate degree of grade–test score convergence was observed using three agreement estimates (coefficient kappa, tau-b correlations, and classroom-level mean differences between grades and test scores). In addition, only small amounts of grade–test score convergence were observed between teachers; a much greater proportion of variance lay within classrooms and subjects.

Given inconclusive evidence, why would a teacher or school decide to embark upon standards-based grading?

Here’s what I’ve found: First, the absence of research supporting traditional grading practices is concerning. Too many times, stakeholders enter these types of conversations assuming traditional grading practices are some type of research-proven paradigm when in fact, schools inherited the traditional grading system over one hundred years ago (Cureton, 1971).  Next, beyond the limited quantitative studies related to standards-based grading available right now (and summarized above), classroom teachers can do a better job aligning what we teach with our assessments, a fundamental tenet of grading reform.  In other words, due to a dearth of evidence, educators should strongly consider pragmatic solutions.  For more on these pragmatic themes and their connection to scholarly literature, I encourage readers to consider, “What does the research say about standards-based grading?” a research primer I co-wrote with Dr. Tom Buckmiller several years ago.  Finally, standards-based grading provides students and parents with more useful information about current levels of work (“proficient understanding of Pythagorean’s Theorem”) when compared to traditional grading practices (“85% on the Chapter 3 Test”).

In summary, the impact of standards-based grading on external achievement measures is mixed. With limited quantitative studies available to base this conclusion upon, educators should consider pragmatic benefits of standards-based grading practices and urge educational researchers to respond to this question with more detail in the future.

Works Cited

Cureton, L. W. (1971). The history of grading practices. NCME Measurement in Education, 2(4), 1-8.

Haptonstall, K. G. (2010). An analysis of the correlation between standards-based, non standards-based grading systems and achievement as measured by the Colorado Student Assessment Program (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses. (UMI No. 3397087)

Pollio, M. & Hochbein, C. (2015). The association between standards-based grading and standardized test scores as an element of a high school model reform. Teachers College Record, 117(11), 1-28.

Rosales, R. B. (2013). The effects of standards-based grading on student performance in Algebra 2 (Doctoral dissertation). Retrieved from http://digitalcommons.wku.edu/diss/53/

Welsh, M. E., D’Agostino, J. V., & Kaniskan, B. (2013). Grading as a reform effort: Do standards-based grades converge with test scores? Educational Measurement: Issues and Practice, 32(2), 26-36. doi:10.1111/emip.12009

Three Lessons for Schools Shifting Their Grading

I was recently invited to write a brief article for School Administrator, an AASA (The School Superintendents’ Association) publication.  “Three Lessons for Schools Shifting Their Grading” was embedded within a feature article about standards-based grading, (a well written one, I might add) by Ken O’Connor.

The full article is available via the AASA digital magazine link here.

Standards-based grading: Frequently asked questions about reassessment

The email questions continue to roll in this school year.  A math teacher from California gave me permission to share some of our recent communication:

If there is unlimited number of reassessment, how do you manage students who want to re-assess till they attain “got it” and eventually the school year is ending?

Our teachers usually have a “final reassessment deadline.”  For example, if the semester ends on December 20 and grades are due on December 23, a teacher might communicate a final reassessment deadline of December 18.  In the ideal world, students would be allowed to re-assess forever (think: 31 year old re-assessing his high school government coursework!), however the realities of our current educational paradigm (180 days, bells, student schedules, etc.) force us to create arbitrary deadlines, even in a standards-based grading system. It would be very challenging for a teacher to allow reassessments to be turned in up until the last minute grades are due to the school, therefore some type of buffer should be established to allow for the teacher to score and enter the final batch of reassessments.  In general, as long as the final reassessment deadline is communicated early and often, students and parents understand the need for the teacher to grade the reassessments and get them entered into the grade book before the school-imposed grade deadline.
If the student can choose to reassess just one standard, doesn’t it tell the student what concept or skill is required to solve the problem given and makes learning segmented? For the reassessment problem, should it be similar to the previous assessment/practice or should a novel problem be given? 
You’ve identified one of the biggest critiques I have read/heard of standards-based grading — narrowing down learning into finite concepts rather than seeing math as a larger body of ideas in which life rarely tells us which formula to use.  With this in mind, any assessment in a standards-based grading or traditional grading classroom is only as good as its author.  In other words, any test could be written with a very low cognitive complexity or a very high level or rigor.  I have seen standards-based grading tests that break down the concepts into fine-grained concepts and I have seen others that expect students to climb Bloom’s taxonomy.  I believe a starting point is thinking about re-assessments at a similar level of cognitive complexity as the original assessment.  Sometimes the expected level of rigor is described in the standards themselves.  For example:

CCSS.MATH.CONTENT.HSG.GMD.B.4
Identify the shapes of two-dimensional cross-sections of three-dimensional objects, and identify three-dimensional objects generated by rotations of two-dimensional objects.

“Identify” may give the assessment author a glimpse into the expected level of Bloom’s intended by the writer of the standards, in this case the Common Core State Standards. 
Does any of this make sense?

Standards-based grading: Integrating homework completion with reassessment

A teacher from a nearby school district recently emailed me with a few questions about standards-based grading in preparation for the upcoming school.  He gave me permission to share some of our dialogue in this public space.  This is the second of two question and answer posts about homework as practice, rather than merely point accumulator, in standards-based grading. (The first one is here)

Q: I have heard of some teachers that will not allow retakes on assessments unless the homework has been completed. What are your thoughts?

A: Great question! I have seen this work in two different ways, each with pros and cons.

The first perspective goes something like “Students may not complete a reassessment unless they completed the homework prior to the initial assessment.”

Pros: May motivate students to do the homework prior to the first assessment; may help students do better on the initial assessment (because they did their homework).  Cons: May motivate students to copy homework and play this part of the “game of school.”  Only allowing students an opportunity to reassess if they completed homework seems to go against the idea students learn at different rates/paces.  What if the reason the student didn’t complete the homework initially is because he/she had no idea about the concepts?  Why require the student to do a slew of problems incorrectly?

The second perspective is the one I tend to favor, “Students may complete a reassessment only if they completed the homework sometime (doesn’t matter if it it was before or after initial assessment) and complete additional re-learning steps.”

Pros: Better honors that students learn at different rates/paces; may also be a better chance students are likely to ask better questions when completing the homework “Okay, I obviously didn’t get this idea as you saw on the test, Mr. H….could you help me understand it on the homework?”  Re-assessment should be meaningful for students while not overburdening the instructor.  Cons: It’s not a silver bullet!  Students may still game the system by copying from a friend…but there’s less incentive to do so, because if they copy and do not learn, they will not likely do any better on the reassessment.

How do you integrate homework completion and the reassessment process within standards-based grading?  Feel free to leave your experiences in the comments below.

Standards-based grading: Motivating students to complete homework/practice without points

A teacher from a nearby school district recently emailed me with a few questions about standards-based grading in preparation for the upcoming school year.  He gave me permission to share some of our dialogue in this public space.  This is the first of two question and answer posts about homework as practice, rather than merely point accumulator, in standards-based grading.

Q: When homework is no longer completed for points or a grade in a standards-based grading environment, I could see some students reluctant to submit homework assignments. Do you have any advice on convincing students that homework is still a required, essential part even if they aren’t getting a score for it? What about those kids who just don’t turn in their work?

A: Let’s be honest for a moment – there’s no silver bullet for motivating kids to do homework! When we think about the traditional grading paradigm, students do not often value practice/homework, even when it is worth points. Evidence of this theory includes students across the country in high schools with traditional grading who do not turn in their homework assignments and students who turn in copied homework assignments.

Here is my biggest piece of advice, which comes from personal experience: In traditional grading, when a student does not turn in an assignment, we give them a zero, but do not talk with them about it. We assume they’re going to “learn” from the zero. Instead, I tried something different in my later years as a high school teacher.  It went something like this…

Class, the purpose of homework in this class is practice.  Although homework is not worth any points, it is still very important.  The purpose of homework is practice!  Just like you practice for a small group speech contest, vocal music solo or volleyball game, practicing is important in math class.  Turn to your neighbor and share with them two reasons you believe practicing in math class is important and one reason why you might be tempted to not complete homework in this class….Okay, who can share with me a summary of their partner discussion?  How many of you talked about the importance of practice in doing well on tests?….

Then, when a student (inevitably) decides to not turn in an assignment a few days later, have a good ole fashioned one-on-one, sit down conversation with him/her.

Why did you decide not to do this assignment?

and

How well do you think you’ll do on the next assessment?

I’ve found this to be a relationship building exercise and gives me a better idea how I can help the student. Sometimes students are going through tough times at home. Other times, they’re lost conceptually and don’t want to admit it.

This is not a cure-all type of solution, but one that I and other educators using standards-based grading practices have found to be helpful.  In what ways have you motivated students to complete homework when it is worth zero points?  Leave your ideas in the comments below.