End of an era and beginning of a new one

For the past fourteen years, I have worked in the Solon Community School District (Solon, Iowa).  When I interviewed for a teaching position in 2004, I had no idea Solon would be such a wonderful place to work. During that interview, I found out the high school building was only a few years old and principal at the time told me there were occasional “Taco Tuesdays” in the staff lounge, so it sounded like a good place to land a job! Beginning with my first months as a teacher, and later as a district administrator, I am grateful for the way Solon staff allowed me to ask lots of questions and learn from making (many) mistakes. Solon is a tremendous place with high expectations for adults and students. I feel blessed beyond measure to have called the Solon Community School District my professional home for so long.  Many, but not all, of the ideas on this blog were somehow related to my professional experiences and thoughts in Solon.

Beginning in August 2018, I will transition to a tenure-track assistant professor of educational leadership at the University of Northern Iowa.  In this position, I will teach aspiring principals, central office administrators and superintendents.  Our mission is to develop and nurture reflective leaders of learning, service, and change in schools who positively impact students.  After finishing a doctorate degree last year, I had no idea an opportunity in higher education would present itself so soon, and one that will allow my family relocate to a familiar part of the state while our three boys are (hopefully) too young to remember it. Mentoring and teaching future school leaders is a professional chapter I have been looking forward to for a few years.

While I will begin writing more regularly in peer-reviewed journals as part of my new responsibilities, I hope to communicate even more frequently on this blog, too.

Standards-Based Grading and College/University Admissions (Summary)

Two articles were published in the February 2018 issue of School Administrator (AASA) describing university admissions office perspectives on standards-based grading (SBG).  The full e-edition is available online and brief summary of each article is below.

High school students experiencing SBG receive a fair shot at higher education admissions

The authors interviewed admissions folks at several Midwestern universities with the purpose of determining if high school students experiencing standards-based grading receive a fair shot in the university admissions process.  Three key findings emerged.

  1. Letter grades and transcripts based on standards are acceptable, if not preferable, by admissions folks, with a few caveats.
  2. When universities receive profiles/transcripts from schools with alternative grading/reporting systems, these students receive equal consideration.
  3. Due to limited personnel in the admissions office, grades and standardized tests are the most trusted measures.

Buckmiller, T., & Peters, R. (2018). Getting a fair shot?. School Administrator, 75(2), 22-25. [Available online]

University admissions offices are aware of SBG and preparing to adapt, as needed.

Voices from university admissions administrators across the country share their experiences with class rank, standards-based grading, and alternative reporting measures.  For example, Paul Seegert, director of admissions at the University of Washington, says he does not believe students currently applying under a standards-based are at a disadvantage in the admissions process.  If/when high school transcripts change, the general consensus shared is that admissions offices will need to be better prepared.  However, the “fact that college admissions offices will have to make some adjustments should not deter high schools from pursuing meaningful reforms in the way they teach and evaluate students” (p. 29).

Riede, P. (2018). Making the call inside admissions offices. School Administrator, 75(2), 26-29.

Mastery-minded grading in secondary schools

I was invited to share our district’s standards-based grading journey with the national superintendents’ professional organization, AASA.  A brief summary:

In Solon, Iowa, teachers’ gradebooks describe students’ current levels of learning without the customary array of A’s and C’s or numerical grades. The small district is at the forefront of a new assessment movement in some local schools known as standards-based grading.

Read the entire February 2018 e-edition of AASA’s School Administrator publication or access the individual article here.

Leaders of Data Analysis: More than Crunching Numbers

(Note to readers: This is part three in a series of columns written about Iowa ASCD’s current focus on supporting curriculum leadership across the state.)

In the last column, I proposed curriculum leads consider getting their feet wet and engaging teachers in a collaborative process to understand the nexus between standards, instruction and assessment in all content areas. This week, we’ll be taking a closer look at what it means to be a leader of data analysis.

According to our organization, curriculum leads “assure all educators’ ability to use data to inform, implement, monitor, and evaluate results-based decisions.” At first glance, this function may seem like it’s all about spreadsheets, databases, crunching numbers and creating elaborate reports filled with pie charts. Sure, there’s a time and a place for disaggregating data to reveal gaps across subgroups.   Without a doubt, curriculum leads should be providing assessment and other data in formats staff, parents and community members can easily understand. Our job is to use data to inform others. It is equally as important to “tell the story” about the data for the purpose of generating a solution or next steps than it is to merely crunch the numbers. Let’s be clear: our positions do not require an advanced degree in statistics or mathematics! Our ability to communicate through written language will directly impact our capacity to be leaders of data analysis. Here’s an example. Consider FAST (an early literacy assessment) scores in an elementary building indicating only 65% of students had met grade level benchmarks. If, during the previous school year, 45% of students had met benchmark, this year’s scores would be a huge celebration! On the contrary, comparing this data to the state’s healthy indicators for differentiated accountability (80% or more meeting benchmark is the universal target), the numbers may seem bleak. Clearly communicating these contextual comparisons can be helpful in sharing progress and next steps to stakeholders.

We live in an era with more than enough educational data to fill weeks of endless number crunching. As a former high school math teacher, I naturally bend towards looking at the numbers in isolation rather than figuring out if there’s a bigger picture to consider. Instead, our job is to look at the data in its context, and ask (ourselves and others) compelling questions, such as “Is there anything else we need to know about these data points?” An example of this in my life happened last year when we noted a small drop in Iowa Assessment scores in several grades. It would have been easy to suggest our instruction or curriculum materials needed a boost, however after a closer look, we realized the areas we could most notably improve upon would require us teaching to the test rather than the grade-level standards (which is not something we were willing to do). Investigating the context around these data points lead us to a completely different next step.

Using data to monitor and evaluate is important, too. At a recent AEA curriculum directors’ meeting, a few of us discussed program evaluation and the struggles that go along with effectively and efficiently evaluating various programs in our districts. Realizing program evaluation data does not always need to solely involve test scores was a helpful reminder. For example, my district uses several self-audits and continuums to identify our current level of implementation. We have a continuum to assess each team’s current progress towards our professional learning philosophy (i.e. power standard development, common assessments, data analysis, and action planning) that has informed professional learning and team goal setting during the past several years. Asking questions such as “To what degree are we implementing this practice with fidelity” may be a precursor to concluding the degree to which an initiative or classroom practice is impacting the expected outcomes.

In closing, curriculum leaders are relentlessly building capacity in the school system to use data as a driver of informing, implementing, monitoring, and evaluating results and corresponding decisions. This function does not require advanced training in spreadsheets or mathematics! Leading data analysis does involve summarizing and formatting data in a meaningful way that will allow others to draw conclusions from the information in order to address a specific problem or challenge.

Resources to further learning as a leader of data analysis:

  • Partnering with Parents to ask the Right Questions by Luz Santana, Dan Rothstein, and Agnes Bain (2016, ASCD)
  • Root Cause Analysis: The Core of Problem Solving and Corrective Action by Duke Okes (2009, ASQ Quality Press)
  • Data Analysis for Continuous School Improvement, 4th Edition by Victoria Bernhardt (2017, Routledge)

What does it mean to be a leader of curriculum, instruction, and assessment?

[Note to readers: This column was printed in a November 2017 edition of Iowa ASCD’s The Source e-newsletter.]

What does it mean to be a leader of curriculum, instruction, and assessment?

Not too long ago, I challenged readers to join Iowa ASCD this school year by digging deeper into what it means to be a curriculum lead.  According to our organization, the functions of our work as a curriculum lead include being leaders of…

  • Curriculum, Instruction, and Assessment
  • Data Analysis
  • Processes
  • Professional Development
  • Relationship Building
  • Performance
  • Operations, and
  • Change.

In this column, I’d like to describe my experiences leading curriculum, instruction, and assessment, several key questions curriculum leads might ask themselves, and a few resources to further learning in this function.  Throughout the year, future columns will be dedicated to the remaining curriculum leadership functions.  Whether you are a principal also serving in a curriculum leadership role, a full-time central office administrator, or an aspiring teacher leader, I hope this information will be helpful to you in growing your curriculum leadership capacity.

“Effective curriculum leaders must assure that there is a laser-like focus on the alignment of curriculum, instruction, and assessment with identified district-wide standards and benchmarks at every grade level.”  When I was a classroom teacher in the early 2000s, the role of the curriculum director was to assemble a team of teachers and task them with creating a list of the standards and benchmarks for a given content area.  Too often, we grabbed the standards document from a neighboring school district, made a few tweaks and called it our own.  We probably rushed through the standards identification process because we were more concerned about selecting the next textbook series.  With any luck, the materials we recommended for purchase might have some degree of alignment with the standards we documented earlier in the year!

Enter the Iowa Core Curriculum Essential Concepts and Skills in the first decade of the 21st century. Finally! Iowa became the last state in the country to adopt state standards.  Gone are the days of selecting our own standards.  From the outside, selecting textbooks and accompanying materials seems like it should be an easier task now that we have state and national standards.  Not so fast. I often tell the teachers in my district, “there’s no such thing as the Iowa Core police!”  In other words, just because a publisher uses a “standards-aligned” sticker doesn’t mean that we as curriculum leaders should accept it as face value.  I recommend that curriculum and materials committees consider using tools such as the “Publishers Criteria for the Common Core Standards for Mathematics” (available at achievethecore.org) as a starting point when screening sample materials.

Using these tools, curriculum committees might ask questions such as, “Are there any chapters or units that appear in our standards documents?”  You may be surprised to see chapters and sections that publishers carried over from previous editions of the text without any consideration to the grade-level standards.  Curriculum committees might also consider investigating the level of cognitive complexity the materials assume students should be learning the standards.  Resources on IowaCore.gov note some standards’ alignment with Webb’s Depth of Knowledge.  A well-designed set of materials should consider a wide range of questions and activities within Bloom’s Taxonomy or Webb’s Depth of Knowledge.

Finally, curriculum leaders must be concerned with how the standards are assessed in classrooms across the district, beyond vendor-provided tests.  Solution Tree authors and speakers Rick and Becky Dufour have written extensively on the need for teams of teachers to develop common assessments based upon power/priority standards.  Curriculum leads might consider providing these teams with protocols and processes for developing power/priority standards, such as the ones written in books by Larry Ainsworth.  Using these most important standards, teachers should be allocated significant time during the contract day to create common assessments for the purpose of informing classroom instruction.  When two or more teachers analyze data from these assessments, effective teaching strategies can be shared and students in need of additional assistance can be identified for supplemental support.

In closing, curriculum leaders are constantly painting the picture of a shared vision for the integration of curriculum, instruction, and assessment.  Because it seems state standards are constantly under revision (Hello, ELA, science and social studies standards as of late!), our work in this area will never be done.  Relying on neighboring district documents and publisher labels may be an easy way out, however a viable alternative exists.  I hope you will consider getting your feet wet and engaging teachers in a collaborative process to understand the nexus between standards, instruction and assessment in all content areas.  Through this deep dive, we can develop the collective capacity of the organization to assure that all students are successful.

Resources to further learning as a leader of curriculum, instruction, and assessment:

  • Leading Curriculum Development by Jon Wiles (2009, Corwin Press)
  • Focus: Elevating the Essentials to Radically Improve Student Learning by Mike Schmoker (2011, ASCD)
  • Common Formative Assessments: How to Connect Standards-Based Instruction and Assessment by Larry Ainsworth (2006, Corwin Press)
  • Ahead of the Curve: The Power of Assessment to Transform Teaching and Learning by Douglas Reeves (2007, Solution Tree)

Top 5 pitfalls to avoid in a standards-based grading system shift

Are you thinking about making the shift to standards-based grading in your building or district?  Based upon hundreds of phone calls, consultations, workshops and emails, here’s a list of five pitfalls I have observed that school leaders should avoid.

  1. Use exceeds as a descriptor in the grade book at the secondary level.
    Nothing frustrates Sally and her parents more than realizing the teacher taught the class how to learn the concept in class, but in order to get the highest mark in the grade book, Sally must come up with some type of application or knowledge beyond what was taught on the assessment.  Instead, consider removing “exceeds” and replacing it with “understands the standards” for the top indicator.
  2. Fail to communicate the standards-based grading shift.
    Traditional grading has been around for over one hundred years, so there’s reason to believe a shift to something new or different will require communicating a solid rationale and plan, repeated multiple times in multiple mediums.  Of McRel’s twenty-one leadership responsibilities, communication is one that takes a hit during second order change (and yes, standards-based grading is likely a second order change for many teachers, parents and students in your district).  Tell ’em. Tell ’em what you told ’em. And tell ’em again.
  3. Do not report practice in the online grade book at the secondary level.
    We know that reporting academics separate from work habits is a cornerstone of standards-based grading/reporting.  At the secondary level, the standards (rather than quiz and test numbers) are often reported through an online grade book , leaving little, if any room to document work habits.  Whether it’s retrofitting a grade book designed for traditional grading practices, or using a grade book more in tune with standards-based grading practices, it only makes sense to continue reporting levels of homework completion to parents, despite these assignments not counting towards the final academic grade calculation.
  4. Forget to tell stakeholders what is staying the same during the shift in grading practices.
    If your middle school is switching to a standards-based report card, be sure to let parents know you will continue to host parent-teacher conferences twice per year.  If your high school is shifting to a standards-based grade book, parents will want to know final course grades are still reported on the transcript, and that grade point average will be communicated with university admissions offices.  In addition to communicating what’s changing, don’t forget to let them know what will remain the same.
  5. Inconsistent implementation
    During the first year of standards-based grading implementation, we surveyed parents and students to find out their perception of this change.  Frustrated Roger = Frustrated Roger’s mom and dad, and one of the biggest sources of this angst was inconsistent implementation.  While we had an agreed upon purpose of grading and board-approved grading guidelines, we relied on (often inconsistent) institutional knowledge rather than a documented tight and loose implementation guide for our teachers to operationalize the tenets of SBG.  Somewhere between “every teacher for his/her own” and a lockstep approach is usually a good place to land.  Ensuring teachers are supported to implement agreed upon standards-based grading non-negotiables, will help students and parents adapt more quickly to the change, because they’re seeing it in multiple courses and/or grade levels.

What other pitfalls would you add to this list?

Recommended reading:

Frankin, A., Buckmiller, T., & Kruse, J. (2016). Vocal and vehement: Understanding parents’ aversion to standards-based grading. International Journal of Social Science Studies, 4(11), 19-29. [Available online]

Peters, R., Kruse, J., Buckmiller, T., & Townsley, M. (2017) “It’s just not fair!” Making sense of secondary students’ resistance to a standards-based grading initiative in the midwestern United States. American Secondary Education, 45(3), 9-28.

Peters, R. & Buckmiller, T. (2014). Our grades were broken: Overcoming barriers and challenges to implementing standards-based grading. Journal of Educational Leadership in Action2(2), [Available online]

Swan, G.M., Guskey, T.R., & Jung, L.A. (2014). Parents and teachers’ perceptions of standards-based and traditional report cards. Educational Assessment, Evaluation and Accountability, 26(3), 289-299.

Urich, L.J. (2012). Implementation of standards-based grading at the middle school level (Doctoral dissertation). Retrieved from http://lib.dr.iastate.edu/etd/12492

“It’s just not fair!” Making sense of secondary students’ resistance to a standards-based grading initiative

A new peer-reviewed article I co-authored is now available in your local academic database!

Peters, R., Kruse, J., Buckmiller, T., & Townsley, M. (2017). “It’s just not fair!” Making sense of secondary students’ resistance to a standards-based grading initiative. American Secondary Education, 45(3), 9-28.

 

 

The School Leader’s Guide to Grading [book review]

As a result of a top 10 standards-based grading books list published not too long ago, a reader of this blog made me aware of The School Leader’s Guide to Grading by Ken O’Connor.  So, I bought a used copy on Amazon and read it during a summer airplane trip, halfway across the country.

I cannot believe I had not read this book until now and whole heartedly recommend it to all principals and central office administrators who are considering a standards-based grading shift.

The preface states, “This book is intended to provide principals with ideas that will improve their effectiveness in helping and supporting their teachers in evaluating and communicating student achievement.”  I believe this book does just that, in a concise and easy-to-read manner.  Although the title of the book does not refer explicitly to “standards-based grading,” author Ken O’Connor communicates four critical conditions for effective grades which are right in line with SBG principles.  For example, one of the conditions states, “Grades must be meaningful” and the author further explains “Getting a B in history tells students and parents almost nothing….To be meaningful, grades need to be based upon standards, outcomes, or expectations” (p. 2).

Perhaps the aspect of this book I appreciated the most was Ken O’Connor’s ability to articulate both theory and reality.  While eliminating letter grades may be the gold standard, O’Connor realizes this may be beyond state, district, or local expectations, therefore he proposes practical ways to help principals keep the focus on learning.

Another helpful component of the book is the examples from schools who are working towards each of the grading conditions.  O’Connor is quick to note these are all examples and not models, which again illustrates the practical and humble approach the book takes in assisting principals with grading shifts.  For example, the book suggest students should be provided multiple opportunities to demonstrate their learning.  Often times, this will involve students completing “correctives” prior to reassessment.  A sample “Assessment Retake Reflection” from a school in Wisconsin is provided for principals to use as a starting point in their conversations with individual teachers or an entire faculty.

Finally, at less than 100 pages (including ~20 pages of appendices), I believe this book is an appropriate length for principals who are often busy managing the day-to-day operations of a building.  If I were to lead a course for school leaders looking at standards-based grading, this would be my first choice.

(Much of this book review was cross-posted on Amazon.com)

How does standards-based grading affect standardized test scores?

A teacher from a school in Iowa recently contacted me with an inquiry,

Is there any research indicating students going through a standards based grading system show improved standardized test scores  or college readiness compared to students that go through a traditional grading school?

Context: What we know about educational research

This is an excellent question that comes up often when educators and their school systems are considering a shift towards standards-based grading. Based upon my knowledge of research methodology, it would be challenging (but not impossible) to conduct a study truly isolating standards-based grading as a single variable influencing a school’s student achievement data. In other words, we know that in any educational study, limitations exist (i.e. fidelity of implementation, additional initiatives simultaneously assisting or hindering test scores, the alignment between state standards taught and standards assessed, and any placebo effect).  Finally, any experienced educational researcher will readily admit the challenge of generalizing study results outside of the original context.

How does standards-based grading affect standardized test scores?

I scoured the literature as part of my recent dissertation and found only a few quantitative studies that consider this type of question (How does SBG affect standardized test scores?), some of which look at an entire school and others that look at a smaller section of a school, such as an individual classroom. Each has clearly stated the study limitations.  Here’s a quick copy/paste from my dissertation:

The impact of standards-based grading on external achievement measures is mixed. While some studies indicate a significant statistical difference in one or more content areas (e.g. Haptonstall, 2010; Pollio & Hochbein, 2015), others have not (e.g. Rosales, 2013; Welsh, D’Agostino, & Kaniskan, 2013).

To add additional clarity, I’ve added more detail below related to each of the aforementioned citations.

Haptonstall (dissertation): From the abstract of the study, emphasis mine:

This study examined the correlation between the grades a student earns in his or her classroom and the scores that each student earned on the Colorado Student Assessment Program tests, in Reading, Writing, Math, and Science. The study also examined the mean scores of varying sub-groups to determine if certain sub-groups demonstrated higher means, dependent of the school districts that they were enrolled. While all the school districts that participated in the study showed a significant level of correlation between grades and test scores, Roaring Fork School District Re-1, using a standards- based grading model demonstrated both higher correlations and higher mean scores and grades across, the overall population and sub-groups.

Pollio & Hochbein: From the abstract of the study:

Results indicated that the rate of students earning an A or B in a course and passing the state test approximately doubled when utilizing standards-based grading practices. In addition, results indicated that standards-based grading practices identified more predictive and valid assessment of at-risk students’ attainment of subject knowledge.

Rosales: From the dissertation study, emphasis mine:

This study seeks to determine whether standards-based grading has the same effect on students at the high school level (grades 9-12) by comparing end-of-course test scores and posttest scores of Algebra 2 students enrolled in a standards-based graded classroom with to those enrolled in a traditionally-graded classroom. Two teachers each taught two classes of Algebra 2 and graded one class using standards-based grading and one class using traditional grading methods. Students at both the honors level and the regular level of mathematics were included in the study.
Honors students performed better than regular students on both assessments, but no significant difference was found between the performance of traditionally-graded students and the students who were graded with standards-based grading.  The results of this study indicate that standards-based grading may offer improved methods of communication between teachers, parents, and students and may give students a new perception of learning.

Welsh, et al.: From the abstract, emphasis mine:

Standards-based progress reports (SBPRs) require teachers to grade students using the performance levels reported by state tests and are an increasingly popular report card format. They may help to increase teacher familiarity with state standards, encourage teachers to exclude nonacademic factors from grades, and/or improve communication with parents. The current study examines the SBPR grade–state test score correspondence observed across 2 years in 125 third and fifth grade classrooms located in one school district to examine the degree of consistency between grades and state test results. It also examines the grading practices of a subset of 37 teachers to determine whether there is an association between teacher appraisal style and convergence rates. A moderate degree of grade–test score convergence was observed using three agreement estimates (coefficient kappa, tau-b correlations, and classroom-level mean differences between grades and test scores). In addition, only small amounts of grade–test score convergence were observed between teachers; a much greater proportion of variance lay within classrooms and subjects.

Given inconclusive evidence, why would a teacher or school decide to embark upon standards-based grading?

Here’s what I’ve found: First, the absence of research supporting traditional grading practices is concerning. Too many times, stakeholders enter these types of conversations assuming traditional grading practices are some type of research-proven paradigm when in fact, schools inherited the traditional grading system over one hundred years ago (Cureton, 1971).  Next, beyond the limited quantitative studies related to standards-based grading available right now (and summarized above), classroom teachers can do a better job aligning what we teach with our assessments, a fundamental tenet of grading reform.  In other words, due to a dearth of evidence, educators should strongly consider pragmatic solutions.  For more on these pragmatic themes and their connection to scholarly literature, I encourage readers to consider, “What does the research say about standards-based grading?” a research primer I co-wrote with Dr. Tom Buckmiller several years ago.  Finally, standards-based grading provides students and parents with more useful information about current levels of work (“proficient understanding of Pythagorean’s Theorem”) when compared to traditional grading practices (“85% on the Chapter 3 Test”).

In summary, the impact of standards-based grading on external achievement measures is mixed. With limited quantitative studies available to base this conclusion upon, educators should consider pragmatic benefits of standards-based grading practices and urge educational researchers to respond to this question with more detail in the future.

Works Cited

Cureton, L. W. (1971). The history of grading practices. NCME Measurement in Education, 2(4), 1-8.

Haptonstall, K. G. (2010). An analysis of the correlation between standards-based, non standards-based grading systems and achievement as measured by the Colorado Student Assessment Program (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses. (UMI No. 3397087)

Pollio, M. & Hochbein, C. (2015). The association between standards-based grading and standardized test scores as an element of a high school model reform. Teachers College Record, 117(11), 1-28.

Rosales, R. B. (2013). The effects of standards-based grading on student performance in Algebra 2 (Doctoral dissertation). Retrieved from http://digitalcommons.wku.edu/diss/53/

Welsh, M. E., D’Agostino, J. V., & Kaniskan, B. (2013). Grading as a reform effort: Do standards-based grades converge with test scores? Educational Measurement: Issues and Practice, 32(2), 26-36. doi:10.1111/emip.12009

Doctoral program: 36 month update [graduated!]

Nearly three years ago, I started a doctorate in education program at the University of West Georgia.  Today, I am happy to share all coursework and dissertation requirements are finished and as a result, I recently walked across the stage!

(Dissertation chair, Matt Varga, and me before commencement)

Although participating in the ceremony is optional, it provided a sense of closure and personal accomplishment for me.

What is next?

  1. Business as usual as a district administrator.
  2. Teaching a weekend curriculum course for aspiring school administrators this summer.
  3. Continue working with my chair to publish portions of my dissertation research in one or more peer-reviewed journals.

Previous doctoral program updates: