Sunday, February 15, 2015

Your State's Guide to RtI Just Doesn't Make Sense



What your Department of Education isn't Sharing about its Multi-tiered/Response-to-Intervention Procedures   

Dear Colleagues,  

  When you work as a national consultant, it is expected that your districts or schools are going to give you the toughest problems to solve. . . . the most academically or behaviorally challenging students, the most resistant teachers, the schools that have been failing the longest and the hardest. And that's why I love doing what I do.

   However, the toughest school or district problems are sometimes compounded by (federal or local) Department of Education policies or procedures that are not supported by sound research, effective practice, or even common sense.

   Recently, my work in one state required me to review the state's new policy and procedures manual on "Response to Instruction and Intervention" (RTI2). While this state's RTI approach was similar to other states in many ways (and that is not necessarily a good thing), it is crucial to recognize that statutory popularity does not represent field-based validity.

   In fact, when departments of education pass and police bad RTI policy and practice, at least two dilemmas result. The dilemma of:

   * How, within the bounds of ethical and effective practice, a consultant does not point out how the state's statutes are likely, for example, to harm students by delaying or denying them timely and appropriate services.

   * How, a consultant can ask a district to ignore or not comply with its state statutes ... when s/he knows that accountability to these same statutes is required.


   While the simple resolution would be to make sure that all state statutes reflect sound research, effective practice, and common sense- - that is more idealistic than realistic in our hyper-politicized world (really!) of education. Remember, I have worked in a state department of education for over 12 years.

   And so, the only answer is that there are times when courageous acts of "educational common sense" are needed, on behalf of our students, as these acts reflect the right thing to do.  

Remember Peter Drucker's quote: 
"Management is doing things right; Leadership is doing the right things.
_ _ _ _ _ _ _ _ _ _


Leadership Responses to Flawed RTI Statutes

   In reviewing the RTI2 Guidebook of the state where I was consulting, the following management flaws (see Drucker's quote) stuck out as needing common sense leadership.

Flaw #1. Missing the Interdependency between Academics and Behavior.

   I often ask teachers with struggling students two critical questions:

   * Do you have students who are behaviorally acting out because of academic frustration?

   * Do you have students who are academically not learning (or not learning quickly enough) because they do not have certain behavioral skills (sitting in their seat, paying attention, working in interpersonally effective ways with others)?

   When they answer "Yes" to both questions they are demonstrating that academic instruction, learning, and mastery is interdependent with classroom discipline, behavior management, and student self-management.

   Thus, it does not make sense for a state's RTI process to focus only on academic skills. . . to the exclusion of students' social, emotional, and behavioral skills.  

   Indeed, if a student does not (a) have the social skills to get along with others (e.g., in a cooperative learning group); (b) feel emotionally secure in class (e.g., due to teasing or school safety issues); or (c) have the behavioral skills to organize themselves (e.g., to work independently), then the even best teachers, curricula, technology, and instruction will not result in the desired academic outcomes.
_ _ _ _ _ _ _ _ _ _

Flaw #2. Missing the Continuum of Instruction.

   Many state RTI2 guidebooks and systems do not provide a research-based continuum of services and supports that helps to organize and differentiate the difference between "instruction" and "intervention." These guidebooks talk about the need for intervention, but rarely provide any specificity.

   Over the past decade (or more), we have presented this continuum to states, districts, and schools across the country---presenting it as the PASS (Positive Academic Supports and Services) model.

   As is evident in the slide below, RTI starts with an effective teacher providing sound, differentiated instruction, supported by good classroom management, and the data-based monitoring of students' academic and behavioral learning and mastery.  

   When students are not learning (or learning quickly enough), an assessment process must be conducted to determine why the progress is missing (see Flaw #3 below). This assessment could be done (a) by the teacher, (b) with the support of grade-level colleagues as part of a Grade-level RTI Team, or (c) with the support of the multidisciplinary Building-level RTI Team. How the teacher assesses the problem is determined largely by his/her skills, and the duration or intensity of the problem (see Flaw #7 below).


   Once the underlying reasons for the problem have been validated, the teacher (once again- - by him/herself, supported by grade-level colleagues, and/or with members of the Building-level RTI team) strategically decides how to solve the problem (see Flaw #4). As in the slide above, the problem may be solved through strategically selected:

   * Assistive support technologies
   * Remedial approaches
   * Accommodation approaches
   * Curricular modification approaches
   * Laser-targeted Interventions
   * Compensatory strategies

   When students are demonstrating social, emotional, or behavioral problems, a comparable continuum is used (after completing the needed functional assessments) that consists of strategically selected:

   * Skill Instruction strategies
   * Speed of Learning and Mastery Acquisition strategies
   * Transfer of Training strategies
   * Emotional Coping and Control strategies
   * Motivational strategies
   * History of Inconsistency strategies
   * Special Situation strategies
_ _ _ _ _ _ _ _ _ _

Flaw #3. Avoiding Diagnostic or Functional Assessment until it is Too Late.

   Many state RTI2 guidebooks, adopting the flawed approaches of the U.S. Department of Education's RTI technical assistance centers, advocate for a "wait to fail, then assess" strategy. That is, when students are not succeeding academically (for example) at Tier 1, they recommend 30 minutes of largely unspecified group interventions at Tier 2. Then, if the students are still having problems, they recommend a diagnostic (or, for behavior, functional) assessment as the entry point to Tier 3.

   And yet, critically, I don't know many doctors, electricians, car mechanics, or other professionals who would not do a diagnostic assessment at the beginning of the problem solving process. . . to ensure that their first recommendations are their last recommendations (because the problem is solved).

   And so. . . Why would we, in good conscience, "allow" a student to struggle for six to ten or more weeks in the classroom, and in a Tier 2 intervention, so that we can get to the point where we finally do a diagnostic assessment to figure out what really is wrong?  

   And why would we do this knowing that, after these multiple and prolonged periods of failure, the problem may be worse (or compounded), the student might be more confused or frustrated, and we might need even more intensive interventions because we did not identify and analyze the problem right from the beginning?
_ _ _ _ _ _ _ _ _ _

Flaw #4. Not Linking Assessment to Intervention.

   Many state RTI2 guidebooks and systems do not delineate the different types of assessment (e.g., screening versus progress monitoring versus diagnostic versus implementation integrity versus high stakes/proficiency versus program evaluation assessments).  This often occurs because state departments of education write their guidebooks to meet a statutory requirement . . . rather than to educate their practitioners. 

   Relative to RTI processes that will effectively help students with academic or behavioral difficulties, state guidebooks and systems typically do not emphasize the importance of linking diagnostic assessment results with the instructional or interventions approaches that have the highest probability of success.

   Critically, when school practitioners do not strategically choose their student-focused instructional or intervention approaches based on reliable and valid diagnostic assessment results, they are playing a game of "intervention roulette."  

   And, as in Vegas, the "house" usually wins. But, in the classroom, the loss here is the student's loss.

   Every time we do an intervention that does not work, we potentially make the problem worse, and the student more resistant to the next intervention.

   Said a different way: Intervention is not a benign act. . . it is a strategic act.  We should not be satisfied, professionally, because we are implementing interventions. We should be satisfied when we are implementing the right interventions that have the highest probability of success for an accurately identified and analyzed problem.
_ _ _ _ _ _ _ _ _ _

Flaw #5. Focusing on Progress Monitoring rather than on Strategic Instruction or Intervention Approaches

   Many state RTI2 guidebooks and systems overemphasize progress monitoring. . . and then, they compound the problem by overemphasizing curriculum-based measurement (CBM) to the exclusion of other curriculum-based assessment (CBA) approaches.

   In addition, most of the progress monitoring examples-- in the state guidebooks that I have reviewed-- are in the area of reading decoding and fluency (where the progress monitoring research and writing has been most prevalent).   

   Rarely do you see state guidebooks discuss progress monitoring for vocabulary and comprehension. . . not to mention the lack of progress monitoring examples in the different areas of math, written expression, spelling, and oral expression.  This is because progress monitoring for these outcomes does not work well with CBM. 

   Finally, most state guidebooks do not explain how to effectively create (or evaluate the acceptability of) a progress monitoring probe.  That is, they do not emphasize that progress monitoring approaches must be connected to the instructional or intervention goals, outcomes, and implementation strategies.  

Said a different way:

   * If the instructional or intervention target for a student is increasing his/her understanding and receptive/expressive use of a specific list of grade-level vocabulary words, then the assessment protocol must be designed to sensitively measure these explicit outcomes.

   * If the instructional outcome is a certain format of expressive writing, then reliable and valid scoring rubrics need to be created to guide not just progress monitoring, but instruction and student self-evaluation.


   As noted earlier, progress monitoring is an evaluation approach. Thus, for students with academic or behavioral problems, it follows the (a) identification and (b) analysis of the problem, and the (c) intervention preparation and implementation stages. Unfortunately, some educators still believe that progress monitoring is the intervention. Or, they believe that the intervention must fit the progress monitoring tool adopted by the district- -rather than the tool being fit to the intervention outcomes desired.
_ _ _ _ _ _ _ _ _ _

Flaw #6. Establishing Rigid Rules on Student's Access to More Intensive Services

   I have no problem with a state RTI2 guidebook providing a blueprint on the typical sequences and decision rules that a teacher needs to follow to "move" a student from Tier 1 to Tier 2 to Tier 3. However, I do have a problem when the sequence must be followed in a rigid, fixed way.

   Simplistically, there are two types of students with academic or behavioral problems: students with progressive, longstanding, or chronic problems; and students with significant, severe, or acute problems.

   For the latter students especially, they often need immediate and intensive (Tier 3, if you will) services, supports, strategies, and/or programs. They (and their teachers) should not have to go through a series of intervention layers so that they eventually "qualify" for the services that they need.

   I "get" that many worry about an influx of inappropriate referrals to the Building-level RTI Team. But, if you break your leg, you need to go to the emergency room. If you try to fix it yourself, you may get an infection and lose the whole leg.

   The "trick is in the training." In the schools where I work, we create a collaborative system where everyone in the school is trained on the data-based problem-solving process. We also create an early warning "problem solving, consultation, intervention" culture, along with a "check and balance" approach to minimize the number of capricious referrals to the Building-level team.

   It works. But more important is the fact that more students are receiving earlier and more successful instructional and intervention approaches. And, the teachers are leading the entire process. . . with greater enthusiasm, involvement, self-direction, and success.

   Isn't this the true goal of RTI? 
_ _ _ _ _ _ _ _ _ _

Flaw #7. Setting a "Price" on Access to Multidisciplinary Consultation

   To concretize the ultimate point in Flaw #6 above:  If a student needs to be immediately considered by the Building-level RTI Team, then this should occur without the need for a certain number of interventions implemented for a certain number of weeks, under a certain level of conditions.

   In other words, get on with it. . .  
           "Do not stop at Go, and do not collect your $200."

   But I want to extend this point. If a teacher needs a consultation with a colleague in order to better understand and work with a student, there should not be restrictions on what colleagues are available.

   To be explicit:  Too often, I hear that general education teachers cannot consult with special education personnel (teachers, OTs, PTs, speech pathologists, etc.) until a student needs "Tier 3" attention. This makes no sense if the earlier consultation could have resulted in "Tier 1" success . . . thereby eliminating the need for more intensive Tier 3 attention.

   Sometimes, the reason for restricting the consultation is that the "special education teacher is paid through federal special education funds that don't allow the consultation to occur earlier."

This is simply not true.  

   Even in the most extreme interpretation, the federal special education law (IDEA) encourages early intervening services, and it allows districts to use up to 15% of their special education funding for services and supports that are not directed to students with a disability.
_ _ _ _ _ _ _ _ _ _  

Summary

  As always, we need to use common sense and focus our decision making on student outcomes.  

   Our state RTI2 guidebooks need to provide blueprints and guidance that are supported by sound (not self-selected) research that are translated into effective (not limited trial) practices that result in demonstrable (not hypothetical) student outcomes. Rigid, one-size-fits-all approaches do not work. Schools need be given the flexibility, within the state blueprints provided, to implement the best problem solving, progress monitoring, and services and supports to academically struggling and behaviorally challenging students.  And educational practitioners who are working directly with those students are in the best positions to do this.  

   Brandon Sanderson was right when he said:  

"The mark of a great (educator) is one who knows when to set aside 
the important things in order to accomplish the vital ones."
_ _ _ _ _ _ _ _ _ _

   I hope that some of the ideas above are thought-provoking, and motivate you to look at how you are providing services and supports to all of your students.  If these ideas validate what you are doing. . . excellent !!!  If they uncover areas of improvement. . . I appreciate your willingness and dedication to the change and improvement process.

   But to make all of this more concrete:  

I want to give you a free
RtI Implementation Guidebook  

that I have used across the country.  Written for districts and schools, the Guidebook gives you a common sense, user-friendly, step-by-step multi-tiered process (with forms) that can organize your entire RtI process.

   To download the guide, look at the first entry on the following page of our website.

   CLICKHERE 

   Meanwhile, thank you for everything that you do to support your students, staff, and schools.  Let me know if I can be of help. 

Best, 


Howie      

Saturday, January 31, 2015

Correcting the Flaws: The Feds’ Thinking on Academic Proficiency and Results Driven Accountability



Connecting and Correcting the Flaws in (ESEA's) High Stakes Proficiency Assessments of Students' Academic Achievement and (OSEP's) the New Special Education Results Driven Accountability System  



Dear Colleagues,

   I hope that your January (and New Year) has gone well. . . and that you are focused on your student, staff, and school goals and outcomes as we enter the second half of the school year.

The ESEA Debate on High-Stakes Testing and the Federal Move to Results Driven Accountability

  With a new Congress seated and in session, a lot of attention is focused on reauthorizing the Elementary and Secondary Education Act (ESEA) within the next two months.  In fact, there have already been a number of Congressional hearings (CLICK HERE for related story), at least two draft “discussion bills” (one each from the Senator Lamar Alexander and Representative John Kline, the respective chairs of their chamber’s education committees), and a reauthorization policy speech and outline from Secretary of Education Arne Duncan.
 
   Unfortunately, most of the public attention seems to be on whether the new ESEA should continue to require (a) annual high stakes assessments to determine students’ academic proficiency, and (b) the (flawed) use of these data to determine a school or district’s effectiveness.  In fact, over the years, the debate has escalated to activism (CLICK HERE for related story) as student, parent, and other stakeholders have planned and carried out actions to “opt out” of these assessments.
_ _ _ _ _

   In the parallel world of federal policy and practice, the U.S. Office of Special Education Programs (OSEP) is requiring every state education department to document its “Phase I” approach to the new Results Driven Accountability (RDA) process as represented in Indicator 17, (the State Systematic Improvement Plan; SISP).  This is a required part of each state’s annual special education State Performance Plan/Annual Performance Report which is due in Washington, DC in the next few days (CLICK HERE for more information).
 
   And so, along with the current or reauthorized ESEA, states, districts, and schools now must attend to the RDA initiative as described by Deborah Delisle, the U.S. Assistant Secretary for Elementary and Secondary Education and Michael Yudin, the Acting U.S. Assistant for Special Education and Rehabilitative Services in a joint May 21, 2014 letter to every state’s Chief State School Officer:

“The U.S. Department of Education is implementing a revised accountability system under the IDEA known as Results-Driven Accountability (RDA), which shifts the Department’s accountability efforts from a primary emphasis on compliance to a framework that focuses on improved results for students with disabilities. RDA will emphasize child outcomes such as performance on assessments, graduation rates, and early childhood outcomes. In the coming year, each State will be required to develop a State Systemic Improvement Plan (SSIP) as part of the State Performance Plan / Annual Performance Report that the State submits annually in accordance with the IDEA. In developing the SSIP, States will use data to identify gaps in student performance, analyze State systems, and then implement targeted, evidence-based reforms to address the gaps.”
_ _ _ _ _ _ _ _ _ _

The Flaw(s) of Single-Measure Accountability

   One of the single biggest flaws in the federal (and, sometimes, state) approach to accountability is the dependence on a single measure.  While a single measure may be acceptable as part of a screening to determine whether a student may be having academic or behavioral difficulties, or a progress monitoring approach to determine whether a student is making progress in a specific area, it is not psychometrically acceptable for program evaluation. 

   In fact, using a single measure for school or district accountability (i.e., a single test to measure students’ academic proficiency) increases the probability for the following additional flaws or inappropriate/ineffective schooling practices or perspectives:

      * Concluding that a school (or student) is academically successful and that it is doing the “right things” that are “causing” its success, or concluding that a school (or student) is academically unsuccessful and needs to change some of its “ineffective” practices

     * Taking a “top-down” perspective where the test-specific factors that make students successful are analyzed, rather than a “bottom-up” perspective that looks at the curriculum, instruction, teacher, and student factors that help students to learn, master, and be able to apply progressive levels of “real-world” knowledge, information, and skills

     * Said a different way:  Schools need to avoid teaching to the test, focusing instead on educating students for functional understanding and application. . .  that is. . . they need to focus less on test results, and more on “real-world” educational results

     * Focusing exclusively on a school’s academic program to the detriment of the social, emotional, and behavioral instruction needed to address student trauma and stress, attention and engagement, and project-based and cooperative learning group interactions

     * Teaching students – especially academically struggling students – at their grade-level, rather than at their current functional skill, understanding, and/or instructional level
_ _ _ _ _

   Relative to the special education Results Driven Accountability State Systematic Improvement Plan (SISP), we are already seeing state departments of education interpret the OSEP Annual Performance Plan’s Indicator 17 requirement whereby they are planning on using a single measure to assess the success of their SISP activities. 

   This is in spite of the fact that OSEP wants state to identify “measurable result(s) for children with disabilities (NOTE the plural possibility of multiple results or outcome measures).

   For example, one state is thinking about using only the DIBELS to measure the literacy improvement of their students with disabilities. . .  largely because the schools are already collecting DIBELS data.  Beyond, as above, the flaws of using a single measure to assess systemic improvement, this largely ignores much of what was learned during the Reading First era. . . namely, that:

     *  The DIBELS is a screening and not a program evaluation tool; that
     *  It does not effectively measure literacy comprehension; and that
     *  The results of this process will likely be students who are better at decoding text, but not better at understanding it.

   And so, if state departments of education measure their SISEP goal using (flawed) measures of convenience, their “systemic efforts” will not help students with disabilities to become more effective in the diverse areas of literacy.  This, then, will negatively impact the students’ ability to demonstrate proficiency on their high-stakes assessment tests, and the vicious cycle with continue.
_ _ _ _ _ _ _ _ _ _

So. . . What do We do ???

   In short, there are a number of possible solutions so these problems.  For example:
    
     *  We need to communicate with our U.S. Senators and Representatives immediately, telling them to eliminate the single-test perspective of accountability in ESEA, and endorse a multi-faceted approach that evaluates schools on having effective curriculum and instruction, multi-tiered services and supports for academically struggling and behaviorally challenging students, outcomes-based professional development and teacher evaluation, and progress monitoring and evaluation systems that measure student learning, mastery, and growth.

     *  We need to communicate (nothing is “set in stone” yet) with the special education unit in our state departments of education to find out what their SISEP will focus on, and how its success will be measured . . . so that the “single measure mentality” does not predominate this important initiative.

     *  We need to remember the underlying science of effective program evaluation, and apply it in sound practice.

     *  We need to remember that educational effectiveness and excellence cannot be legislated, it must be planned, resourced, disseminated, and evaluated.

     *  We need to blend targeted outcomes with common sense when implementing services, supports, strategies, and programs at the student, staff, and school levels.  If it doesn’t make sense, it probably won’t work.
_ _ _ _ _

   In the end, we have two great opportunities with the reauthorization of ESEA, and the initiation of RDA.  And yet, if we focus on politics, convenience, oversimplification, and rhetoric, our goals will not be attained, and we will add another layer of frustration to a process that has so many challenges and so many needs.

   Please accept my THANKS for the great services and supports that you provide to your all students each and every day. Have a GREAT week !!!

Best, 

Howie