Week 6- Evaluation Questions

I chose three main questions for my evaluation. Those three questions are:
• How well are teachers properly trained to know what is available at the Resource Center and how to use available technology?
• Are students with IEP’s and 504’s reaching their benchmarks and goals?
• Are all students receiving improved grades due to Resource Center help?

The way I selected these questions is I first thought about what I am evaluating. I am evaluating a Resource Center. At this Resource Center, students of all abilities are being helped by teachers, tutors, and technology. In order for the students to use the technology properly, teachers must be trained to show the students. This is how I came up with the first question. Are the teachers properly trained to show the students how to use the available technology? If not, then they need extra training.

Secondly, students on 504′s and IEP’s need extra assistance on homework, tests, etc. I thought that this Resource Center would be the perfect place for those students to get assistance outside of the classroom. My second question assures that this Resource Center is actually beneficial for those students. By using the Resource Center, students are able to reach their benchmarks and goals.

Lastly, I don’t want to exclude students not on 504′s or IEP’s. All students should be able to go to the Resource Center if they need extra assistance. All students have questions and therefore need a place to get help and answers. My third question includes all students and making sure that the Resource Center is beneficial for them. Is the Resource Center helping students study and achieve higher grades?

I feel that by choosing the three questions I did, I was able to hit the major areas of the Resource Center. Therefore, I can better examine and improve the center.

Week 5 – Appreciative Inquiry and evaluation

There are many similarities and differences between Appreciative Inquiry and evaluation. Both evaluation and AI are used to correct or fix a situation. Many people are involved in the processes. Some work together as groups and some work individually. However, evaluation focuses on fixing problems and looking for what is missing. Appreciative Inquiry focuses on what is working. It also envisions a more positive future and holds discussion groups.

Looking at the book Reframing Evaluation Through Appreciative Inquiry, there are many evaluation competencies listed. These are broken down into six categories: Professional Practice, Systematic Inquiry, Situational Analysis, Project Management, Reflective Practice, and Interpersonal Competence. AI has several similarities with these competencies. Just a few of the most obvious similarities include 2.7 Frames evaluation questions, 3.11 Remains open to input from others, and 4.4 Communicates with clients throughout the evaluation process.

I would have to say that applying AI to the practice of evaluation would be a very easy thing to do. AI and evaluation already have very many similarities that I have listed above. AI just adds the positive view to evaluation. By using AI for evaluation, members converse positive stories and examples that can make their organization even stronger. Several phases are completed until the final phase where their positive visions come true.

This week really made me understand AI and evaluation more clearly. I really like how we had to find the similarities and differences. I would really like to find out what other types of evaluations could be done. I think that would be an interesting topic to study.

Week 4 Annotated Bibliographies

I feel like I spent hours this week researching the articles I wanted to read on Appreciative Inquiry.  I found so many different articles where AI works with different topics.  Those specific topics involving AI include interviews, recovery from dugs/alcohol, faith formation, health/nursing, education, in the workplace, etc.  It is so interesting to see how AI works in every situation. 

 

I also found it interesting to see the specific articles others have chosen.  For instance, Pam chose an article about an interview with Preskill, the author of Reframing Eva luation Through Appreciative Inquiry.  I too read that article but did not choose to annotate it.  In this article, Preskill was interviewed and explained what AI is and how she has used it.  Preskill first heard about AI many years ago and decided to work further with it.  She researched many books and articles and even took workshops.

Patrick choose three completely areas where AI could be found.  His first article involved petroleum and Castrol Marine’s improvement.  His second article describes changes in school culture.  His final article describes school improvement.  It is great that AI can work in different organizations.

Ashley found a great article where is actually helps people and organizations decide if AI is the right method of evaluation for them.  Appreciating Appreciative Inquiry explained that AI does not work for everyone.  I think that after reading Ashley’s annotation that this would actually be a great article for this class to read.  As of now we have already read about what AI is and the types of organizations that use it.  This article probably tells the reader about places where it doesn’t work and how to choose if it is the right evaluation plan to use.

Week 3- Appreciative Inquiry and Project Background

This week our topic was about creating our hypothetical evaluation. I love the fact that we can look ahead and see what the assignments are for the following weeks. Since the first week of class, I have been trying to think of a program that I could hypothetically evaluate. I currently teach at a Catholic high school. At my school, we do not have many resources for students with 504′s or IEP’s. Over the past 2 or so years, my high school has been trying to improve itself to compete with the local public schools. One way has been talking about having a resource center for students not meeting the school’s requirements or students with 504′s or IEP’s. I thought that I could jump ahead before the school and actually create an evaluation before they do. Not only is this practical, but realistic too. My project will be to evaluate a hypothetical resource room with technology to help students of all abilities and levels.

As far as the reading for this week, I am enjoying the book. Appreciative Inquiry is a method organizations of all kinds use to seek what is right for them to be a positive and successful group. It focuses on the positives and what works well of the organization and makes them think as a group how they can make their organization even better.

There are eight principles that make Appreciative Inquiry. These principles include The Constructionist Principle, The Principle of Simultaneity, The Poetic Principle, The Anticipatory Principle, The Positive Principle, The Wholeness Principle, The Enactment Principle, and The Free Choice Principle. Together these principles work to bring people together in groups to converse about the important topics at hand. These small or large groups discuss the positive future of their organization. Together they build on ideas that could better their organization.

Now according to this book, there are several theories and studies that have focused on these types of positive conversations. There are three that I found most interesting. The first is the placebo effect. Basically, this is like “fake” therapy. The way one believes changes one’s neurochemistry. So if a group thinks positively about a goal, they will reach their goal. The second is the Pygmalion effect. This is often known as “the self-fulfilling prophecy.” If you think and believe it will happen, it will happen. The third is known as the heliotropic principle. Positive images of the future will actually influence the future. If an organization shows signs portraying positive futures, positive changes will be made. Other theories mentioned in the book to make positive changes include inner dialogue and motivation.

To summarize the actually process of Appreciative Inquiry, there are four steps that take place as phases. The phases are Inquire, Imagine, Innovate, and Implement. In the first phase, groups first think about the topic and conduct interviews with each other. They ask each other positive questions regarding the topic at hand. They are also told to tell stories of positive success. Phase two is conversation about what could be… visions and possibilities. Groups stretch their imaginations to think what could be possible for their organization. The third phase is what will be done to achieve these visions. What standards and systems should be used? This is considered the longest and most challenging phase due to the fact that details will be made about what will be done to change. The final phase is actually going out and making the changes. Actions are taken and actually implement them.

I think that this would be a great way to make changes in any organization. Usually the negatives are spoken about. Talking negatively usually brings a group down and not motivated. By speaking of positive possibilities, it heightens the mood of the crowd. People feel better about themselves and the changes that could be made. It is better to talk about the positives, or how well something/someone is doing or can do, than to tell everyone how bad they or their group is doing.

Program Evaluation

I am glad that there are so many standards that need to be followed for Program Evaluation.  Throughout the years, I have heard and read about all the poor research and acts that have been done in the past.  It is really a shame all that has been done.  Many people have been killed or mentally/physically hurt.  Think about trying new medicines and not telling the participants about the side effects.  Or even treating people differently based on the gender, race, or age.  There was a time where people were not treated fairly in research and evaluations.  I am sure still today little mishaps still can happen.

 

In today’s day, we have certain standards that must be followed before research or evaluations are performed.  The Program Evaluation Standards were created by The Joint Committee to ensure ethical, realistic, and practical evaluations.  The standards of this book include: Utility, Feasibility, Propriety, and Accuracy.  The standards go even deeper by explaining concepts about defining, designing, budgeting, managing, staffing and reporting evaluation, and collecting and analyzing information.  The Program Evaluation Standards is a great reference for evaluating because it is so well organized and formatted.  The format includes overviews, guidelines, and common errors.  It is definitely a very user friendly book.  This book is so precise and detailed that it is a great reference guide to use when planning an evaluation. 

 

As I was reading through the Use of Human Subjects in Research, I was shocked, and very pleased, to see how much detail and work actually goes into preparing for human research.  There are forms, such as the IRB, and steps that need to be taken in order to conduct a research/evaluation.  The IRB form asks for names of all investigators and participants, a summary of the research, how the research will be conducted, and how the data will be collected.  Having this form for human research confirms that the subjects will have no harm and will be ethical.  As I was reading the pages, I found it very interesting and amusing that a quiz on the IRB could be found on one of the pages.  All persons participating in an evaluation must take the quiz.  I think it is a great idea.  It ensures that the people read everything that needs to be read and proves that they understand. 

 

Looking at the case study from this week, I realize that there are so many fine points that go into an evaluation.  If I were to do an evaluation of some sort before reading what I read this week, I am sure it would have been fair at best.  I am so glad to know that there are so many detailed aspects that needed to be looked at.    

 

As I think about evaluations and programs that I have seen in my school, I have never realized how much has gone into it.  I know in order for us to have and administer student programs, the students and their parents read a form and sign off that they understand and agree to all points.  As for teachers and administrators, we too read the information and have to agree upon it. 

 

I am looking forward to creating my own program evaluation.  I was thinking about creating a resource room with many technology tools.  I have already mentioned it to one of my assistant principals and she thought it was a great idea.  My school is actually trying to start this program within the next few years.  I would like to see how my ideas differ from my school’s ideas once both are complete.