Week 10 — Thoughts and Questions

I really enjoyed this course. I think that this major project really helped me to fully understand the evaluation process. I never knew how many components there were and how much detail it included. I put a lot of thought and energy into this program to make sure that it would help me in a real life situation.

Some things that I would have liked to explore more are other types of evaluation. We focused mainly on Appreciative Inquiry. I would like to know what other ways could programs be evaluated? I also think that in the future, more detailed case studies would be very helpful. The ones we read in our book were great. However, sometimes they lacked detail that might be important for the reader.

In terms of my final course project, I just posted my final draft for feedback. After I receive the feedback I will make changes as necessary. I also have to continue to work on my Power Point presentation. Does anyone know if we submit our Power Point? Or will we be running it ourselves in Elluminate?

Week 9 – Evaluation Systems

An evaluation system is “a means for identifying, developing, implementing and sustaining those things that support evaluative inquiry.”  According to Reframing Evaluation Through Appreciative Inquiry there are five essential components of an evaluation system.  Those components include: Leadership Commitment, Evaluation Vision and Philosophy, Evaluation Strategic Plan, Evaluation Design and Implementation Requirements, and Personnel and Financial Resources. 

 

Leadership Commitment means that all the leaders of the organization are clear on presenting the goals and values and explaining how important an evaluation is.  The evaluation is important because it strengthens the organization.  The leaders have to explain that during the evaluation, they will be working together as a team to improve the organization.

 

Evaluation Vision and Philosophy includes a vision statement and philosophy in which the organization follows.  The vision statement describes the organization’s values and beliefs.  The philosophy “communicates the organization’s preferred model or approach that will guide evaluation practice.”

 

An Evaluation Strategic Plan is the who, what, where, when, and how of the evaluation.  In this plan, details are planned out with who is involved, where it is held, when will it be held, how long will it be held, what will be done during this time, etc.  It is a very detailed plan.

 

Evaluation Design and Implementation Requirements is to ensure that the evaluation system is implemented in ways that reflect professional evaluation practice.  There are four requirements that contribute to successful evaluations.  Those requirements include Evaluation Plans, Technology Resources and Infrastructure, Communication Systems, and Flexible and Responsive Evaluation Practices.

 

Personnel and Financial Resources include having enough people involved to not only run the evaluation but to participate in as well.  There also should be enough money to run the evaluation.  If there is not enough of either of these, then it will not be a proper evaluation.

 

As far as my final course project, I still need to work on my Power Point a bit.  I should also touch up my wording, spelling, and format in each piece of my project.  I really like having each piece due every couple weeks.  It keeps me on track and focused on each part of the project.  I am still a bit confused on our presentation length though.  The lecture said 5 minutes but I read elsewhere 7-10 minutes. 

Week 8 — Survey Questions

Creating my survey was not as hard as I thought it would be. All I had to do was think of my big questions. From there, I wanted to create surveys for both my students and teachers. The teachers are the ones who actually have to know how to use the technology and show the students. With my survey I wanted to see how knowledgeable the teachers were in the area of technology and how much more they wanted to learn. The students are the ones who then use the technology to assist them in their academic learning.

The information I wanted to get from the teachers consists of how knowledgeable they felt with each particular item of technology. I also wanted to know if they received any professional development, if so what kind? Lastly, I wanted to know if there were any other types of technology training they felt would have been important to study. All of these components would help me in further development of technology.

The information I wanted to get from the students consists of which areas they felt strong/weak in and how the Resource Center could help them. Each student that entered the Resource Center had some sort of a benchmark or goal. They may not have known that offhand but most students to have academic goals in general. I wanted to learn if that benchmark or goal was accomplished during the time spent at the Resource Center. Basically, is the Resource Center a valid place for students to go to receive help?

I think the think aloud really helped in the process of survey creating. Any time there is another person reading over questions it is another mind that can find mistakes or think of something even better. By having that other person to look over your work, it can make the survey a spectacular survey. Erik did a great job giving me feedback. I was able to change words, omit questions, and even form new questions. He was able to read the questions different ways than I so he was able to think of new words to add or change. I thought it was a very helpful assignment.

Week 7 — Interviews

Having the right questions is the most important part of AI. Those questions answer how to change or improve your program. Those appreciative questions guide your participants to work together to create a great plan to shape the future of your organization. Sometimes there may be issues with choosing positive questions rather than appreciative questions. When choosing the right questions, one must not ask a question that would make them answer in a positive way. Rather, appreciative questions have the participants focus on the positives. These questions ask the participants to think about their past and tell a story, or vision what they would like the future to look at. Having the right questions provides useful and meaningful data.

When thinking about choosing the right appreciative questions, one must first think about the evaluation and key questions. Your key questions are what you are trying to find out from your evaluation. You must also think about the people you are evaluating and the types of questions that should be asked based on your group.

Sometimes answers can not be received through a survey and an individual must be interviewed. Personal experiences can be shared during an interview. Interviews bring people and groups together. By doing this, it created a more positive atmosphere. These interviews can be done in person, on the phone, or using the internet.

The questions for my interview include:

Question 1: Think back about your time spent at the Resource Center. Describe with some detail your experience with the Resource Center. Also please describe the ways in which you helped students use technology in the Resource Center.

Question 2: What are the most important things you’ve learned about technology while attending the workshops? Having learned what you’ve learned, what do you think are the ways in which technology can help students with 504’s or IEP’s?

Question 3: What are the biggest challenges you experienced while helping students at the Resource Center?

Question 4: Do you have any success stories about your time spent at the Resource Center or making positive changes to the Resource Center or student success?

To choose these appreciative questions, I first thought about the information I was trying to get from my participants: what they did in the center, how technology has helped them, what has been hard, and what they could change to make it a better place. I know I wanted personal examples from my interviewee so I used the words “think”, “describe”, “stories”, and “you”. Using these words has my interviewee focus on personal stories of his or her experiences.

For my class interview, my partner was Erik. He and I met Wednesday night in the moodle chatroom. I really feel that this was a great assignment. By having this assignment, we each had to create positive AI questions. When we asked our partner the question, we were given feedback to fix our questions. Erik was able to tell me what changes needed to be made and other ways of wording my questions to sound more positive. After he gave me his feedback, I too answered questions and gave my feedback.

The feedback I gave Erik included making a question a more open ended question rather than a yes/no answer. I also suggested combining two of the questions into one since they sounded similar. I also suggested changing the wording around to condense a question.

The only difficult part of this assignment was answering the questions. I was not completely familiar with his program so I tried my best to answer the questions.