Detailed Report
on Released Time
Evaluation
RELEASED 
TIME!
Evaluation of "Released Time" Education Pilot Program The following pages report findings from detailed evaluations of the 12-week pilot
program for Released Time Christian Education in the Lynn Garden community. Evaluation forms with observations and comments about the RT program were completed by: the participating students, their parents, the school principal, all 8th grade teachers, the school secretary, the school guidance counselor, the host church pastor, and four class observers (a business person, a former college professor, an Eastman retiree, and a member of the state legislature). Class visitors included five media representatives and two school board members. In addition, representatives from many churches in the community served refreshments and observed the class. In the first three classes entering students completed a four-page pre-test. Students took the same post-test on the last day of class. A comparison of scores per student indicates the statistical gain in comprehension and application of material covered in the 10 class periods. A survey of the parent and teacher evaluations indicates that RT teachers were successful in reaching those twin goals through the delivery of the curriculum and interaction with the students. The staff also believes that, although significant gains have been made over this short time period, equivalent positive results may continue to be replicated over a longer time if the program is allowed to continue. Two of the most significant observations in evaluating this program are the comments from parents who saw remarkable changes in their children and the observations by the school staff and administration. Evaluations will be classified by section and will contain complete comments. They will include comments that are not complimentary to the program, although most comments were positive. Section I- Students' Evaluations of Released Time Released Time classes began with ten students and grew to thirty over the course of the
program. Twenty-eight students received certificates and completed the post-test on the
last class day. One student moved away during the term and one student dropped out of the
program. Twenty-two of these students took the pre-test when they entered the program.
Seventeen students fit the profile for the pre-test and post-test evaluation. 1. Students were asked to rate the quality of instruction received in RT class as:
"outstanding," "good," "fair," or "poor."
Twenty-seven (27) rated the instruction as "outstanding" and one (1) rated the
instruction as "good." 6. The final question asked students to tell what "value" each has received
from RT. Their answers include the following: That concludes the student evaluations. All 28 students completed the form and did not sign their names. An additional question asked what could be done to improve the class. Of those who answered the question, most said "nothing." Some said, "having the class more often," and a few said: "more lessons," "more activities," or "more videos." Some said it is "perfect." The RT staff and committee believe that these student comments and evaluations are bolstered by supporting comments supplied in the following reports. From a show of hands, it appeared that all 28 students want the RT program to continue after Christmas. Section II- Parents' Evaluations of Released Time Parental questions and comments regarding the RT pilot program centered around ways in
which their children were influenced by the effects of exposure to the program. Specific
questions probed opinions on the curriculum, any behavioral change in children, attitude
changes, and observable changes in schoolwork and attitudes about school, etc. To the question, "Did you notice any changes in your RT student's attitude at home," 60% of respondents observed a positive change in their child attributable to RT influence. The other 40% noticed "no change," with all but 2 of those indicating that attitude was not a problem prior to the class. When asked about changes in their child's behavior at home, 60% attributed a positive improvement to RT exposure. Again, 40% noted "no change" indicating that behavior at home was not a problem for that particular child. Respondents to these two questions were not identical subjects. In regard to schoolwork, 65% of parents noticed a positive change in their child as a result of having attended RT classes. Comments from parents in reference to the above questions are as follows: The next question asked parents how the RT program has been a positive influence for
change in their child. The comments were:
Another question asked parents to "describe your overall satisfaction with
RT." One question asked parents what they would like to say directly to the School Board
regarding RT. Here are their comments: The parents' evaluation questions concluded by asking how RT could be improved. These
answers were given by parents: The RT committee is rather overwhelmed by the extent of positive response from parents and their effusive compliments for the program. Looking back, we recall that the school board selected this particular community and this school for the pilot program. Parents who were skeptical in the beginning about what RT might be have become the greatest cheerleaders for the program. As noted by parental comments, every parent expressed a desire for the program to continue, and many shared their wish that the number of RT classes be increased per week. It is the view of RT staff and committee that these parents who have seen such positive changes in their children as a result of RT will also encourage other parents to permit their children to attend RT classes. The parents' comments indicate that, from their perspective, this RT pilot program has been a resounding success. Section III- Lynn View Principal's Evaluation of Released Time Mr. Dennis Houser, the principal of Lynn View Middle School, has cooperated with the RT committee and staff throughout the pilot program. His comments indicate he has seen positive results from the program and would be supportive of its continuation at Lynn View and possible expansion to include the other grades. The school principal indicated in his evaluation that the logistics of moving students from and to the campus are working well, and the adaptation to this program has progressed well. The principal indicated on his report that he observed positive changes in the behavior of RT students; and a "noticeable" improvement in three students. He also stated that he has received positive comments from parents about the RT program. The only suggestion for improving the school's relationship with the RT program was the possibility of scheduling RT "students out of PE and study hall rather than chorus/ music." It was noted that the RT teachers worked well with the school, and the comment was repeated that "there seems to be significant improvement in three of our students" who attended RT classes. Section IV- Lynn View Teachers' Evaluation of Released Time Teachers of eighth grade students at Lynn View were generally very complimentary of the RT program and schedule. Questions regarding orderly movement of students to and from RT class were mostly answered with "good," "outstanding," or "don't know." A question asking teachers what changes they observed in RT students' behavior garnered
the following remarks: On a question asking if RT students' class work, homework, or grades were affected by their participation in RT, the majority of teachers indicated "no change." Two teachers noted a positive change; one indicated both positive and negative effects; and the choir teacher noted a negative effect due to affected attendance. One teacher indicated that she had received parental comments; the comments indicated parents were pleased with the program. The final question to teachers asked them to list any positive influences on the school
that may be attributed to Released Time. Those comments follow: This concludes the teacher evaluation comment section. The RT staff and committee believe that these comments indicate a wide acceptance of the RT program by teachers at Lynn View Middle School. Some teachers have been very pleased with the results they have seen in their students and a few are still reserved or less forthcoming in their analysis. But overall, teachers indicate a very positive impact from the program. Section V- Host Church Pastor's Evaluation of Released Time The pastor of the host church is James Hoilman. Lynn Garden Presbyterian Church is located directly across the street from Lynn View Middle School. RT classes were held in the fellowship hall of the church, although other parts of the church facilities were used occasionally. Although the pastor is not a RT staff member, he was present at many of the classes as an observer. His comments are very complimentary to the RT staff and their delivery of the program with minimal inconvenience to other church activities. He was impressed with the skill and preparation of RT staff and the "truly nondenominational approach in teaching….based on the Judeo-Christian ethic." One of his initial concerns was that discipline might be a potential problem, but he comments that "I was pleasantly surprised at how well behaved the students were during their trek to the church and during class time. There was no real issue with behavior." The pastor mentions that another unknown in the beginning was housekeeping problems associated with a 'snack time' in the middle of RT class. This fear also proved to be unfounded as "this time went very smoothly as well." His final comments conclude: He closes by saying… Jim Hoilman Section VI- Comments by Observers of Released Time Class During the course of this pilot program, members of the media and other interested individuals were invited to observe RT classes. Four individuals who observed RT classes share their impressions. 1. Dr. Tommy Holtzclaw, a former college professor, shares his comments from that perspective in saying, "The quality of teaching the resource materials was very impressive. The students seemed to be alert, excited, and active. Their spontaneous participation showed a real interest on their part. They were well-behaved and seemed anxious to learn. As a former professor, I was just delighted." Dr. Holtzclaw also stopped by the office at Lynn View and "was told that the 2. Jim Wells, a well-known and respected Kingsport businessman shared his thoughts and observations of released time. "One of the most challenging occupations I can think of is being an eighth grade teacher. I know this, because I once taught the 7th, 8th, and 9th grades at John Sevier Jr. High School. RT skillfully expanded the "Character Counts!" program now being taught in our school system. Wouldn't it be wonderful if parents would take upon themselves to teach character and biblical practices to their children, but since some don't, I am grateful for the RT program that is available for reinforcing the morals, values, and principles necessary to become a worthwhile citizen of our community." Mr. Wells goes on to say: "It would be wrong to deny someone the opportunity of being involved in the RT. The bottom line-it is good for the students, for the parents, and for the Lynn Garden community." 3. Paul Bentley is an Eastman retiree who served as a mentor and class aid in the RT time pilot program. Mr. Bentley is a very active volunteer in community and church- related activities. He attended most every RT class and observed the marked progress made by each student and their eagerness to learn more. He comments: "Not only did they learn the Lord's Prayer and the Ten Commandments but received a sense of direction and purpose for their lives. During the course of this pilot program, we witnessed a growth of increased interest in these young people about the things of God. They have learned the options to make the right choices according to God's Word. How many have been saved from a life of destruction no one can tell, but they know the choice is theirs." 4. State Representative Steve Godsey noted from his visit that the students were well mannered. He was also complimentary of the memorization skills and work emphasized by the staff. His letter mentioned that RT is "in demand not only in Sullivan County but surrounding counties as well." He goes on to say "I support this program because I feel it will have a beneficial effect on both the school and student." Media Reports on Released Time This RT pilot program received quite a bit of coverage in the media from the early stages and throughout the twelve-week series. A reporter and videographer from an area television station did several telephone interviews and came to see the classroom facilities and interview RT staff. After this interview, the reporter asked for an invitation to return later in the series to observe class and interview students. As a result, representatives of area print and television media were invited to a RT class later in the series. Media coverage seemed fair and balanced. Staff and students were interviewed and other folks present were asked to share their observations of the program. One television station conducted a call-in poll for viewers to vote their approval or disapproval of the RT program. The results indicated a 95% approval rating by viewers. While the RT committee would not suggest that school board members be influenced by media coverage in making their decision regarding Released Time, this information is simply included as anecdotal material to illustrate the response garnered from the community by the media. It should also be noted that the only negative responses to RT recorded in the media were from a couple of critics outside the city and county where the pilot program was held, and these were before the program began. Student Improvements as Evidenced by Pre- and Post-Test Released Time Christian Education began its first class with ten students and finished the 12-week pilot program on November 20th, 1997 with 28 students. A total of 30 students participated. One moved away during the program, and one dropped the class. The RT staff and committee find results of the post-test to be very encouraging and feel that this data fully supports the student, parental, and community desire for this program to continue. Specific data will refer to the 'base group' of students who attended 10 or more classes. The first and last classes consisted of taking the referenced tests, which left approximately 10 classes for teaching of the curriculum. It should be noted that the pre-test and the post-test were the same test. The test was designed to measure student progress over the course of the class series; using both empirical data based on real life situations and an accumulation of factual material based on gained knowledge. Of those students included in the evaluation process, the 17 students showed an average, overall gain from pre-test to post-test of 86% (including resource students). Like TCAP's, some of the material from the test was not actually covered in class, although it was scored. The four highest gains in test score comparisons are: 229%, 193%, 170%, and 141%. Higher gains were generally made by those students who did not score as well on the pre-test. Reports from RT staff indicate that many of the students who show significant gains in test comparison also exhibited improved behavior, class participation, and application of material in a progressive manner. Improved social interaction between students, respect for others and their property, and attitudes toward adults and those in authority were observed by RT staff members. While only so much can be made of grades, scores, gains, and testing in the process of learning, especially in a subject that is heavily 'values based,' it is relevant that our society still places a high value on this kind of information. And while the committee and staff of Released Time do not feel that the program rises or falls on the basis of this kind of statistical evaluation, it is still a significant part, to some degree, of the evaluation process both for the committee and for the school board. The pre-test and post-test results present valuable information to the RT staff as to
how effectively various parts of the curriculum were delivered. These results have
provided a wealth of information that can be used to assist individual students in future
programs, if permitted. From the point of view of the RT committee, these tests along with
staff observation of and interaction with students has been a successful way to measure
gains and progress in this program. We, therefore, submit it for your examination. The
following page details that information. As two adult observers of Released Time and the host pastor wrote, "this experience has been beneficial to the students, the parents, the school, and the community." Many parents indicated that this pilot program exceeded their expectations. While some parents were at first skeptical, they have now become the most outspoken proponents of Released Time. Naturally, in a situation where religion is the topic, folks have very diverse and personal views about how issues should be addressed. Because of that, some parents did not initially permit their children to attend RT classes. It was too much of an unknown quantity. And certainly teachers, parents, students, and the general public did not really know what to expect. But after completion of this pilot program, several parents are begging for these classes to be held at least twice as often as in the pilot. The reasons for these requests are the significant improvement that parents have observed in their children's behavior, attitude and respect. It seems that many of these students have developed a whole new attitude toward life, school and their futures. Students were faithful in attendance. Many students did not attend in the beginning,
but once coming were faithful to continue. Students eagerly volunteered for reading
assignments and special class participation. Several also took on extra reading
assignments at home. Many enjoyed the take-home activities with their families. Discipline and respect for others were not problems in this program. Talkative students were reassigned seats when necessary. The class took instruction well and some required more individual attention. Movement of students to and from RT class was timely and orderly. The RT committee wants to thank the school board for allowing this pilot program so that the community could see what Released Time is really all about. We want to thank parents for allowing their children to attend these classes, even though they did not know what to expect. We want to thank the churches and community leaders of Lynn Garden for rallying behind the committee with varied kinds of support. We believe these evaluation reports speak volumes toward the continuation of Released Time. The students are thrilled with the classes and have obviously been affected in a positive way. Parents are effusive in their compliments of the program, staff, curriculum, and benefits of Released Time." Most teachers are very pleased with the program although some still have a guarded opinion or have had limited exposure to the program and its benefits. The school has benefited from the RT program in several ways. Teachers and parents have noticed improvement in academics, behavior and attitude. There has also been increased community involvement in school programs and projects by the church community. From the connection of RT staff involvement with the school, 144 needy families were assisted at Thanksgiving and much the same will be repeated in the Christmas season. Food, clothing, heating fuel, and basic household needs have been provided by members of the community for one another. The initiation of this pilot program has helped to set into motion a chain of events that will have significant results hopefully for years to come.
BETTER KIDS MAKE BETTER SCHOOLS! |
