NFA Long Term Evaluation Report - Fiscal Year 2006

Results are based on:
342 student responses with a response rate of 64.2% and 390 supervisor responses with a response rate of 73.2%.

Four months after training, the extent to which students and supervisors agree that:
Course has improved student job performance:
Students = 96%
Supervisors = 82%.

Course has contributed to student's professional development:
Students = 95%
Supervisors = 92%.

Course has improved performance of the department:
Students = 80%
Supervisors = 78%.

Course helped department address problems in high-risk areas:
Students = 50%
Supervisors = 51%.

Course led to a reduction in fire-related risks with the community:
Students = 40%
Supervisors = 35%.

Would recommend this course to others in the department:
Students = 96%
Supervisors = 96%.

Student has also attended other fire service training in last 3 years:
84% answered yes
16% answered no.

Location of other fire service training:
At a facility in my state = 72.9%
At a regional facility, not in my state = 19.8%
Other = 13.1%.

Note: Percentages may total more than 100%, since respondents are asked to mark all that apply.

Assessment of NFA versus other curriculum materials:
NFA more useful = 53.4%
Other course more useful = 1.4%
Both equally useful = 45.2%.

Percent of students who:
Have applied training on job = 95.7%
Shared training information with colleagues = 95.9%.

Means of sharing training information:
Formally in a training class = 23.6%
Informally, in a group = 51.4%
Informally, one on one = 68.6%.

Note: Percentages total more than 100%, since respondents are asked to mark all that apply.

Student's highest level of education:
High school or less = 3.8%
Some college = 26.9%
AA degree = 23.7%
Bachelors degree = 33.6%
Graduate degree = 11.7%.

Size of department:
50 members or less = 38.3%
51-200 members = 35.4%
201-1000 = 17.0%
1001 members or more = 9.4%.

Student suggestions for improving NFA course, based on 247 comments:
No change needed = 25.5%
More hand-on/practical exercises/scenarios = 5.7%
Update/modify course materials = 4.9%
Shorten class/condense material = 4.9%
Suggestion for class/final project = 4.9%
Lengthen class = 3.6%
Pre-course materials needed/pre-course prep = 2.0%
Offer class more frequently or as field course = 2.0%
Terrorism/WMD/Homeland Security = 1.2%
Grants/budget issues = 1.2%.

Student suggestions for future NFA courses, based on 300 comments:
Grants/budget issues = 10.3%
Terrorism/WMD/Homeland Security = 7.7%
Integrating/coordinating emergency services = 7.3%
Fire fighter safety/health = 6.7%
HR Issues/recruitment/retention = 6.7%
Leadership/management skills = 4.0%
Technology = 4.0%
Diversity Issues = 3.7%
New building materals/construction = 2.3%
Prevention = 2.0%.


Supervisor suggestions for future NFA courses, based on 239 comments:
HR Issues/recruitment/retention = 10.5%
Terrorism/WMD/Homeland Security = 8.8%
Integrating/coordinating emergency services = 7.9%
Grants/budget issues = 6.3%
Fire fighter safety/health = 3.8%
Technology = 2.9%
Volunteer versus career issues = 2.5%
Prvention = 2.5%
Public education = 2.5%
Diveristy issues = 2.1%.

Note: Only the top 10 suggestion categories are reported, so percentages may not add to 100%