Published: Feb 11, 2014 7:51 PM EST

LEE COUNTY, Fla.- The Lee County school board voted unanimously to fire a Riverdale High School teacher, accused of cursing at students and making other derogatory comments toward them.

Brian Marsaglia, a special education teacher, was notified about the allegations against him in November. By December, he was suspended without pay and facing termination.

A school district investigation showed Marsaglia called students 'dumb' and used other slurs toward them. He taught in the district for three years.

We spoke to the former teacher by phone. He tells WINK News it is a sad situation and he was surprised to lose his job. He says he didn't make those comments toward students, and if someone heard something, it must have been taken out of context. He has since moved out of state.