Among the dead are two children, a 4-month-old baby and a 7-year-old.
The twister hit the Town of Smithfield at about 7:15 p.m., about an hour and a half away from Greater Binghamton and east of Syracuse.
A representative from the National Weather Service said wind speeds were over 100 mph and the tornado will be categorized as an EF-2, possibly higher.
More than 60 first responders were involved at the scene and search dogs were brought in to help.
A press conference was held this morning where the Sheriff of Madison County and Governor Andrew Cuomo spoke.
"The winds were so high there that one of the homes was literally lifted off its foundation and carried 150 yards and came down on another home down there. Luckily that home was not occupied," said Sheriff Allen Riley.
NYS Governor Andrew Cuomo says, "The property damage we can repair and anything the state can do to be in partnership with the county and families that have been damaged, we'll work with them to rebuild, repair the property damage. Unfortunately, there is damage that has been done that no one can repair and no one can replace," said NYS Governor Andrew Cuomo.
Five homes were destroyed by the tornado.
Photos: Aftermath of deadly storm
Copyright 2016 Nexstar Broadcasting, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.