Menus > Layers menu > 
Layers > Undo assign
 
 
 

Undo assign moves the last assigned objects back to their previous layer.