If you switch from a theme with two sidebars to one sidebar any widgets you had assigned to sidebar two in the old theme continue to listed as 'used' in the widget manager of the new theme. The only workaround seems to be to switch back to the old theme, delete all the widgets from the sidebar, and then switch back. I'm using 2.5-RC2.