Well... it's consistent - I can delete the category, change a page hierarchy and I have this annoying category named '1'. I can't seem to find an trac existing ticket (so maybe no one else has noticed?).