I could see cutting spending AND increasing taxes. Realistically, that is probably the best way to do it (just a little of each) because otherwise there's going to be mob violence.
Personally, I'd completely gut the military and that would reduce our overall budget by at least 10%, but I know that wouldn't be popular.