Wisconsin Gov. Scott Walker refused Wednesday to back down from his plan to take away nearly all collective bargaining rights from most public workers and force them to pay more for benefits, despite news that the state?s budget is in better shape than previously expected.