The bullpen preserved the win, Milwaukee's fourth straight victory since the team was no-hit by the Tigers.
Bill Hall hit an R-B-I double, and Corey Hart broke the game open with a two-run single.
Francisco Cordero got three outs for his major league-leading 25th save in 27 chances.
For the Twins, Boof Bonser threw 6-plus innings but took the defeat with five hits, four runs and two walks. He struck out seven.
Bush struck out four and allowed a pair of two-out walks. He was charged with two runs and gave up five hits.
With the win he improves to 4-and-6.