I broke what?

[Tamyosho]

I removed the rubber conver myself, it was the actual moving part of the switch that was loose. Replaced with a terminal connector in the mean time, it's hard to find these things.

 

[Jerry-Rigged]

I've broke a few switches over the years too. Radio Shack is my go-to for misc small parts like that. A switch with a button is hard to find, though.