To use physical violence against someone or to push someone around with physical force. A noun or pronoun can be used between "rough" and "up." The mob boss sent around a couple of goons to rough up Thomas for not paying them protection money. I managed to get video footage of the police roughing the man up on the street before arresting him.