Musar על סנהדרין 116:30

ויאמר לרשע. Even raising one's hand without actually striking makes one a wicked person.

He who smites his companion and causes him pain, whether it be in money matters or through fraudulent words, there is no atonement for him unless he can appease his companion. And the Day of Atonement atones only for sins that are between man and God. But as for sins between him and his fellow man, he must first appease him (Yoma 85b). He who lifts his hand against his companion, even though he did not smite him, is called a wicked man (Sanh. 58b), and he must ask forgiveness of him: only thus can he do atonement.