The problem with a hand signal is that everyone, including perpetrators, would know what it was, although I suppose for some it might be easier to use than saying "I need help."

In most cases there is no downside to asking someone if they are OK. But you're right, we have to work on this together in order to improve it.