With the current ETH price, a transaction can cost 0.60$ easy, that's not nothing when you are sending few tokens or sending to a lot of people.
The best way to lower the gas price, in simple transaction try 3-4 Gwei. If it fails to send you will not lose a thing, then go up till transaction succeeds.
admin edit: you can try even with 1-2 Gwei