For some people it's a deal breaker, so I can see where you're coming from.
However, look at it like this. I travel internationally once every 1-2 months. Being in Japan at an international airport, withdraw about 500k-750k yen, buy car parts while there since JDM parts are unreal cheap overthere, send them back home, do my business, make all of it back and more on commissions, go home a happy man and continue to work.
Of course that's just my personal taste for it, but you could change the variables to anything, plus you're travelling, it's great.
Be a stockbroker, their hours aren't as bad and they make some solid cash as well.