We present a new general approach to modeling research problems as Atari-like videogames to make them amenable to recent groundbreaking solution methods from the deep reinforcement learning community. The approach is flexible and applicable to a wide range of problems. We demonstrate its application on a well known vehicle routing problem. Our results suggest that Atari-fication may be a useful modeling approach for researchers studying problems involving sequential decision making under uncertainty.