I'd say its better if you eat when he's not around. Although I don't think it is insulting, it might just make you feel awkward as well as him. Better to avoid that situation in the first place if you ask me. I would just go sit in my car as my parking lot is much more secluded than my office.