If you are vegetarian, because you love animals, then eggs and milk is OK I think, theoretically. It doesn't hurt the animal, if you eat one or two of their eggs or some milk, theoretically... But if you think of mass production, it isn't OK.
I persoinally try to keep clear of eggs and milk too. But it's so difficult sometimes.