From what I have heard, it takes about 5 days to get milk totally out of
your system.  Not just the digestive system, but the whole system.
I'd say, give it a week to get cleared right out.