If it were up to me, the magical remnants would be implemented, but they’d be so small that the side-effects would normally be barely noticeable and wear off in a day or two at most, (in blog time) unless one character drank a lot of Rarity’s milk in a short period of time. So more or less what you're thinking of doing with it if you end up implementing it.