Question regarding backing

[scifisentai]

I've just finished stitching a small piece onto a sweater and I'm in two minds as to whether or not I should put interfacing on the back of it, inside the sweater. It would protect the back of the stitching, I'm just concerned about what would happen to the interfacing the next time it goes in the wash. Anyone here stitched onto clothes before and have some suggestions?