Vinegar works well to remove tempera paint, or the type of paint you use when you decorate your windows for Halloween or Christmas. It takes it off almost immediately. Sponge vinegar over the paint, then wipe off, removing residual paint with paper towels.