The necks on new brass will rebound to some extent so you may have marginal clearance and not need to turn. On the other hand, you don't have much leeway given the best of circumstances. The safest thing to do would be to determine the actual neck diameter of your chamber and go from there. Any clearance is enough but a bit more than a little will keep you safe when you change bullets and forget to measure.
Soot up a dummy round with a candle, chamber the round, pull it out, and look at it. If the soot is mostly rubbed off or "scathed" all around then yes, you need to reduce the neck diameter of loaded rounds.