Depends how you will load in future.
I prep necks with a Lee collet die for most calibres I load & they end up with different (probably less) neck tension than standard sizing dies. Because of that, I open out necks on virgin brass with slightly oversize expanders I have had made, then size the necks down again with the Lee die.
I do chamfer my necks & some virgin brass I've seen (not the stuff I use) has some pretty out of round necks. I guess if you were going to chamfer them before your first loading, you might need to uniform the necks in some way first.
Finally, I guess it depends on how much you trust the manufacturer to produce a uniform product that will allow you to load for the best result in your rifles. If you can eyeball or measure irregularities, then maybe your peace of mind will force you to smooth them out.
John