I did a very rough experiment some time back.
In the old days of film photography, when we read lens tests, it was pretty common to find that the maximum image quality did not coincide with the maximum aperture. It was usually a couple of stops down (half the diameter of the maximum aperture)
Along those lines, I cut a rough hole in a piece of tablet backing and went down the firing line one day (not at a benchrest match) asking if I could do a little experiment that involved target image sharpness. Of course in every case the image got a lot darker when I put my crude "stop" in front of the objective, but differences in image sharpness could still be seen. I tried it on rifle and spotting scopes. The whole process was brief and crude. A lot of the scopes' images were sharpened when stopped down, but not all. I tested my own 36X B&L last, and although the image was a lot darker, it was no sharper. I think that this illustrates that for rifle scopes, on a bright day, that sharpness may not be limited by objective diameter as much as quality of lenses, design, and quality of constructon. Of course not all of the scopes had adjustable objectives, so some of what we saw may have been the result of increases in depth of field when stopped down, compensating for fixed objectives not being focused for the target distance, but this would not apply in all cases, or to the spotting scopes.