skeetlee,
I also have a 541X that didn't seem to shoot very well either. Even after modifying it to make and inexpensive BR-50 style shooter. My reworked 513T outshot it without question. It's sat in the case for several years, along with all my other guns because I stopped shooting due to our range closing and the expense of raising kids, etc.
Anyway, this year I decided to start shooting again and have also sent my rifle to Brian Voelker. I've been shooting the 541 this summer and up until recently I was kind of on the fence regarding how much the accuracy had improved after Mr. Voelker did the work. I'd shot some old Tenex, Match Xtra, the old Fed Ultra Match, RWS makes, and some of the new brands made by Lapua and it's shot ok. I've been steadily improving my scores on the USBR target the last couple of months and had shot as high as 229 3X at 50yds. However, Tuesday I shot a 236 (Lapua Midas +) a 238 3X (Eley Match) and a 247 7x (Eley Match). The 247 might be a bit of a gift but I'll take it.
So, considering that it's never going to be a 40X, I think these rifles can be made to shoot pretty decent if your willing spend the additional money and time to tweak it and feed it properly. Otherwise they're just average bolt action .22's