I'll defer to Stig, but SLS is great (and getting even better) at clerkships, which are obviously the first step to getting near a career in the judiciary. If you really think you'd be happier at Stanford, I don't think you should second-guess yourself as far as "notoriety" goes. After all, Yale is best for clerkships/academia, despite Harvard's lay prestige. The playmakers in the judiciary know that S and H are peer schools and that students have plenty of good reasons to go to either.
Interestingly enough, this is the sentiment I think mirrors my own thinking. Granted I've heard more of the Stig, Geneva train of thought, but I looked at YHS's placements of clerkships into feeder judges/Bristow Fellows and they seem to be very similar. With that being said...it kind of seems like I have my mind made up but I really do appreciate the insight. I love hearing other people's thinking on my first world problems.