iamgeorgebush wrote:Capitol_Idea wrote:Vault rankings are literally, LITERALLY, entirely based on surveys received from associates at these firms (and associates can't rank their own firm, I believe). So no, some random Reed Smith associate who knows fuck-all about Wachtell isn't really qualified to remark on its quality in literally any capacity (work-life balance, strength of practices, etc.).
18,000 associates responded to the Vault surveys, ranking these other 99 firms on scales of 1-10. Even if we assume that every single associate has lateraled twice and in their time has worked extensively with 10 other firms (all of these assumptions are incredibly generous, by the way), that gives them experience at 12 firms, and only from their perspective of being a junior/midlevel associate in a particular office, in a particular practice area. That is ~200K dubiously qualified opinions out of 1.78 Million total.
So do tell me how this is meaningfully relevant to anyone
On the other hand, from a statistical perspective, a bigger sample size is better. Even if many of these associates get it wrong, you might think there is some strength in numbers.
That's not really how statistics work - larger sample size doesn't cure defects in the questionnaire or underlying population, nor does it change the purpose to which the results can meaningfully be used.
You are right in that the large sample size may imply an adequate representation of what it is measuring, but "
what it is measuring" is precisely the question. No one is disputing that it adequately tracks what large numbers of uninformed midlevel associates think about the general reputation and quality of other BigLaw firms, they are questioning the usefulness to which those results can be applied to other things like firm health/quality, desirability to work there, or prestige of the firm among clients, partners, or literally anyone else who isn't a midlevel (and it is completely useless for these things AND there are better alternatives).
If you are a short-term prestige whore whose primary and overriding desire for BigLaw employment is to make other people similarly situated jealous, then I guess go to the higher Vault-ranked firm.