rv11 wrote:GentlemanJim wrote:Seems a bit unambitious if you ask me, and pretty believable.
If they can get scores out in two days, it makes me wonder why it takes them a month for a regular administration. Yes, all they have to do in this case is run it through a machine to score it, but proportionally it seems a little long for a regular test when you compare the two. Regardless, I'm taking it on the 27th and would be very pleased with a two day turnaround.
For a new administration (a new test) they will have to
1. perform statistical analysis: They have to compare the expected difficulty of each individual question against the actual performance of each question by all test takers and identify potential problems. If the expected difficulty is 75% (3 out 4 get right, based on previous experimental performances) but the actual diffulty is 10% or more interesting, 99%, the they have to see why the discrepency occured. Because if actual difficulty end up drastically different than expected diffculty, they may have to a. check and potentially remove the question from scoring (happened before) or b. adjust the conversion scale.
2. They must see if any dispute arise. If they do, they have to address and adjudicate before the test result can be certified.
I don't claim to know the inner working of LSAT, but I was involved in development of some standarized testing software with ETS, and there is a lot of data crunching. With over 20k people taking the test it will take a week or more to analyze the result and then certify it.
With a previously administered test, the work has been done, and they have already certified the test (and released results). They do not have to analyze the test. They will just score the sheets then convert the score and release it. There will also be no disputes. They will not be able to change anything because how would that impact the people who already took the test and got their score?
It may be a blessing in disguise. If they gave us a previously administered nondisclosed test, maybe it would be mroe like the pretests in the early to mid 2000's. I do better on those before they changed the format in the last 2 years. I think test got a little harder.