What is LSAC's process for removing questions post exam Forum

[AverageTutoring]

Hey guys. With all this talk of question removal I wanted to ask how this process actually worked. It cant be based off of test takers memory, because as you can see by the mile long threads, we all remember tidbits here or there but not enough to reconstruct the entire stimulus/answer selection in any great detail. But if it's not based off of test takers then what would cause LSAC to revist a question post-exam? I know that they use three levels of checks to ensure that questions are completely solid...so I'm not sure what causes them to question them after the fact? Perhaps, is it that a lot of test takers complain and then they revisit or....but I cant see this being the case becuase you would have a lot of test takers questioning almost every question!...Anybody know?

Thanks!

[nsideirish]

Kind of related..if a question is removed, does LSAC ever give a reason? Also, is there any way to view the question or is it vanished from the face of the earth?

[2014]

I recall there being some way to formally protest a question, but I have no idea how it works. I'm relatively sure that this happens every test, people panicking over certain questions. While there might have been a couple more on this test that were unique, or hadn't been seen in a while, I would bet it unlikely that any are removed from scoring. It doesn't happen that often.

[AverageTutoring]

I recall there being some way to formally protest a question, but I have no idea how it works. I'm relatively sure that this happens every test, people panicking over certain questions. While there might have been a couple more on this test that were unique, or hadn't been seen in a while, I would bet it unlikely that any are removed from scoring. It doesn't happen that often.

Of course not. Nor do I think any question deserves removal. Having said that, I refuse to believe they revist questions based on what test takers think post-exam. Because as you said, there will pretty much be a litany of test takers questioning every single question! Which would essentially mean they would have to revist the entire exam post-administration...which would make little sense because they've already spent a million dollars checking it 3 times.

But if this is the case I'm going to formally protest every question in RC in hopes of getting a free point LOL

[tazmolover]

PT 60 had a question removed from scoring. It was from LR or RC I don't recall which.

[WonkyPanda]

Robin, from TM, is notorious for challenging LSAC on some of their logic. I think its people like him that really get the ball moving.

[tazmolover]

Robin, from TM, is notorious for challenging LSAC on some of their logic. I think its people like him that really get the ball moving.

Does he take the LSAT every time it's administered? Wouldn't this go against the 2 year period policy?

If he doesn't take the LSAT then he can't challenge LSAC can he?

[WonkyPanda]

Ya, I dunno how exactly it works but I do know he takes it as often as he can. Can the question be disputed post-score release?


EDIT: Regardless, I am pretty confident that TM has a team designed for this so even if it isn't Robin taking it that they have people designed to gauge the questions and note irregularities.

[tazmolover]

Ya, I dunno how exactly it works but I do know he takes it as often as he can. Can the question be disputed post-score release?

Even if it was the scores were already distributed so I don't think LSAC would do anything.

[zworykin]

There's a formal process for disputing questions, you can look it up on the LSAC site.

After the June test this year, there was a huge uproar about a particular logic game. People with poor basic reading skills couldn't figure out what a basic term meant, and had a heck of a time with the game as a result. They sent letters, started a petition or some such, blah blah etc. The thread here had many pages in it.

In the end, a completely non-related question from another section was removed and the game was left intact. Go figure.

[tazmolover]

There's a formal process for disputing questions, you can look it up on the LSAC site.

After the June test this year, there was a huge uproar about a particular logic game. People with poor basic reading skills couldn't figure out what a basic term meant, and had a heck of a time with the game as a result. They sent letters, started a petition or some such, blah blah etc. The thread here had many pages in it.

In the end, a completely non-related question from another section was removed and the game was left intact. Go figure.

If they ever need to remove an entire LG from a test, they should remove the entire LG section...

[J. Galt]

I remember that game in June... field has so many meanings. I didn't hear anyone complain about the random question they tossed out either. I wish the LSAC was more transparent, so that we could have a better understanding of everything going into the test.

[kilgoretrout103]

I've heard that they analyze statistics. If too many high-scorers miss a question while too many low-scorers get it right, they consider it for removal.

[djjf39]

I've heard that they analyze statistics. If too many high-scorers miss a question while too many low-scorers get it right, they consider it for removal.

I think this is one of the ways they will evaluate a question for removal. I know a tutor who said they also look at the overall correct/wrong from all test-takers then compare that with the position of the question within the section. So, last June they yanked the 6th or 5th LR from one section, maybe because too many people missed it. Because the question appeared earlier in the LR the LSAC could have decided the question was too vague because of the lack of correct responses.

Who knows though, the LSAC is notoriously vague in detailing exactly how it makes decisions regarding specific items.

[AreJay711]

I think Car Thieves could get removed but maybe because I just didn't like it and probably got it wrong. The consensus correct answer didn't really affect RATES necessarily which is what the correct answer should do.

[etown989]

I've heard that they analyze statistics. If too many high-scorers miss a question while too many low-scorers get it right, they consider it for removal.

I think this is one of the ways they will evaluate a question for removal. I know a tutor who said they also look at the overall correct/wrong from all test-takers then compare that with the position of the question within the section. So, last June they yanked the 6th or 5th LR from one section, maybe because too many people missed it. Because the question appeared earlier in the LR the LSAC could have decided the question was too vague because of the lack of correct responses.

Who knows though, the LSAC is notoriously vague in detailing exactly how it makes decisions regarding specific items.

it was question 19 I believe

[IBThatGuy]

There's a formal process for disputing questions, you can look it up on the LSAC site.

NM