Page 1 of 3

What would you ask a former LSAT testmaker?

Posted: Wed Aug 17, 2011 3:40 pm
by LSAT Blog
I'll soon be interviewing a former writer of actual LSAT questions. Given this unique opportunity, I figured that starting a thread to solicit your questions would be fitting.

What question(s) would you pose to a writer of LSAT questions? What would you want to know? Please share honest (and serious) questions.

Re: What would you ask a former LSAT testmaker?

Posted: Wed Aug 17, 2011 4:04 pm
by pichu
Oh, I have a ton of questions!!!

Are they deliberately making the LSAT more difficult over time?

On how many tests do they preview questions via the experimental section before using the questions on an actual test?

Are experimental sections identical to future test sections? Or, do they take questions from multiple experimental sections and compile them into a credited test section?

Why do they not release the February LSAT?

How many people do they have proofread the questions to ensure the questions are OK?

What is the process like for getting a question removed from scoring?

Re: What would you ask a former LSAT testmaker?

Posted: Wed Aug 17, 2011 4:10 pm
by glucose101
pichu wrote:Oh, I have a ton of questions!!!

Are they deliberately making the LSAT more difficult over time?

On how many tests do they preview questions via the experimental section before using the questions on an actual test?

Are experimental sections identical to future test sections? Or, do they take questions from multiple experimental sections and compile them into a credited test section?

Why do they not release the February LSAT?

How many people do they have proofread the questions to ensure the questions are OK?

What is the process like for getting a question removed from scoring?
+1, awesome questions!

Re: What would you ask a former LSAT testmaker?

Posted: Wed Aug 17, 2011 6:54 pm
by tmon
Do they believe it to be a test of innate skill or something people can learn to master?

How would they study for the test if they weren't so experienced with it? (pending answer to the previous question, I guess)

Do they think certain groups of people are at a greater disadvantage preparing for/taking the test than others, particularly those of lower socioeconomic status?

Do they see the test moving in any particular direction currently or in the future?

Re: What would you ask a former LSAT testmaker?

Posted: Wed Aug 17, 2011 9:28 pm
by clouds101
This is very interesting. Thank you for taking requests :)

@ pichu, thanks for submitting those excellent questions.

Here's mine:

-why was the comparative section introduced and is it reasonable to expect new forms of reading passage & LR question types?

-why haven't test makers recreated rare game types more often? should students prepare for them (aka prepare for the worst)?

-misc: why do test makers like dinosaurs and extinction theories so much?

Re: What would you ask a former LSAT testmaker?

Posted: Wed Aug 17, 2011 9:47 pm
by glucose101
I hate reptiles and planets

Re: What would you ask a former LSAT testmaker?

Posted: Wed Aug 17, 2011 10:26 pm
by nothingtosee
Has the increase in the amount of "retakers" made any impact on test construction?

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 18, 2011 10:57 am
by Manhattan LSAT Noah
I'd like to hear the process of getting chosen to write questions for LSAC, finding source material, and of submitting questions. Also, what's the pay?

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 18, 2011 11:08 am
by bport hopeful
the answers?

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 18, 2011 11:35 am
by TrojanHopeful
Whose bright idea was it to make each section 35 minutes? Seriously, what is the process for deciding how much time to allow in each section for standardized testing?

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 18, 2011 4:08 pm
by LSAT Blog
Great questions, everyone! I just posted the interview. Be sure to check out #8.

@pichu You can read about the process by which items are removed from scoring in this post.

If your question wasn't answered, and it's something he'd be able to answer, not to worry. There will be another interview in which I hope to get answers to many more of your questions.

Please continue to share them.

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 18, 2011 4:29 pm
by soj
Wow, really interesting. Thanks, Steve.

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 18, 2011 4:49 pm
by gaud
soj wrote:Wow, really interesting. Thanks, Steve.
+1

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 18, 2011 7:52 pm
by clouds101
Steve, thanks for giving a shout-out to dinos and extinction theories in #4. :)

Re: What would you ask a former LSAT testmaker?

Posted: Fri Aug 19, 2011 8:50 pm
by Samara
Cool interview. Here's a couple things I want to know:

Why 101 questions instead of 100? That drives me crazy.

Are any of the Logical Reasoning passages based on actual scholarship? A lot of them seem like real arguments.

How are RC passages chosen?

Re: What would you ask a former LSAT testmaker?

Posted: Sat Aug 20, 2011 2:42 pm
by pichu
Thanks for doing the interview. It was really interesting.

Re: What would you ask a former LSAT testmaker?

Posted: Mon Aug 22, 2011 12:11 pm
by LSAT Blog
My pleasure, everyone. Glad you all enjoyed it.

Dr. Harris said that he's especially looking forward to answering tmon's questions. I look forward to seeing his answers.

Re: What would you ask a former LSAT testmaker?

Posted: Mon Aug 22, 2011 7:59 pm
by tmon
LSAT Blog wrote:My pleasure, everyone. Glad you all enjoyed it.

Dr. Harris said that he's especially looking forward to answering tmon's questions. I look forward to seeing his answers.
Excellent! Can't wait to read it.

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 25, 2011 3:08 pm
by LSAT Blog
Just posted the second interview and was lucky enough to get answers to many of your questions.

Please post any new questions that come to mind. If I collect enough additional ones, I'll likely do another interview.

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 25, 2011 3:09 pm
by gaud
YOU ARE AWESOME!!


thank you

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 25, 2011 3:28 pm
by Samara
My two non-facetious questions were used. Cool. Another great interview!

It made me think of another question:

Were you ever tasked to write questions of a certain difficulty level or did you just try to write the best questions you could?

Re: What would you ask a former LSAT testmaker?

Posted: Thu Aug 25, 2011 6:31 pm
by tmon
Thanks for the update, glad mine made it. Very interesting!

Re: What would you ask a former LSAT testmaker?

Posted: Sun Aug 28, 2011 2:11 am
by tedler
.

Re: What would you ask a former LSAT testmaker?

Posted: Sun Aug 28, 2011 3:23 am
by tyro
This is one of the most helpful/interesting threads on TLS that I have seen. Your dedication to helping future law students seems extraordinary. I've followed your blog/site for about two months now. So I apologize if this question has been answered already, but here is my question for the ex-psychometrician that you are coordinating with:

What elements constitute the development of the curve that is used for each individual LSAT exam?

Re: What would you ask a former LSAT testmaker?

Posted: Mon Aug 29, 2011 12:59 am
by suspicious android
Nice job. Definitely hope to see a part three sometime.