Comparing LSAT Preparation Methods: What the Data Say
From time to time, the Law School Admission Council, the company that writes and administers the LSAT, gathers data and publishes reports on many different LSAT-related matters. One such matter is the different methods of preparation LSAT takers use.
In this week's post, we'll dive into and analyze data from the most recent LSAC report on test-takers' self-reported methods of test preparation, which covers the 2011-12 thru 2013-14 academic years. We'll walk through the relevant data, focusing on the following methods of preparation: official LSAC materials, non-LSAC books, commercial test preparation services, self-study and no preparation.
The study also provided data on those who used sample questions available on LSAC's website, the June 2007 exam, undergraduate institution test-preparation courses and other preparation methods.
Among the methods we'll focus on, self-study was the most popular, with 54 percent of respondents reporting using that method. Forty-four percent of respondents reported using non-LSAC books, 37 percent reported using official LSAC materials and 32 percent reported using commercial test preparation services. Only 2 percent of respondents reported not preparing at all.
These percentages add up to more than 100 percent -- because many respondents used more than one method of preparation. This will play a role in our analysis later.
[Know the best ways to prepare for the LSAT.]
In evaluating the first five methods, we'll focus on two key data points: the average LSAT score for each method and the difference in LSAT score between those who used and didn't use each method. We'll then draw some conclusions regarding the effectiveness of different preparation methods based on the data.
What the Data Show
The data indicate that students who reported using official LSAC materials, non-LSAC books and commercial test preparation services experienced similar and significant increases in LSAT scores compared with those who did not. For each method used over the three years, LSAT test-takers scored just above 152 on average and experienced an average increase of 2.1 points compared with those who reported not using the method in question. Clearly these methods are effective in increasing one's LSAT score.
Significantly less effective was self-study. Those who reported preparing on their own averaged a score of 151.3, an increase of just under one point compared with those who reported that they didn't self-study.
LSAT takers who reported that they did not prepare at all unsurprisingly experienced much worse results than those who prepared -- they scored an average of 147.9 over the three years, an average decrease of 3.1 points compared with those who reported preparing in some manner.
[Create a four-month study plan for LSAT success.]
What the Data Doesn't Show
A significant missing component of this data is that theys do n't show results for test-takers who used varying combinations of preparation methods. For example, almost all commercial test preparation companies encourage students to use official LSAC materials, often published tests, in their preparation. Similarly, those who self-study almost always use official LSAC materials or non-LSAC books to prepare.
The reality is that almost all of those who prepare for the LSAT use a combination of the methods that the study enumerates. Additional data from the study bears this out: Approximately 40 percent of respondents reported using two or three different methods of test preparation.
[Erase three top LSAT preparation myths.]
What We Can Learn From the Data
Not surprisingly, the data confirm that preparing for the LSAT is a good idea -- those who didn't prepare scored significantly worse than those who did.
But it's not just whether you prepare -- it's also how you prepare. Of the nine methods the study examined, four created worse results for the respondents. Those were using the LSAC website's sample questions, undergraduate institution test-preparation courses, other preparation methods and no preparation at all. All the other prep methods, when used, produced better results than when they weren't used.
This data is also consistent with our general advice: Prepare a lot, take numerous real practice tests and engage a tutor or preparation course to make sure you have learned all the techniques necessary to achieve your best score.
