Since the inception of the SAT in 1926, the admission world has debated (1976, 2001, 2008, 2015, 2018, 2019) the impact of and validity of the SAT (and later the ACT, CLT, CCTST, etc) on the pool of applicants and enrolled students at a university. Recently, more and more colleges have been asking themselves should they diminish the role of testing in their admission process and declare a test optional admissions policy. This debate has heated up recently with the release of Measuring Success: Testing, Grades, and the Future of College Admissions and the announcement of the University of Chicago’s test optional policy causing many institutions to look inward at their use of test scores. Continue reading Why Aren’t More Colleges Test Optional?
As the new school year begins, I am anxiously awaiting (read: dreading) the forthcoming SAT and ACT annual reports and with them the inevitable exaggerations, hand-wringings, misinterpretations, and statistical paralogisms that will follow. The College Board’s Total Group Reports and ACT’s Condition of College and Career Readiness Reports (or Profile Reports) will not only spark the annual “sky-is-falling because district scores have dropped .005 points” responses but will also likely lead to an uptick in the “SAT/ACT scores show students not ready to succeed in college, career, life, liberty or the pursuit of happiness.”
This is a draft.. I never finished it.. but i’m tired of working on it so it goes up as is.
This past fall NYC DOE officially announced their participation in College Board’s SAT School Day program. This program had been quietly piloted in 40 schools in March of 2015, is being expanded to 90ish schools in spring of 2016, until it finally encompasses all of the approximately 496 NYC public high schools in 2017. Naturally, being the eduprenerd (educator + entrepreneur + nerd) and test prep wonk that I am, this rekindled my interest in the SAT School Day Program and sparked the following analysis of its implications, benefits, and drawbacks.
On Tuesday April 19th, I woke to find the following press release in my inbox.
Las Vegas, NV (April 18th, 2016) – ACT, (the other test maker) has decided to partner with Kaplan Test Prep to offer free standardized test prep, in a new effort to emphasize the ineffectuality of standardized tests. This new state of the art online testing program will be at least partially live (Take that KHAN ACADEMY with your pre-recorded doodles). Though it’s not entirely free to all students, Kaplan promises to provide lots of free test prep to low-income students to help dial down the reality that it is a for-profit company making bank on this new partnership. With this new program, Kaplan promises to utilize the same top-notch online portal used for classes at Kaplan University. (Ranked 137th Best Online College and ranked equally with the notable Oral Roberts University.)
This new program entitled: Kaplan Online Program Outreach for Underserved Tutorials (or simply KOPOUT) features lessons from seasoned Master Ninjas who no longer need silly things like textbooks to cover the material that isn’t showing up in high school this year.
“We know that helping kids help understand the help they need should not go unhelped,” says ACT COO, Kyle Ren. “After all, we think it’s beneficial to work with test prep companies, as they’ve made it their business to recognize the flaws we’ve created. It’s like, you know when like the Terminator came back and he was like, I’m not here to kill you like I’m here to help save your kid from the shiny new guy who wants to kill you. And he can like mold himself into anything at all, and that’s like, useful and stuff. So we’ve got the Terminator on our side. Or are we the Terminator? I don’t know. I guess one of us is the Terminator.”
KOPOUT also includes the following features:
- An online platform with prerecorded lessons over the backdrop of a 1980’s yearbook setting.
- Sciencey science for the Science section discussing the charts and graphs and other things ACT takes for college level Science.
- Real ACT questions which are totally different from the ones you’d find in the book they’re about to publish for more money.
- A social network of like-minded kids using the service as an excuse for learning instead of snap chatting nasty comments to their ex-girlfriend.
Over the last few days, I’ve been texted, tweeted, gchatted, emailed and called about the release of College Board’s/Khan Academy’s SAT prep resources. I’ve been forwarded article, after article, after article, about the playing field leveling that College Board is touting its partnership with Khan Academy will bring. I’ve been asked for my opinion and thoughts on Khan’s resources and the implications for my job and industry. So here it is, my unfiltered (mostly) thoughts on Khan Academy “Official SAT Practice.”
The partnering of Khan Academy and College Board is certainly a significant step for low income students. The key benefits of Khan’s SAT prep are:
- Greater opportunity and access for free – This relationship creates the opportunity for low income students to have reliable free practice, which until now has not been easily found. Students, parents, teachers, and counselors now know immediately where they can send a student to find practice tools for the SAT.
- High quality practice questions – Khan’s practice questions will be high quality because their relationship with the College Board will give KA a resource to verify that accuracy and appropriateness of their questions. Prior to this relationship the validity of free online SAT practice materials was questionable at best. (I’ve seen some terrible practice SAT materials both in stores and online, in fact most of the free SAT resources online are terrible.)
- Ease of use and access – Setting up and using KA’s site is relatively painless and in this day and age most students have probably already accessed it at some point. This means by adding SAT practice tools, they are simply improving an already useful tool. This is great for students.
- Integration with College Board results - In the fall there are plans to integrate further with College Board test results. PSAT and SAT test-takers will be able to add their test results to their KA accounts and get analysis and feedback. This again is great since it allows a one-stop shopping for information and analysis.
- Boys and Girls Clubs of America - The most interesting and least clear part of the College Board’s venture into test prep is the partnership not with Khan Academy but with the Boys and Girls Club. Reports are spotty but have indicated everything from College Board providing support setting up computer labs to College Board putting tutors in the Boys and Girls Clubs to provide actual teaching. If there is large scale free instruction supported by the College Board that will be truly interesting and helpful for low income students.
- Ongoing improvement - It seems that KA has an active team of professionals working to improve the product. This is amazing and bodes well because I’m anticipating that the College Board hasn’t yet finished tinkering with the SAT (and won’t finish until May 2016).
So while clearly there are great potential benefits to the advent of KA’s SAT tools, it’s also important to be aware of the limitations. Most of the articles I’ve seen about KA have ignored completely or paid scant attention to the potential problems with KA. These articles are touting Khan as the grand equalizer of economically and racially aligned score discrepancies on the SAT. It’s not. Khan is a tool. It’s a nice, well-designed free tool. And like any tool it will only be as good as those using it. I don’t object to the existence of KA SAT tools (in fact I’m excited by them), my concern is about the impact of touting it as a solution to inequalities. Let’s explore some of the key limitations with KA:
- Access is not effectiveness – Khan provides OPPORTUNITY to practice. It’s ACCESS to materials. But just because you are provided access and opportunity that does not mean it will be used and if it’s not used then no matter how good it is there will be no effect or leveling of the playing field. One of my concerns about Khan’s effectiveness is about access (since there are lots of studies saying low income students do not have the same internet access or solely access the web via mobile).
- Access is not engagement- Another of my concerns is engagement. Logging on to KA periodically when you have a sticky math problem in homework is very different from the consistent practice generally necessary to improve SAT scores. Will students be engaged enough to use the site? Historically, College Board’s prep tools have only been mildly used (I’ve been told by districts that usage of College Board’s SAT Online Course which comes free with most SAT School Day contracts is less than 10% as is use of the My College Quickstart site that is included for every PSAT test taker). Are these videos enough to keep student engaged?
- Free access is free for everyone – No matter how great Khan is at providing resources for low income students, high income students will also be able to access those resources to supplement their high priced tutoring programs. Any claims that this tool will minimize the score differentials overlooks that KA tools are available to all regardless of how much the family makes.
- Academic preparation is not test preparation - There is a big difference between academic learning and preparing specifically for a test. College Board and Khan provide more of the academic learning (they’ve actually said so). They are focused on more academic approaches. Here is an interesting comparison by Stacey Howe-Lott of Stellar Scores on how a test prep person might do a question vs how an academic might do the same question.
- Testing is not the same – All the great practice in the world is generally not sufficient to replicate the experience of take a proctored exam in a crowded room with other kids sniffling and tapping and stressing. Khan will never be able to truly simulate the experience of taking the test.
So what’s the upshot of all of this?
While Khan is shaping up to be a great resource it’s important to not get too enamored with the potential of the shiny new toy. Khan will help those who have had no access to quality free resources, but it will probably not level a playing field that is slanted at every level of education starting in utero and culminating in the workplace. Additionally Khan has been around for years delivering lessons for everything from algebra to physics and yet somehow the teaching industry has not been disrupted, it’s unlikely this will upend the test prep industry.
The keys for taking advantage of Khan will be to start using it early and over a sustained period of time to build academic skills and gain comfort with the material on the SAT. If you don’t make the gains you want or have very little time, then it might make sense to look into actual test preparation options.
What’s your thoughts ? What did I miss? What articles or research do I need to read or link to? Please put it in the comments!
A couple of articles that get it right
With close of the “college application season,” I’m once again reminded of the stark differences in the college application process for students from low income families and that for the 1%. With every blog or article I read, I’m continually reminded how divided America is in every way. Divided informationally. Divided experiencially. Divided economically. Divided racially. Divided educationally. Just divided. This division is no small matter, it’s a chasm that starts with access to pre-k programming, blossoms in primary school, matures throughout higher education, and culminates in the workplace. The college admissions process is not immune to these conditions and concerns (despite its theoretical claims to a meritocracy). In fact, the college application and admission process may be the very nexus of these myriad issues and bring to a head the years-long growth of inequity between the haves and have-nots. But since I can’t address, cure, or understand all the ills of society, I’ll just explore differences between the college preparation and application process for the haves and have-nots (and yes I’ll ignore America’s shrinking middle class).
One of the more interesting debates of the past 30 years has been the efficacy test prep programs. In one corner you have College Board (CB) citing a seemingly vast number of studies that support the idea that test prep is at best minimally effective. Many of us have likely heard or read College Board reports that suggest that SAT scores are near immutable and that from one test to the next scores will only change by negligible amounts. In the other corner you have a billion dollar test prep industry making score claims that fly in the face of all information given by College Board. Additionally, many of us also have friends (or have friends who have friends) whose children attended prep classes and improved by 200 or 300 points.
Reading the papers and following the blogs, one is led to believe that the only choice families and schools have is whether to believe the “evil test creator” who seemingly exists to torture kids with 4-hour long tests or the “greedy test prep companies” who are bilking families out of billions of dollars by making them pay for prep that doesn’t work. Faced with this conflicting information one could easily be confused about who’s right, what the real story is, and what to do to help your child or student. How do parents, educators, administrators or students sort through the noise and determine how to put their child in a position to succeed on these tests (and more importantly get into college). Let’s explore the factors that lead to the disagreement and shed some light on the issue.