Pilot SQE1 report
Over 300 candidates sat the SQE1 pilot over the course of three days at Pearson VUE test centres throughout the UK, in Singapore and France.
The pilot SQE1 assessments were laid out as follows:
Functioning Legal Knowledge (FLK) Test – 120 BSA* questions in three papers
2. Property practice; wills and the administration of estates and trusts; solicitors’ accounts; land law
3. Public and administrative law, legal system and legal services, criminal litigation and criminal law
Stage 1 skills test – 2 assessments
Recommendations from independent reviewers and Kaplan
Kaplan proposed splitting the 360 questions into two papers instead of three “for a fair, valid, reliable, accurate, cost effective and manageable Stage 1 SQE exam”.
To achieve the above, both the independent reviewer and Kaplan proposed dropping the SQE1 Skills assessment. Kaplan states:
“For reasons of the robustness and resilience of the exam as well as reliability, accuracy, validity, fairness and equality of opportunity, a Stage 1 skills exam in its current form should not be part of the SQE.”
They further explain:
“…performance in the two “mini OSCEs” was very different with mean scores of 75.8% and 59.1% respectively… This disparity between deliveries would be challenging to defend in a high-stakes professional exam. “
Despite the big disparity between the two assessments, the independent markers marked each station almost identically and raised no issues about the question. The report concludes:
“This suggested strongly that the results were not due to a poorly drafted question or poor marking… This draws attention to a major issue with a pass/fail decision based on so few stations. One station performing differently can have an unacceptable effect on outcomes.”
The recommendations set out with the SQE1 Skills assessment suggests finding another way to assess legal skills. The report adds:
“The design of a high stakes professional exam should ensure it is sufficiently robust and resilient to withstand unusual performance in a station for whatever reason.”
The SRA will be in continual discussion on how to assess skills in SQE1 because stakeholders consulted on the SQE believe there is a need to assess skills in SQE1. The SRA will use the pilot for SQE2 (set for December 2019) to inform their decision on whether to drop the skills assessment from SQE1 and if not, how to assess writing and research skills.
The new way to qualify as a solicitor
The assessment will be split into two parts:
The cost for both exams will probably be between £3,000 – £4,500. Students will only be able to sit the examination a total of three times and this must be done within six years.
In order to qualify as a solicitor, a candidate will need to pass the SRA character and suitability requirements as well as have qualifying work experience. More information can be found here.
*Single Best Answer
**Objective Structured Clinical Examination
***The SRA accepted Kaplan and the Independent reviewer’s recommendation to split the FLK tests into two papers instead of three.