Royal Courts of Justice
Strand, London, WC2A 2LLDate: 07/03/2013
Before :
THE HON. MRS JUSTICE NICOLA DAVIES DBE
- - - - - - - - - - - - - - - - - - - - -
Between :
R on the application of Save our Surgery Limited | Claimant |
- and - | |
Joint Committee of Primary Care Trusts | Defendant |
Newcastle Upon Tyne Hospitals NHS Foundation Trust | InterestedParty |
- - - - - - - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - - - - - - -
Philip Havers QC and Jeremy Hyam (instructed by Hempsons Solicitors) for the Claimant
Dinah Rose QC and Marina Wheeler (instructed by Capsticks Solicitors) for the Defendant Fenella Morris QC (instructed by Samuel Phillips Solicitors) for the Interested Party
Hearing dates: 11th, 12th, 18th February 2013
Approved Judgment
Mrs Justice Nicola Davies :
The claimant seeks to quash the decision of the defendant, the Joint Committee of Primary Care Trusts (the JCPCT) made on 4 July 2012 which identified seven specialist centres in England for the future performance of paediatric cardiac surgery. Those centres are to be located in Bristol, Birmingham, Liverpool, Newcastle, Southampton and London (two centres) (“the Decision”). Of twelve options considered in a consultation process the JCPCT decided that Option B, an option excluding Leeds General Infirmary (Leeds) but including the Freeman Hospital (Newcastle) would provide the best quality care.
Factual Background
The 2001 Report of the Public Inquiry into deaths at Bristol Royal Infirmary chaired by Professor Sir Ian Kennedy noted that healthcare services for children were “fragmented and uncoordinated” and made a series of recommendations. Reports by groups of experts in 2003, 2006 and 2007 recommended re-organisation of the centres providing paediatric cardiac surgery services. The consensus was, that in order to achieve better and safer results, surgical expertise needed to be concentrated in fewer, larger centres. A minimum number of surgeons were needed in each centre to ensure adequate cover. Each needed to perform a minimum number of procedures per year to ensure sufficient expertise. In order to achieve the stated aims of a high quality sustainable service with equitable access the number of surgical centres in England would have to be reduced and local arrangements for non-surgical centres would have to be strengthened.
In response to such concerns in 2008 the NHS Medical Director, Sir Bruce Keogh, acting on behalf of the NHS Management Board requested the NHS National Specialised Commissioning Group (NSCG) to review the provision of paediatric congenital cardiac services. The review became known as the “Safe and Sustainable Review” (the Review). The Review was led by a project team (the NSC team) and was assisted by specialist groups which included:
The Steering Group: this primarily provided clinical advice. It was chaired by Dr Patricia Hamilton and comprised 25-30 members of professional and lay associations and commissioners from around the country;
The Standards Working Group: a sub group of the Steering Committee led by clinicians whose role was to research and develop a framework of clinical and service standards;
An Independent Assessment Panel (the “Kennedy Panel”) chaired by Professor Sir Ian Kennedy whose role was to review the existing providers of paediatric congenital cardiac services (“PCCS”) and evaluate their compliance with the proposed service standards currently and in the future. The panel was comprised of experts in paediatric cardiac surgery, paediatric cardiology, paediatric anaesthesia/paediatric intensive care, paediatric nursing together with lay representatives and NHS commissioners.
In 2010 the JCPCT was established as the formal consulting body with responsibility for the conduct of the consultation of the Review and for taking decisions on issues
the subject of the consultation. On 1 March 2011, the JCPCT published a Consultation Document entitled “Safe and Sustainable: A New Vision for Children’s Congenital Heart Services in England” (the Consultation Document). The essence of the proposal was that the number of centres providing paediatric cardiac surgical services be reduced from eleven to seven and that the paediatric congenital cardiac service be reconfigured into one of a number of national configuration options. The Legal Challenge
The claimant is a shell company created solely for the purpose of this litigation. Its funds are raised from public contributions and it draws upon the support of many local people, a petition signed by 600,000, together with local MPs and clinicians. The preliminary work in respect of this challenge was carried out by the Children’s Heart Surgery Fund (CHSF) but following advice from the Charity Commissioners the CHSF had no further involvement in the proposed litigation. The defendant challenges the standing of the claimant to act in these proceedings.
The claimant does not challenge the merits of the Decision. The challenge is to the consultation process which preceded the Decision and its product, namely the Decision. The claimant’s contention is that the same were flawed by:
procedural unfairness – a failure to disclose sub-scores awarded by the Kennedy Panel which were the key to understanding the “material differences” in “Quality” between the centres considered in the configuration assessment. This failure deprived the consultees of the opportunity to make intelligent and informed responses, which, had they been taken into account by the JCPCT, at the very least may and probably would have had a significant influence on the outcome of the configuration assessment;
a failure to take into account material considerations: a failure by the JCPCT itself sufficiently to inquire into and then take into account the supposed “material differences” in “Quality” between the centres which were being considered in the configuration assessment by failing to have regard to the Kennedy Panel sub-scores and by relying on mistaken and erroneous advice/assurance from Professor Sir Ian Kennedy.
For the purposes of these proceedings the claimant does not challenge the decision that it is Leeds or Newcastle as the one northern centre. In the event that the decision is quashed the claimant would contend that both could continue to provide these services.
The defendant contends that the consultation process was fair, all relevant considerations were properly taken into account by the JCPCT when the decision was made. The overall scores awarded by the Kennedy Panel were disclosed to consultees and were considered by the defendant as was a detailed report prepared by the Kennedy Panel. The report identified the areas of strength and weakness in compliance with identified criteria which it had assessed on the evidence provided to it by the centres. The report provided sufficient information to enable consultees to comment intelligently on the proposals for reconfiguration of the service.
Fairness does not oblige a decision maker to disclose all underlying materials which have informed advice provided to the decision maker. Such a requirement is particularly inappropriate where the advice itself, and the reasons for it, have been disclosed; where the advice consists of an exercise of individual and collective expert judgment, rather than an objectively verifiable analysis of data; where the information being assessed has been provided by the consultees themselves; and where the decision maker has not had access to, or relied upon, the material in question. There is no principle of fairness that requires the disclosure to consultees of material which has not been considered or relied upon by the decision maker. The logic of the claimant’s case is that not only the sub-scores but also the working notes and individual scores of members of the Kennedy Panel together with all the evidence considered by them ought to have been disclosed to consultees.
The application for judicial review was issued on 2 October 2012. On 21 November 2012 HHJ Mackie QC sitting as a Deputy High Court Judge made an order which included the following:
Newcastle Upon Tyne Hospitals NHS Foundation Trust be joined as an
interested party;
A rolled up hearing to determine the application for permission and the substantive claim be heard.
Having considered the submissions I grant permission to the claimant to apply for judicial review.
Legal Framework
Sections 1 and 3 of the National Health Service Act 2006 require the Secretary of State for Health to provide or secure certain medical services. By regulation 3 of the National Health Service (Functions of Strategic Health Authorities and Primary Care Trust and Administration Arrangements) (England) Regulations 2002 (SI 2002 / 2375), as amended, that function has been substantially delegated to Primary Care Trusts (“PCTs”). Section 242 (2) (b) of the 2006 Act imposes a duty on each body to which it applies which includes PCTs, to consult persons to whom services are being or may be provided on “the development and consideration of proposals for changes in the way those services are provided”.
Paragraph 10.3.2 of the Department for Health Overview Scrutiny of Health Guidance provides that :
“…where a proposed service change spans more than one PCT, they will need to agree a process of joint consultation. The Board of each will need to formally delegate responsibility to a Joint Committee, which would act as a single entity. Following consultation the Joint PCT Committee will be responsible for making the final decision on behalf of the PCTs for which it is acting.”
Specialised paediatric cardiology and cardiac surgery services are “specialised services”, commissioned regionally by Specialised Commissioning Groups (“SCGs”),
which are constituted as joint committees of PCTs in their catchment area. The NSCG coordinates the work of the SCGs and oversees, when necessary, pan-regional commissioning.
Lawful Consultation
The law imposes obligations of fairness upon any consultation exercise, the requirements of a lawful consultation were identified by the Court of Appeal in R v North and East Devon Health Authority, ex parte Coughlan [2001] 1QB 213:
“108 It is common ground that, whether or not consultation of interested parties and the public is a legal requirement, if it is embarked upon it must be carried out properly. To be proper, consultation must be undertaken at a time when proposals are still at a formative stage; it must include sufficient reasons for particular proposals to allow those consulted to give intelligent consideration and an intelligent response; adequate time must be given for this purpose; and the product of consultation must be conscientiously taken into account when the ultimate decision is taken (R v Brent London Borough Council ex parte Gunning (1985) 84 LGR 168)…
112...It has to be remembered that consultation is not litigation: the consulting authority is not required to publicise every submission it receives or (absence and statutory obligation) to disclose all its advice. Its obligation is to let those who have a potential interest in the subject matter know in clear terms what the proposal is and exactly why it is under positive consideration, telling them enough (which may be a good deal) to enable them to make an intelligent response. The obligation although it might by quite onerous, goes no further than this.”
In Devon County Council v Secretary of State for Communities and Local Government [2010] EWHC 1456 (Admin) Ouseley J. stated:
“68. What needs to be published about the proposal is very much a matter for the judgment of the person carrying out the consultation to whose decision the courts will accord a very broad discretion…But, in my judgment, sufficient information to enable an intelligible response requires the consultee to know not just what the proposal is in whatever detail is necessary, but also the factors likely to be of substantial importance to the decision, or the basis on which the decision is likely to be taken…
70...: a flawed consultation exercise is not always so procedurally unfair as to be unlawful; R (Greenpeace) v Secretary of State for Trade and Industry [2007]Env LR 29, Sullivan J…the true test is whether the consultation process was so unfair that it was unlawful…”
Within the context of this case the claimant identified the “factors” (paragraph 68) as representing the Kennedy sub-scores. The defendant contends that they represent the factors developed in the Consultation Document namely accessibility, deliverability, sustainability and quality; the sub-scores are the underlying assessment of these factors.
In R v Secretary of State for the Home Department ex parte Doody [1994] 1.A.C 53.
the challenge was to decisions of the Secretary of State by serving prisoners as to the minimum terms of imprisonment which they would have to serve prior to their cases being reviewed. Lord Mustill dealt with the issue of what fairness required in the context of the case and stated at p.560 (e):
“.…(2) The standards of fairness are not immutable. They may change with the passage of time, both in the general and in their application to decisions of a particular type. (3) The principles of fairness are not to be applied by rote identically in every situation. What fairness demands is dependent on the context of the decision and this is to be taken into account in all its aspects…(5) Fairness will very often require that a person who may be adversely be affected by the decision will have an opportunity to make representations on his own behalf either before the decision has taken with a view to producing a favourable result; or after it is taken, with a view to procuring its modification; or both. (6) Since the person affected usually cannot make worthwhile representations without knowing what factors may weight against his interest fairness will very often require that he is informed of the gist of the case which he has to answer...
The respondents acknowledge that it is not enough for them to persuade the court that some procedure other than the one adopted by the decision maker would be better or more fair. Rather, they must show that the procedure is actually unfair. The court must constantly bear in mind that it is to the decision maker, not the court, that Parliament has entrusted not only the making of the decision but also the choice as to how the decision is made…”
The defendant relies upon the above passage in support of its contention that it is the gist of the case of which consultees have to be informed. The claimant does not accept that the ‘gist of the case’ is sufficient for the purpose of a consultation exercise, Doody was not a consultation case it was a challenge to a decision.
The defendant also relies upon the authority of Bushell and Another v Secretary of State for the Environment [1980] AC 75 Lord Diplock p.95:
“What is fair procedure is to be judged not in the light of constitutional fiction…but in the light of the practical realities as to the way in which administrative decisions involving forming judgments based on technical considerations are reached…”
Bushell did not involve a consultation process, the issue was one of fairness at an inquiry.
In R (Eisai) v National Institute for Health and Clinical Excellence and Others [2008] EWCA CIV 438 the claimant pharmaceutical company held the UK marketing authorisation for a drug used in the treatment of Alzheimer’s disease. NICE decided that it was not cost efficient and published guidance to that effect. The claimant challenged the procedure by which NICE had reached its decision contending that as a consultee of NICE, it should have had access to a fully executable version of the economic model that NICE had used to determine the cost effectiveness of the drug, rather than the only partly executable version which NICE had made available to all consultees. It was an important feature of Eisai that throughout the consultation process, the claimant had asked for a copy of the fully executable version of the model. Richards LJ cited the above passages in ex-parte Coughlan and continued:
“ 26. The mere fact that information is “significant” does not mean that fairness necessarily requires its disclosure to consultees…nevertheless the degree of significance of the undisclosed material is obviously a highly material factor.
27. What fairness requires depends on the context and the particular circumstances; see for example, R v Secretary of State for Education, ex-parte M [1996] ELR 162, at pp. 20062007, where Simon Brown LJ emphasised the need to avoid a mechanistic approach to the requirements of consultation…
30. …The fact that the material in question comes from independent experts is plainly relevant to the overall assessment, but it was a combination of factors – including the requirement of a high degree of fairness…the crucial nature of the advice, the lack of good reason for non-disclosure, and the impact on the applicants- which led to what was on the facts a fairly obvious conclusion…
65…even if one accepts the possibility that release of the fully executable version would add two to three months to the appraisal process, that has to be viewed in the context of an already lengthy process…I do not think that either the additional time or the additional cost to NICE should weigh heavily in the balance in deciding whether fairness requires release of the fully executable version. If fairness otherwise requires release of the fully executable version, the court should in my view be very slow to allow administrative consideration of this kind to stand in the way of its release.
66…procedural fairness does require release of the fully executable version of the model. It is true that there is already a remarkable degree of disclosure and of transparency in the consultation process; but that cuts both ways, because it also serves to underline the nature and importance of the exercise being carried out. The refusal to release the fully executable version of the model stands out as one exception to the principle of openness and transparency that NICE has acknowledged as appropriate in this context. It does place consultees…at a significant disadvantage in challenging the reliability of the model. In that respect it limits their ability to make an intelligent response in something that is central to the appraisal process…”
The request by the claimants in Eisai for disclosure of the relevant model was contrasted with the position of the claimant in R (Easyjet)v Civil Aviation Authority and Others [2009] EWCA CIV 1361 in whichthe claimant’s challenge was based upon the fact that the defendant had acted unfairly in failing to consult the airlines. After its own stated deadline for accepting representations from any party had passed, the defendant obtained and took into account material evidence from BAA explaining their underlying calculations for additional security costs. The defendant did not inform the airlines about this material, nor was there any opportunity to scrutinize or comment upon it. The essential factual difference between Eisai and Easyjet was that in Eisai the claimant had made clear that it wanted to see and comment on the fully executable version of the model whereas in Easyjet the airlines were content to leave the completion of the process of scrutinising and assessing the security costs to the defendant without any further input from them.
The court recognised that the airlines had played a full part in the consultation process prior to the identified deadline. It found that the process was not unfair and relied upon the fact that the airlines were content for the defendant to complete the final stage of the process without any further input during which period further submissions were received upon which they did not comment. Of note is the following identified by Maurice Kay LJ [74]:
“…what fairness demands is dependent on the context of the decision.
The decision in the present case does not impact on personal liberty, a person’s home, the use which a property owner may make of his property or the right to conduct a business. Its context is the regulation by a statutory body of one aspect of the process charged by a private monopoly supplier to its customers…the ultimate issue is not the provision or non provision of a service. It is simply the charge that may be levied by the airports per passenger
[73] This puts the decision of the CAA at the “soft” end of the spectrum…fairness should reflect the context as I have described it. It is for this reason that I reject Mr Béar’s submission that the present case is on all fours with Eisai where the regulatory decision was effectively as to whether or not the company should be enabled to market their drug within the NHS. I see that as a significantly more intrusive decision which is more likely to attract a higher level of procedural fairness…”
As to the refusal of the JCPCT to consider the sub-scores the claimant relies upon the authority of Kaioa & Others v West & Another [1985] 159 C.L.R 550 Brennan J stated at 628:
“a person whose interests are likely to be affected by an exercise of power must be given an opportunity to deal with relevant matters adverse to his interests which the repository of the power proposes to take into account in deciding upon its exercise;… the person whose interests are likely to be affected does not have to given an opportunity to comment on every adverse piece of information, irrespective of its credibility, relevance or significance…nevertheless in the ordinary case where no problem of confidentiality arises an opportunity should be given to deal with adverse information that is credible, relevant and significant to the decision to be made. It is not sufficient for the repository of the power to endeavour to shut information of that kind out of his mind and to reach a decision without reference to it. Information of that kind creates a real risk of prejudice, albeit unconscious, and it is unfair to deny a person whose interests are likely to be affected by the decision an opportunity to deal with the information…”
In Lambeth London Borough Council v Ireneschild [2007] EWCA CIV 234 an issue of procedural unfairness arose based upon the fact that the respondent was not provided with an opportunity to address the provisional views of the author of an assessment of her care and accommodation needs. Hallett LJ relied upon the fact that the material in the assessment was essentially derived from the respondent herself as one of the factors in deciding that there had been no unfairness. The defendant submits that the process identified is similar to the facts of the present challenge: the claimant was told what the issues were; was asked relevant questions and given an opportunity to put forward its best answers. The claimant contends that this was not a consultation case, the document was an internal report by one of the authority’s own officers. Hallett LJ regarded as significant the fact that the process allowed for representations to be made after the assessment had been completed, it was not a final determination of an entitlement.
As to what has to be demonstrated: in R (Smith) v North Eastern Derbyshire NHS
Trust [2006] EWCA CIV 1291 May LJ stated that in such a challenge
“The defendants would have to show that the decision would inevitably have been the same and the court must not unconsciously stray from its proper province of reviewing the propriety of the decision making process into the forbidden territory of evaluating the substantial merits of the decision…”
In considering the authorities cited by the parties I have paid particular attention to and given weight to those which consider a challenge to the consultation process. From the authorities the following principles can be identified:
The issue for the court is whether the consultation process was “so unfair it was unlawful” – Devon County Council;
Lawful consultation requires that: i) it is undertaken at a time when proposals are still at a formative stage; ii) it must include sufficient reasons for particular proposals to allow those consulted to give intelligent consideration and an intelligent response; iii) adequate time must be given for this purpose; iv) the product of the consultation must be conscientiously taken into account when the ultimate decision is taken;
Disclosure of every submission or all of the advice received is not required. Save for the need for confidentiality, those who have a potential interest in the subject matter should be given an opportunity to deal with adverse information that is credible, relevant and significant to the decision to be made. The degree of significance of the information is a material factor;
The fact that the information in question comes from an independent expert or from the consultee is relevant but it is a combination of factors including fairness, the crucial nature of the advice, the lack of good reason for non disclosure and the impact upon consultees which are to be considered upon the issue of fairness;
What fairness requires is dependent on the context of the decision; within that the court will accord weight and respect to the view of the decision-maker;
If the person making the decision has access to information but chooses not to consider it, that of itself, does not justify non-disclosure; it will be for the court to consider the reason for non-disclosure;
A consultation process which demonstrates a high degree of disclosure and transparency serves to underline the nature and importance of the exercise being carried out; thus, non-disclosure, even in the context of such a process, can limit the ability of a consultee to make an intelligent response to something that is central to the appraisal process;
The more intrusive the decision the more likely it is to attract a higher level of procedural fairness;
If fairness requires the release of information the court should be slow to allow administrative considerations to stand in the way of its release.
The Assessment and Consultation Process
In March 2010 the draft service Standards were published following which each of the existing surgical centres was sent a Self-Assessment Template. The purpose of the exercise was to enable each centre to supply information and evidence to demonstrate that it met specified core criteria derived from the Standards or would be able to meet them in the future.
Self Assessment Template
The template contained an explanation of the evaluation process and the method of scoring, including the weightings to be applied to the scores. The text included the following:
“2. Evaluation process and scoring
Evaluation process
The evidence you supply in this exercise will be assessed as part of the evaluation process we will undertake, and will therefore ultimately inform the final recommendation. The entire evaluation process has 2 discrete stages – Assessment Evaluation and Configuration Evaluation. This process will fulfil the first stage of the Assessment Evaluation.
The second stage of the Assessment Evaluation will be visits by the Assessment Panel to each centre… for one day in order to review the current service against the criteria specified in the self-assessment. The visit will give the Panel the opportunity to meet all members of the team, to see the service in operation, and to gain assurance against all reported development opportunities in the self-assessment document…
It should be noted that the criteria and scoring process for the Configuration Evaluation have not yet been determined. This will be communicated to all stakeholders in due course. However, the criteria and scoring for the Configuration Evaluation is separate from the Assessment Evaluation. The information supplied in the assessment stage of the process will not have any direct bearing on the scoring of the configuration evaluation process.”
…Scoring
Scores will be allocated against each criterion, which will come together as a final score for each centre. The scoring process will take place as follows:
Before the assessment visit, each member of the Panel will score these self assessment submissions using the criteria detailed below.
An assessment of the financial viability of the proposals will be conducted by the NSC Team and supplied to the Panel for their consideration, alongside the completed self assessments.
Subsequently, during the assessment visits, the first stage scores will be validated by each member of the assessment panel, as a result of what they see, hear and observe during the day.
The scores will then be cross checked between all panel members at the end of each visit, to ensure consistency and rationality.
Feedback will be given to each individual centre by letter to the Chief Executive when all assessment visits to all centres have concluded (July 2010).
Individual scores for each centre will help identify the configuration options, which will then be tested against criteria such as ease of access, affordability and deliverability, and risks of reconfiguration. The exact scoring mechanism for this stage has yet to be determined.
For the Self Assessment Evaluation Stage, each question within the 9 self assessment criteria will be scored individually, as indicated below:
Inadequate (no evidence to assure panel members)
Poor (limited evidence supplied)
Acceptable (evidence supplied is adequate but some questions remain unanswered or incomplete)
Good (evidence supplied is good, and the panel are assured that the centre has a good grasp of the issues)
Excellent (evidence is exemplary)
Each question within that criterion will then be weighted according to the stated multiplier, in order to reach a final score for each question. The sum of these final scores will be the total score for that criteria.
The total scores for each criterion will come together as a final score for each centre…
How the Criteria for Self Assessment were derived
The criteria that this template asks for evidence against are as follows:
Leadership and Strategic Vision
Strength of Network
Staffing and Activity
Independent Services
Facilities and Capacity
Age Appropriate Are
Information and Choice
Excellence of Care
Deliverability and Achievability
Criteria 1 and 9 are derived from the need to review the strength of the organisation, in terms of its future sustainability and ability to ensure continuous improvement.
Criteria 2-8 as derived from the full designation standards document, which is detailed at Appendix 1. The designation standards document describes the proposed future model of care for Paediatric Cardiac Surgery Services. The standards will, in effect, be used for two purposes:
As a tool for assessment
A number of the standards are “core requirements” in order to pass the assessment evaluation stage of the process, and to be able to move forward to the configuration evaluation. These are represented by criteria 2 to 8.
As a commissioning service specification
Once the reconfiguration is complete, and centres are designated, they will be expected not only to have the core requirements in place, but also to demonstrate to commissioners how they will achieve the standards, within timescales specified. The standards document will therefore be used as an ongoing commissioning service specification which will be managed through local performance management processes.”
Criteria 1-8 contained sub-criteria. ‘Leadership and Strategic Visions’ contained 11, the remaining criteria contained 3 identical sub-criteria briefly described as:
Current achievements against standards
Development plans
Meet the minimum of 400 procedures.
Leeds and Newcastle submitted their Self-Assessment Templates in March-May 2011. SCG commissioners were asked to provide commentary on the assessments as a form of validation. Centres were sent two subsequent Templates: a Financial Template, and a Template relating to Nationally Commissioned Services (NCS). The NCS template asked centres if they wished to be considered as providers for paediatric cardiothoracic transplantation (provided at the time by Great Ormond Street Hospital “GOSH” and Newcastle), extra-corporeal membrane oxygenation (ECMO) (provided by GOSH, Newcastle and Leicester) and complex tracheal surgery (only provided at GOSH).
Kennedy Panel assessment
On receipt of the Self-Assessments, Kennedy Panel members individually allocated initial scores to each centre’s submissions. They visited the centres: “We interrogated the centres on the information they had provided to us, to see what the story was behind the figures and data provided”. (Witness Statement, Professor Sir Ian Kennedy). The statement continues:
“…Using the evidence that we had been given and had gathered, the Independent Panel members assessed the centres current performance in meeting the Standards and the robustness and achievability of the centres’ development plans for meeting the Standards, if they were not currently met…We were as interested in the centres’ ability to meet them in the future, and the realism and feasibility of their ambitions in this respect…Each sub-score constituted a judgment on a number of factors, and the views of the different experts on the Independent Panel – drawing from their own experience - on those factors. The scores were composite of these factors…”
Each centre was said to be scored independently of the others. The final consensus score was the result of discussion.
Weightings (identified in the template) were applied to the scores by the NSC team. Sensitivity analyses were applied to test the robustness of the process.
The sub-scoring for Newcastle and Leeds was as follows:
Criteria Newcastle Leeds consensus weighted consensus weighted
45 99 36 78
10 45 11 48
8 73 8 73
11 48 14 62
12 56 9 42
10 29 11 31
9 27 11 31
12 48 9 36
0 0 0 0 117 425 109 401
______________________________________________
The Steering Group convened to consider the applications to provide Nationally Commissioned Services (NCS). It reported in July 2010 that the three current providers of services, (GOSH, Leicester and Newcastle) were delivering good outcomes, NCS should be maintained in these locations if possible. At that time it was considered that Birmingham could develop a transplant and ECMO service if required.
In August 2010, each centre received initial feedback on the Kennedy Panel assessments by letter from the Director of National Specialised Commissioning which stated that compliance with the standards had been scored, and a summary of findings specific to the centre was provided. Centres were informed that the ninth criterion, “deliverability and achievability”, which focused on the financial affordability of proposals submitted by the centres, had not been scored by the Kennedy Panel, and would instead form part of the consideration by the JCPCT in developing proposals for reconfiguration.
On 28 September 2010 the Kennedy Panel attended the meeting of the JCPCT to report on the outcome of the assessments. The JCPCT were given the final consensus scores (but not the sub-scores). The centres were ranked as follows:
Evelina 535 Southampton 513 Birmingham 495
Great Ormond Street 464 Royal Brompton 464
Bristol 449 Newcastle 425
Liverpool 420
Leicester 402 Leeds 401
Oxford 237
The minutes of the JCPCT meeting record discussion relating to disclosure of the subscores:
“Dr Carroll requested the Committee be given access to the subcomponents of the panel’s original scorings. Mr Glyde said a summary report had been offered to members at a previous meeting but not taken up by members. Ms Claire stated that she did not wish to see the detail: she believed that the expert’s interpretation was authoritative. Sir Ian Kennedy highlighted the risk of judicial review; the process was undermined if data was provided when experts had been appointed to make a judgment. Ms Llewellyn shared Sir Ian Kennedy’s concerns. Asked if the detail was disclosable under the Freedom of Information Act, Mr Glyde said he believed that it would be once the process was concluded.
Ms Christie suggested that the summary report of key findings from each centre be provided by the panel Sir McKay endorsed Ms Christie’s suggestion and advised the Committee to be disciplined in resisting requesting further detail once the summary was provided.”
Professor Sir Ian Kennedy’s evidence as to the advice which he gave at the meeting was that the JCPCT should limit their judgment to the context in which they had the opportunity to test the evidence. The JCPCT was free to use the conclusions and report as they wished but “questioning the scores themselves would take them into an
area in which they were not expert.” Sir Ian’s recollection of the reference he made to the risk of judicial review in the minutes was “…this was a caution that the process as a whole needed to be conducted fairly, and with considerable care, and of the dangers of JCPCT acting beyond its expertise.”
In December 2010, the Kennedy Panel produced the “Report of the Independent Expert Panel” (‘the Kennedy Report’). It set out the total scores and a narrative assessment of each centre’s compliance with the specified criteria. For each centre, there was an overview followed by an assessment of compliance and gaps in compliance in relation to each of the individual template questions. This was shared with the centres and made public in January 2011.
Professor Sir Ian Kennedy described his report as “a very substantial piece of qualitative analysis of each centre against these standards. It analysed whether the centres could meet the standards now or in the future. The full report provides an explanation for the scores, and would enable an informed challenge to our findings of fact – as mounted by Leeds Teaching Hospitals NHS Trust in its response to the consultation…”
The summary for Leeds noted the following:
“Areas of compliance
The Network is currently very strong and the trust has good relationships with all key stakeholders
All critically interdependent services are currently co-located
The PICU currently meets core PICU standards and there are two separate rotas for anaesthetists
The Trust has good facilities that can sustain an increase in activity to 400 procedures per year
The Trust had implemented best practice from Ohio
Areas of weaker compliance
The Trust did not demonstrate innovative working practices
The Trust has no plans to use telemedicine for paediatric cardiac surgery
Waiting lists at the trust are long
There are concerns about future staffing capacity in PICU and theatres
The trust has no transition nurse
The Trust did not sufficiently describe an academic research portfolio”
The main body of the report described areas in which Leeds complied with the standards, including co-location of relevant paediatric services on one hospital site, compliance with the paediatric intensive care standards, a strong network, and a stand-alone paediatric retrieval service. Areas of non-compliance identified for Leeds included an unsustainable model of paediatric intensive care, inefficient working practices, limited confidence in the leadership within the service, limited evidence of the strategic importance of paediatric cardiology services to the Trust, limited evidence of relevant academic research and clinical innovation, limited confidence in the Trust’s ability to develop a larger congenital heart network and limited confidence in the Trust’s development plans and its understanding of the scale of the challenge in this regard.
The summary for Newcastle noted:
“Areas of compliance
The Trust has a strong record of delivering high quality services and had a strong clinical governance structure
The Trust demonstrated highly innovative work, especially with regard to the use of Berlin Hearts. It was the first centre to set up a cardiac genetics database. The estates strategy was strong
All services are co-located as per the standards
Areas of weaker compliance
Because of the small and specialist nature of the PICU it has insufficient staffing levels to maintain a consultant led service
There was limited information about how the trust would work with other hospitals in the network, including hos the IT strategy and transition would be applied within the network, and how it would resolve the concerns working with Carlisle.
There is no clinical psychologist or Children’s Cardiac Specialist Nurse”
Configuration options assessment
Between July 2010 and February 2011 the JCPCT, under the chairmanship of Sir Neil McKay, considered the options for the national configuration of the service. In July 2010, the JCPCT agreed that the following principles should apply:
Each option (cluster of centres) should ensure that all centres included within in it are able to carry out a minimum of 400 procedures per year, ideally 500 and options should contain six or seven centres;
Due to the size of its catchment population, London requires at least two centres;
Oxford should be discounted due to sub-optimal quality and lack of
contribution to access times;
Birmingham to remain in all options due to high referrals from a large catchment population;
Bristol and Southampton are mutually exclusive but one required in all options to serve local populations;
Two sites are required in the “North” but patient numbers are insufficient to sustain three: for demographic and geographic reasons, options to include Liverpool and either Newcastle or Leeds.
At a JCPCT meeting on 11 January 2011 two additional criteria were applied which required, inter alia, that options must include a minimum of three centres capable of providing ECMO services, two centres providing transplant services and one providing complex tracheal surgery. The JCPCT then considered which of the viable options should be put forward for consultation. The options were scored against weighted evaluation criteria which were the product of consultation undertaken by the NSC team. The following evaluation criteria (in order of importance) were agreed for assessing the options:
Quality:
centres will deliver a high quality service;
innovation and research are present; (c) clinical networks are manageable; ii) Deliverability:
high quality NCSs will be provided;
the negative impact on other interdependent services will be kept to a minimum, as will negative impacts on the workforce;
Sustainability:
centres are likely to perform at least 400-500 procedures; will not be overburdened and will be able to recruit and retain newly qualified staff.
Access and travel times:
negative impact of travel times for elective admissions are kept to a minimum; retrieval standards are complied with.
“Quality” contained three elements. The Kennedy Panel consensus scores for each centre were used by the JCPCT to score the “high quality service” element within the option ranked first of the four. Options were scored on the basis of the extent to which they met the criteria: ranging from: 1 (some elements met) – to 4 (criteria exceeded). Weightings were applied to the scores for each of the four criteria to reach a total score for each option. Options were then ranked.
On 16 February 2011, the JCPCT met in public to discuss and agree the Pre Consultation Business Case (PCBC) and the Consultation Document. The four reconfiguration options proposed were:
Option A: Newcastle, Liverpool, Leicester, Birmingham, Bristol, London x 2
Option B: Newcastle, Liverpool, Birmingham, Bristol, Southampton, London x 2
Option C: Newcastle, Liverpool, Birmingham, Bristol, London x 2 Option D: Leeds, Liverpool, Birmingham, Bristol, London x 2
Consultation Evaluation
The Consultation Document “Safe and Sustainable: A New Vision for Congenital Heart Services in England” issued on 1 March 2011, set out the process by which these options had been identified, and the evidence which had informed the proposals. The analysis was supported by the PCBC. The consultation took place between 1 March to 1 July 2011. During the four month consultation period about 50 public events were held, 77,000 responses were received. Events held in Leeds attracted many participants, including representatives of CHSF. Issues such as transport infrastructure, travel times and the co-location of paediatric and adult services on one site at Leeds were raised at the events in Leeds. No query or issue arose in respect of the Kennedy Panel’s sub-scores. Consultation responses were analysed by Ipsos MORI and presented in a written report.
Consultation responses
Leeds submitted a detailed response to the consultation, arguing its case for retention of Leeds as a centre for paediatric cardiac surgery whilst raising concerns about the review process. It identified advantages in retaining Leeds, and where it had the edge over Newcastle. In a section headed “Issues and concerns in relation to the Safe and Sustainable process” the following was stated:
“In broad terms our concerns relate to
Matters of factual accuracy and consistency.
Matters of scope, context and approach in the review and with the options appraisal.
3.1 Matters of factual accuracy and consistency
The final report received from Professor Ian Kennedy’s Review in January 2011 was different from the draft letter about the report that the Trust had commented on in 2010 and contained a number of inaccuracies around the PICU configuration and specialist nurse posts. Although the Trust had responded to the inaccuracies in the draft letter, a number of them were not corrected in the final report from Sir Ian Kennedy. There was not an opportunity to correct the final report before this information was placed in the public domain, and indeed members of the Safe and Sustainable team have repeated this information in the media.
Despite requests, the details of Sir Ian Kennedy’s expert panel’s scores for Leeds have not been shared with us nor have the errors been rectified. The Pre Consultation Business Case (PCBC) and the final consultation document attempt to describe the process and assumptions that the JCPCT used to shortlist the final four options that had been put to the public…”
It should be noted that there had been no previous request by Leeds for disclosure of the details of the Kennedy Panel’s scores.
Within the same part of the response complaint was made that the ratings given to access and travel times were not consistent with Leeds own polling; challenge was made to the inclusion of Newcastle in three of the four options when it was said that it could only just reach 400 procedures whereas Leeds could easily deliver over 500 and it was noted that the Kennedy Panel had scored current networks in a differential way based on current practice and track records, whereas the scoring of the options had not adopted this approach but had given all potential options the same score.
Comments on matters of “scope” included challenge to the definition of co-location used by the Kennedy Panel; the failure to take adequate account of the population density of Leeds; and assumptions about patient flows. The response also questioned how, if the Kennedy Panel had decided not to score centres on deliverability or achievability, matters such as impact on the workforce, recruitment etc. would be considered.
Leeds proposed an alternative configuration option which replaced Newcastle with Leeds. It did not challenge the principle that Leeds and Newcastle were mutually exclusive as stated in the Consultation Document. Finally, Leeds set out in detail its proposals for future network arrangements, the Kennedy Panel having identified that as a gap in compliance.
Sharon Cheng, Director of CHSF submitted a response to the consultation which expressed strong support for the Leeds centre. The response echoed points made by Leeds, drawing attention to the “gold-standard” co-location of children’s services at Leeds and its extensive cardiac network. The view was also expressed that the provision of NCS had been allowed to dominate. The CHSF response did not challenge the assessments of the Kennedy Panel nor did it ask for the Kennedy subscores.
On 29 June 2011, the JHOSC submitted an initial response to the consultation which questioned the definition of co-location and predicted patient flows from the region. It noted the high level of surgical activity at Leeds, and suggested that too great an emphasis was being placed on NCSs. After the end of the public consultation, the JHOSC made a number of requests for further information which included a request for the sub-scores from the Kennedy Panel. The JHOSC’s full response to the consultation, submitted on 5 October 2011, noted its concern that requests for information, such as the sub-scores agreed by the Kennedy Panel, had not been met.
Thereafter, the JHOSC complained to the Secretary of State pursuant to Regulation 5 of the Local Authority (Overview and Scrutiny Committees Health Scrutiny Functions) Regulations 2002 that the JCPCT’s consultation with the JHOSC had been inadequate and that information requested, including the sub-scores, had not been provided in advance of the consultation deadline. The IRP, considered the complaint, and advised the Secretary of State that it did not recommend a full review into the matters raised. The IRP noted that the detailed breakdown of the Kennedy Panel subscores had not been seen by the JCPCT: “…it was not material to the production of the consultation document, nor will it be material to the decision making process. The JCPCT’s commitment to release this information once it has made its final decision is, in our view, reasonable.” The Secretary of State accepted the IRP’s advice and informed the JHOSC on 23 February 2012. No challenge has been brought to the decision of the Secretary of State.
Further Kennedy Panel Assessment
In August 2011, following submissions from consultees, the JCPCT requested that the Kennedy Panel consider and advise further in relation to three specific matters: (i) alleged factual inaccuracies in the assessments of the Leeds and Leicester centres, (ii) the definition of co-location used by the Panel and (iii) its application in relation to 3 provider centres: the Royal Brompton in London, the Glenfield Hospital in Leicester and the Freeman Hospital in Newcastle. The Panel was asked to consider if any statements of fact required revision and whether there be revision to the previous scoring.
The Kennedy Panel met to consider these matters. Its Report (“Report of Sir Ian Kennedy’s Panel in Response to Questions by the Joint Committee of Primary Care Trusts” dated 17 October 2011 ) rejected the suggestion of factual inaccuracy. It noted that questions had been raised previously about its assessment of PICU reconfiguration at the Leeds centre and its specialist nurse posts – but it had rejected these.
The Price Waterhouse Cooper (PwC) Report
In May 2011, PwC were commissioned to review assumptions about patient flows and clinical networks in the four configuration options being consulted upon. The work focused on 22 postcodes which were broadly equidistant to two or more surgical units. The Newcastle network was of particular concern, because some users of the Leeds unit expressed a preference during the consultation to travel to centres other than Newcastle, should Leeds close. The report found that all networks could be delivered with different degrees of risk. It recognised more reluctance to consider travelling to Newcastle than to other centres. It also found 96% of clinicians stated that they would refer in line with the networks envisaged, and that parents would follow the advice of referring clinicians. Accordingly PwC concluded that, if managed, all the networks in the four options could work.
KPMG work: sensitivity testing and option appraisal
KPMG carried out sensitivity testing and in-depth analysis following the consultation process taking into account the issues raised by consultees and the alternative options
being considered. The scoring of “Quality” was altered to take account of the concern of consultees that it had not received adequate prominence. The principle that Newcastle and Leeds were mutually exclusive remained. New assumptions and options were considered. Option G (including Leeds rather than Newcastle) was one of the new options introduced and scored. Option B received the highest overall score as it scored highest for quality and deliverability. Option G scored well for quality and highest for travel and access and came second in the overall scoring.
The Advisory Group for National Specialised Services (‘AGNSS’) Report
The cessation of paediatric cardiac surgery at three of the providers would necessitate the re-location of one or more of three NCS that require on-site back-up from a consultant congenital cardiac surgeon. AGNSS advised the JCPCT that whereas ECMO services could be developed at Birmingham, there were significant risks in a proposal to move Paediatric Cardiothoracic Transplant and ‘Bridge to Transplant’ services from Newcastle. AGNSS noted the conclusion reached by Birmingham Children’s Hospital, the only other potential provider of transplant services in England, that it was not able to sufficiently address these complex risks. AGNSS also advised the JCPCT that Newcastle provided excellent clinical outcomes for transplant services and had developed expertise in aspects of paediatric cardiothoracic transplantation that were unique to the United Kingdom.
The Decision Making Business Case (‘DMBC’)
In June 2012 the Safe and Sustainable Review of Children’s Congenital Cardiac Services in England was completed in the form of a decision making business case. It included the core recommendation that Option B should be implemented and the designation of congenital heart networks led by the centres contained within it. It was not made public until after the Decision in July 2012. Its purpose was to summarise the key evidence and issues from the consultation and assist the JCPCT in its decision-making. Six new options were considered viable, formally scored and put forward for consideration. These included Option G which contained the same centres as Option B, save that Newcastle was substituted by Leeds. When scored, Option B remained the highest scoring option followed by Option G. Nine sensitivities were tested, and the options rescored. In each of these exercises, Option B remained the highest scoring option.
Section 12, headed “Testing the evidence for option B”, advised:
“[A]lthough the scoring process has consistently highlighted option B as the highest scoring option the JCPCT should not regard the scoring process as determinative. Rather the JCPCT’s decision should be based on a consideration of all of the available evidence in the round, including the evidence for and against alternative options”.
Relevant matters considered in this section included the importance placed by consultees on quality, the definition of co-location, ways to mitigate increased travel times, population density and projections, the “validity of the Newcastle network” and advice relating to the NCSs.
The DMBC identified the importance of high quality care as being one of the most frequently mentioned issues for respondents discussing either specific hospitals or the options more generally. Its importance was reflected in the following at page 154:
“ Some respondents suggested that the outcome of the Kennedy’s Panel Report was that there was no material difference across the centres, such as the suggestion that “all centres are within 95% of the top scoring centre”…
Such was the concern of how the JCPCT should reflect the findings of the panel around the scoring of “quality” that the chair of the Panel, Professor Sir Ian Kennedy wrote to the JCPCT in October 2011:
“the panel is of the view that it’s report has identified important differences in the extent to which the centres can meet the quality standards in the future: panel members have reflected these differences in their scores and in the report. It is our view that the outcome of the panel’s work would be rendered redundant were the JCPCT to interpret the report’s conclusions thus finding that there are no material differences across the centres and their ability to meet the quality standards in the future. This interpretation would not be justified. To repeat, there are important differences.
It is therefore proposed that the sub-criteria “high quality service” has the greatest influence on the total score for quality based on a strong theme from respondents during consultation – that “quality” of service should be the most important of the JCPCT’s considerations…”.
In relation to NCS, the DMBC noted that under Option B transplant services would remain in their current locations. It recalled previous advice from the Steering Group that changes to NCS could be managed but noted that this assumed an alternative safe provider. Whilst Birmingham had been considered a possible alternative, recent capacity testing by the NCS team questioned this, and Birmingham itself doubted that it could develop a Transplant and “Bridge to Transplant” service to replace the Newcastle service within a three year time-frame.
The Decision
On 4 July 2012 the JCPCT met in public to consider and agree the recommendations of the Review, including which option to adopt for the reconfiguration of paediatric cardiac surgical services. In his witness evidence, Sir Neil McKay, Chair of the JCPCT, identified the key issues considered at the meeting and why the JCPCT chose option B:
“There were two key reasons for the JCPCT favouring option B over option G. The issues were quite finely balanced, but the JCPCT was satisfied that the differences were conclusive. Firstly, and as demonstrated by the scoring, option B was the higher scoring option for quality. The second reason related to nationally commissioned services (NCS) and in particular the risks around relocating cardiothoracic transplant services, which would be needed if cardiac surgery services at Newcastle ceased”
Of that risk Sir Neil McKay stated:
“the importance of retaining a safe transplant service was such that the scoring process carried out by the JCPCT (and the earlier quality assessment) would have needed to show a material difference in favour of option G, or there would have had to be another significant countervailing argument in favour of option G in order to counterbalance the risk. Again the issue of transplant was not itself determinative (that is, we did not decide on the basis of the issues relating to Birmingham’s ability to undertake transplants) but it was a significant consideration”.
Claimant’s Case Ground 1
In summary the claimant’s position is:
(i). | Without the scores the consultees could not sensibly, intelligently, or meaningfully respond to all that they had to in respect of the total scores and the Kennedy Report; |
(ii). | The scores were being used comparatively. It is not the claimant’s case that the JCPCT were not entitled to rely on comparative scorings but if so it is a further reason to disclose the sub-scores so as to enable centres to see how they compare and comment upon their comparisons; |
(iii). | The more information that is given the more intelligible and meaningful the response. The more productive and more transparent the consultation exercise the more information will be generated and thus improve the quality of the decision making; |
(iv). | During the consultation exercise Leeds requested the sub-scores as did the JHOSC and CHSF subsequently. If Leeds thought the scores were relevant what good reason was there to refuse disclosure. If disclosure were deemed appropriate after the consultation it makes no sense to have withheld the sub-scores prior to the decision making when disclosure could have been meaningful. |
The Kennedy Panel’s scores were important. They were relied upon by the JCPCT as a proxy for “quality”, high quality service was given the highest weighting to reflect its importance. The scores fed directly into the final decision and were ultimately determinative of it.
In October 2011 Professor Sir Ian Kennedy wrote to the JCPCT indicating that there were important differences between the centres which were reflected in the scores. No consultee, in possession of the Kennedy narrative and only the total scores, could properly understand the “material differences” still less make informed and intelligent consultation responses in respect of the accuracy, or validity of the ranking process, as the absence of the sub-scores rendered it impossible for any centre to know how it had scored upon individual criterion. As to the defendant’s argument that the information used by the Panel emanated from Leeds; the provision of the information cannot and does not provide any indication of the scoring subsequently attached by independent assessors.
Leeds were the most affected centre because they came bottom in the ranking, Oxford having been excluded. As the scores were relevant to the assessment, the breakdown of the scoring should have been disclosed to the centres whether or not the JCPCT proposed to look at it. If there is a public law duty to make information available to a consultee disclosure cannot be denied simply because one party does not wish to look at that information.
The claimant relies on the importance of the scoring against a background in which the chair of the JCPCT at a meeting in November 2011 is noted as having said:
“Members had heard that financially there was little to discriminate between options G and B and that they were the best value for money. While there were many issues to be addressed in implementation, there was no showstopper to suggest that either option B and G could not work…”
Further, on 23 April 2012 the JCPCT met, by this time the advice from AGNSS had been received. It is noted that:
“the Secretariat’s advice to the Committee was that the relocation of the paediatric transplant service was not “a showstopper”; i.e. the issue of relocation of NCS should not dictate the final list of options for consideration on 4 July. However, AGNSS’s advice was very strong evidence which should be fed into the scoring process around deliverability and into a consideration of the options generally”.
As there was no ‘showstopper’ and Professor Sir Ian Kennedy had identified ‘material differences’ Leeds required proper disclosure in order to respond to an aspect of the process which had become central to the appraisal. Following disclosure and consideration of the sub-scores the claimant contends that it has concerns and doubts as to a) the accuracy of the scoring, b) the fairness of using the Kennedy scores as a comparative ranking tool and c) on the evidence then available to the JCPCT a fair comparative assessment of quality as between Leeds and Newcastle should not have ranked Leeds lower than Newcastle.
During the course of the hearing Leading Counsel on behalf of the defendant, the interested party and the Court pressed the claimant as to precisely what the case was as to concerns which could or would have been raised had the sub-scores been disclosed. As a result a schedule was prepared by the parties which represents, in summary, the claimant’s case as to the points which would have been raised following disclosure of the sub-scores. The schedule is attached to this judgement as Annexe1.
Reason for non-disclosure of scores
The reason for non disclosure given by Professor Sir Ian Kennedy is noted in the JCPCT minutes of 28 September 2010. The subsequent refusal of disclosure by the IRP and the Secretary of State relies upon the fact that as the detailed breakdown of the scores had not been seen by the JCPCT it would or could not be material to the decision making process and thus did not need to be disclosed. It is the claimant’s case these are plainly bad reasons.
Was it inevitable that the outcome would have been the same
The short answer is no, nor does the defendant contend that it was. In his statement Sir Neil McKay stated “even if the quality assessment (based in part on the findings of the Independent Panel) or the scoring more generally had favoured Option G in my view this may not have been enough to draw the JCPCT into choosing Option G”. The claimant relies upon the use of the word “may”, it being said that that is sufficient to justify a quashing of the decision for unfairness. The issues of ECMO, transplantation and the advice of AGNSS could never have been the ‘trump cards’ as was acknowledged in the advice that was given to the JCPCT to the effect that there were no “showstoppers”.
Appendix One
During the course of these proceedings Newcastle’s Self Assessment Template was disclosed. In respect of each of the core requirements: e.g. strength of network, staffing and activity, etc. the final question in each section was “Would your ability to meet this core requirement be affected by meeting the minimum stated volume of 400 paediatric cardiac surgical procedures a year? In identical form, in response to each such question are these words: “See appendix one outlining the Director of Finance’s initial estimate of resources required to meet the quality standards and to increase activity.”
In his written evidence Professor Sir Ian Kennedy identified the task of the Panel as including future compliance and the feasibility of proposals for such compliance. Appendix One represented the financial background to any future proposal. The Court was informed that the Kennedy Panel had not seen, and it follows, had not considered the content of Appendix One. No reason was advanced as to why this was.
The claimant’s contention is that Appendix One indicated whether or not future compliance could be achieved, thus proper consideration of its content was of critical importance. Further, this part of the assessment of the core requirements was worth, after weighting, more than 47.5 % of the total available for “Quality”. Shorn of the financial information provided by each centre Newcastle’s answers to this question are simply statements of good intention which cannot properly reflect upon the comparative quality of the centres given the direct and important link of available funding. Thus, how can the scores fairly be relied upon as the determinative criteria in the configuration assessment? This is another cogent submission which an informed consultee such as Leeds is likely to have wished to make to the JCPCT having seen the sub-scores and the disparity in scoring.
Ground (2) Failure by the JCPCT itself to scrutinise or properly take into account the Kennedy sub-scores.
There was a duty on the JCPCT to carry out sufficient inquiry into the matter that was under consideration in Secretary of State for Education and Science v. Tameside Metropolitan Borough Council [1977] AC 1014. A material failure to take into account relevant considerations will justify the quashing of a decision – see R(Alconbury) v. Secretary of State for the Environment Transport and the Regions [2010] UKHL 23.
Where advice is proffered to a decision-maker – (here, by Professor Sir Ian Kennedy in 2011), an improper reason given by that adviser which exerts influence on the decision-maker may vitiate the consultation process or cause the decision-maker to fail to take into account relevant and material information which will vitiate the decision– R(Evans) v. Lord Chancellor [2011] EWHC 146 (Admin); Goldsmith v. WandsworthBorough Council [2004] EWCA Civ 1170.
The claimant relies upon the following: (i) Initially, at least, the JCPCT, or some members of it, thought that there was an expectation that the Kennedy sub-scores and underlying methodology would be disclosed;
To the JCPCT’s knowledge, interested consultees had requested disclosure of the Kennedy sub-scores and this request had been refused;
Sir Ian Kennedy had expressly advised the JCPCT that there were ‘important differences’ between the centres but had also advised them not to seek to look at the underlying data for fear of judicial review. That advice was bad. The JCPCT had an obligation to scrutinise and assess the information which underlay the Kennedy scoring, particularly as it then sought to compare and rank centres when Professor Sir Ian Kennedy had explained that the centres had not been scored one against the other;
As the JCPCT had only the Kennedy Report (or a digested summary of it) there was no way of ascertaining what the ‘important differences’ between the centres were. The ‘key’ to understanding the weight which the Panel had allocated to aspects of ‘compliance’ or ‘gaps in compliance’ were the Kennedy sub-scores;
The reliance on the advice of Professor Sir Ian Kennedy, meant that the JCPCT did not scrutinise the use of the Kennedy scores and the ranking table when they should have done so, in view of the fact that:
The Self-Assessment Template had stated that the scores would not be used directly in the configuration assessment, when in fact that is precisely how those scores were being used;
The Kennedy Panel itself had made clear that the Panel had not scored the centres against each other but in isolation and on their own merits;
The Kennedy scores were now being used as the proxy for ‘high quality service’ in the configuration assessment which necessarily ranked Options against each other, and by necessary implication, would depend on a comparative ranking between centres. Thus the only relevant difference between Option B and Option G, the two highest scoring configuration options, was that Option B included Newcastle in substitution for Leeds. In short the configuration assessment quickly turned into a Leeds vs. Newcastle ‘play-off’, a fact recognised by the JCPCT itself (April 2012).
The JCPCT had a duty properly to scrutinise the use of the scores in the configuration process and to understand what were the ‘material differences’ between the centres which the Kennedy Panel insisted were so important. They failed to discharge their duty to take into account a plainly material consideration, the sub-scores, which were the key to their understanding (a) how the respective scores had been arrived at and (b) whether those scores could properly be used for a comparative assessment in the way they were.
Defendant’s Case
Grounds One and Two
Disclosure of the Kennedy Panel’s sub-scores was not necessary to render the consultation process fair. In particular:
Fairness does not oblige a decision-maker to disclose to consultees the underlying material which has informed judgments or assessments made by those who have advised the decision-maker, it does not even require the disclosure of the advice itself. In any event, disclosure of the advice, and a summary of the reasons for it, was done in this case, and is sufficient. Fairness does not require the disclosure of material which has not been considered or relied upon by the decision-maker;
Consultees were provided with sufficient information to make informed and intelligent responses to the consultation; they did in fact make such representations;
The information analysed by the Kennedy Panel was derived from the centres themselves: they were aware of the detail of such information; consultees had all the information concerning the assessments of the Kennedy Panel which was available to and relied on by the defendant;
Disclosure of the sub-scores would not have promoted sound or efficient decisionmaking, and would have been disproportionate.
The sub-scores did not add in any material way to the information placed before consultees. They were not “the key” to understanding the supposed “material differences” in quality between the centres or the Kennedy Report. Consultees were provided with sufficient information to enable them to understand the areas of strength and weakness identified by the Kennedy Panel in relation to each centre, and the differences between them. Most of the points now advanced by the claimant could have been, and in some instances were, advanced on the basis of the information provided to consultees. The history of the consultation shows that consultees were not prevented from probing the qualitative assessment made by the Kennedy Panel. Leeds, CHSF and other supporters of the centre made detailed representations as to why they felt the quality of Leeds had been underestimated, including by comparison
with Newcastle. Challenges to the process were pursued. The Kennedy Panel reconsidered matters put to it and the defendant sought further advice from others, including PwC.
The configuration assessment depended on a number of criteria, of which quality was only one. The scores for “high quality service” depended on the number of the high or lowest ranking centres which were included in each option. Reliance is placed upon Sir Neil McKay’s evidence that when the Decision was made, scores were only one mechanism used to inform the defendant’s thinking:
“Although the Independent panel’s work was a major part of the assessment of “quality” it had no bearing on the JCPCT’s assessment of deliverability, as set out below. I want to make it clear again that it was not just the scores themselves that informed the JCPCT’s conclusions. The final decision was the product of two years of analysis and evaluation by the JCPCT, in the largest single service reconfiguration analysis that the NHS has undertaken to date”.
The Kennedy scores were not determinative of the configuration assessment. If this were correct, it would be expected that the Brompton Hospital would appear in the reconfigured option, having been ranked fourth equal with GOSH. Equally there would be no place for Liverpool ranked fourth from the bottom below Newcastle.
In the configuration assessment, a very significant factor in preferring Option B to Option G was that Newcastle was one of only two centres to provide the nationallycommissioned transplant and bridge to transplant service. It was essential to retain two centres for this service, and the evidence before the JCPCT showed that transferring the service to another centre would carry significant safety risks. Thus, even if disclosure of the Kennedy Panel sub-scores might have permitted additional representations on the relative quality of Leeds and Newcastle to be made, it is very unlikely that such submissions would have affected the Decision.
Disclosure of the sub-scores was not necessary to render the process fair, it was unlikely to improve the quality of the decision-making. The sub-scores were not material which the JCPCT was obliged to take into account when making its decision.
Further, the decision not to disclose the sub-scores has already been the subject of independent scrutiny by the IRP and thereafter the Secretary of State. No challenge has been brought to the decision of the Secretary of State, although Councillor Illingworth, the Chair of the JHOSC, seeks to make the same complaint in his evidence in these proceedings.
Reason for non disclosure
As Sir Ian Kennedy explained, the aim was to safeguard the integrity of the process. The reference to judicial review was “a caution that the process as a whole needed to be conducted fairly, and with considerable care, and of the dangers of the JCPCT acting beyond its expertise”. Sir Neil McKay’s view was that the narrative in the Kennedy Report was sufficient; it was this which informed its decision-making. As Professor Sir Ian Kennedy had pointed out to “check” their work would have required
the JCPCT to have access to all the evidence to which the Kennedy Panel had access. This was impossible and disproportionate. The JCPCT was entitled to entrust the task of assessment to an expert Panel, and to consider the Panel’s report of the outcome of that work, and its final judgments (the overall scores) on each centre. The material considerations, to which the JCPCT was obliged to and did have regard were the views of the Panel and the reasons why it had formed those views.
The receipt of a “flood” of such material from consultees would have greatly increased the complexity, length and cost of the consultation process, to no public benefit. Not only was the decision not to consider or disclose the sub-scores one which the defendant was entitled to make: it was a sensible and proportionate decision, conducive to efficient decision-making. Disclosure would have made no difference
On the facts, it cannot sensibly be argued that disclosure of the sub-scores would have altered the Decision of the JCPCT to chose Option B:
Sensitivity testing undertaken to address the complaint that the merits of Leeds as a centre had been underestimated, still resulted in Option B scoring higher than
Option G;
The Kennedy Panel assessment and scores were only one element in the decision to select Option B. A vital element in evaluating the configuration options was that Newcastle provided NCS; in particular a transplant and bridge to transplant service, which the JCPCT was advised could not safely be developed at an alternative centre within acceptable time scales. The JCPCT was entitled to give this factor considerable weight.
In the circumstances, there is no realistic prospect that disclosure of the sub-scores would have affected the decision of the JCPCT.
Appendix One
The assumption that Appendix One was relevant material which the Kennedy Panel had to assess in order to evaluate Newcastle’s response to the identified question (c) is incorrect. What the question required was an explanation from each centre of the way in which its services and facilities would have to be extended and how they would implement such expansion including the risks attendant upon it in order to meet the minimum number of 400 procedures per year. It did not require the centres to state how the expansion would be funded. The fact that Newcastle referred to Appendix One, a financial appendix, in respect of its answer to question (c) does not make the document relevant to the Kennedy Panel’s assessment of those answers. The Kennedy Panel did assess question (c) as demonstrated by the witness statement of Professor Sir Ian Kennedy and the analysis in the Kennedy Report which contains judgments of the centre’s development plans. The financial appraisal of the centres was carried out by the Secretariat/ NSC Team in conjunction with the centres and local commissioners and the conclusion was that all potential configuration options were affordable.
Ground Two
The following additional points, were made in response to Ground Two. The defendant relied on the judgment of the independent experts it had appointed but also had available to it the full explanation of their judgment and reasoning. It challenged and scrutinised the advice received to the extent that it was both necessary and proportionate to do so. The JCPCT was entitled to entrust the task of assessment to the Panel and to consider the Report of the outcome of that work and its final judgment. The material considerations to which the JCPCT was obliged to have regard and did; were the view of the Panel and the reasons why it had formed those views. It is not accepted that the advice given by Professor Sir Ian Kennedy was bad advice, in any event, it is irrelevant. The question for the court under Ground Two is whether the sub-scores were or were not a material consideration to which the defendant was obliged to have regard.
The Interested Party
The Newcastle Upon Tyne NHS Foundation Trust comprises a cluster of hospitals in Newcastle which include the Freeman Hospital and within it the site of the Cardiothoracic Centre, the Children’s Heart Unit and the Institute of Transplantation; other specialist units include the Northern Centre for Cancer Care, the Liver Unit and the Great Northern Children’s Hospital. The interested party had not intended to become involved in these proceedings but following service of a number of witness statements by the claimant which were said to contain inaccurate and professionally derogatory information the Trust felt an obligation to set the record straight. The interested party filed a number of statements properly identifying the facilities and the care provided at Newcastle. It is the only Trust in the country to provide all cardiac care from conception, through birth, childhood and adulthood. The Freeman Hospital is one of only two children’s cardiac pulmonary transplant units in the UK, it is among the top 5 centres in the world, within this field and has an international reputation.
In skilful and succinct submissions Miss Morris QC on behalf of the interested party sought to identify its strengths as a centre and in general terms supported the case for the defendant. During the course of these proceedings there appear to be a retraction, of sorts, of part of the evidence given by one of the claimant’s witnesses in respect of Newcastle. Mr Havers QC made clear that it was no part of the claimant’s case to cast aspersions on the quality of the care or the facilities provided by Newcastle. The Court was grateful for the clarification. In view of this clarification and the interested party’s support for the case of the defendant, I hope I do no disservice to the quality of its submissions if I specifically consider the submissions made on behalf of the defendant.
The claimant’s standing within these proceedings
The defendant submits that the claim should be dismissed because the claimant does not have a sufficient interest in the matter to which it relates contrary to Section 31 (3) of the Senior Courts Act 1981 which provides that the court should not grant [permission] unless it considers that the applicant has a sufficient interest in the matter to which the application relates. The defendant submits that the claimant is a shell company, founded solely for the purpose of this litigation. It has taken no part in the consultation process. As a corporate entity it has no involvement in the provision of paediatric cardiac services, it is not affected by the decision which it seeks to challenge.
It is unclear who the claimant is or whose interests it represents. The claimant is supported by representatives of the Leeds’ centre of the CHSF and the Chairman of the JHOSC. CHSF’s response to the Consultation Document made no reference to nor request for the Kennedy Panel’s sub-scores. The JHOSC’s request and subsequent complaint in respect of the sub-scores was dealt with by the Secretary of State in respect of whose decision no challenge has been raised.
As to the Petition on which the claimant relies it is the defendant’s contention that the Petition was organised and submitted by CHSF. The financial contribution came largely from CHSF which is unable to bring this claim because of advice received from the Charity Commission in September 2012 namely that bringing the claim might be incompatible with the aims of the charity whose object is the “advancement of the relief of sick children, and adults with congenital heart conditions, within the Area of Benefit”; the point being that Newcastle came within the same area. Further the Petition states its support for the Leeds centre but there is nothing to suggest that the signatories support the de-designation of Newcastle.
The claimant contends that it has sufficient interest. Sufficient interest is the remedy afforded by judicial review; in this case the quashing of the reconfiguration decision on the grounds that the consultation process was unfair and flawed. The claimant plainly has an interest in that remedy. The majority, if not all of the individuals who have contributed to the fighting fund, together with the Directors of the claimant, would have a direct sufficient interest in their own right had they brought the claim as individuals. Some of those individuals are clinicians, others are members of the public. The adverse costs in litigation are such that no citizen of ordinary means would prudently contemplate bringing this litigation as an individual. Incorporation was and is the proper means of allowing the interests of a substantial number of persons who consider the defendant’s decision to be unfair and unlawful to be jointly represented. There is no obvious better placed challenger, in fact there is no other challenger.
I am satisfied that the claimant has sufficient interest in these proceedings. The claimant represents many individuals who have contributed financially in order to bring these proceedings. It includes individuals who have been or could be directly affected by the closure of the Leeds Unit and clinicians who work within the unit. Incorporation, following the intervention of the Charity Commission, was a proper means of allowing the interests of a substantial number of such persons to pursue this litigation.
Conclusion
This was a comprehensive consultation, lasting a matter of months and prompting 77,000 responses. Thought and care was given to the consultation process both as to its content and implementation. When considered necessary, independent work or advice was commissioned; professional groupings provided advice when requested. Those responsible for, and involved in, the setting up and implementation of this process aimed to provide one which was informed, detailed and transparent.
One aspect of the process were the assessments of the relevant centres provided in the form of scores by the Kennedy Panel. As an independent panel, primarily comprised of experts in the relevant field, it is accepted that their scoring would involve the exercise of professional judgment. As the process of evaluation developed, the importance of the criteria of quality increased and within it the sub-criterion of high quality service for which the Kennedy scores were a proxy.
The minutes of the JCPCT meeting 1 September 2010 note that Oxford was to be excluded from all options because it scored so significantly lower than its nearest comparator. Sir Neil McKay was asked whether any other centres should be excluded, given that quality became more important amongst closely ranked centres. It is recorded that he “summarised that quality would have to be the distinguishing factor…”.
In the DMBC, Ipsos Mori reported of the public consultation that:
“the quality of care provided was the most frequently mentioned issues for respondents discussing either specific hospitals or the options more generally. In fact, quality of care featured heavily throughout the consultation responses, as each of the questions posed in response form and in the letters and emailed requests submitted. There was a strong belief amongst many that quality should be the deciding factor in service planning.”
To reflect the importance to be attached to this criteria “Quality” was given a weighting of 39/ 100 whereas Sustainability was given 25, Deliverability 22 and Access and Travel 14. Of the Quality criterion the DMBC records that the subcriterion for “high quality service has the greatest influence on the total score for quality based on the strong theme from respondents during the consultation – that
“quality” of service should be the most important of the JCPCT’s considerations…” 108. The DMBC identified the total scores for ‘Quality’ as being:
Option B 3 Option G 2
Option B Option G
High quality service 3 2 Innovation and research 3 3 Clinical networks 2 3
___ ___
8 8
The totals of the sub-criteria scores were identical. It was the weighting given to ‘high quality service’ which resulted in an additional point for the overall score for ‘Quality’ for Option B. Immediately below the table it was stated that the proposed scores for the sub-criterion of high quality service were based on the scores applied by Professor Kennedy’s Panel.
In my view these figures demonstrate:
the comparative closeness of the scoring;
the weighting attached to ‘high quality service’ reflective of its importance in the context of the overall scoring;
the significance attached to the Kennedy Panel’s scores in the scoring of ‘Quality’, itself an important factor.
I do not accept the defence description of the sub-scores as being no more than ‘underlying workings’. They provided the basis for the consensus score which was ultimately used as one of the most valuable and thus significant tools in the assessment of ‘Quality’ of the respective centres.
The DMBC advised the JCPCT to consider the extent to which each option included the three highest scoring centres (which would increase an option score) and the three lowest scoring centres in any option (which would lower an option score). Liverpool, Leicester and Leeds, in that order, were the lowest scoring. Newcastle was immediately above Liverpool, fourth from bottom. The point made on behalf of the defendant was that in order for there to be any real change not only would Newcastle have to come down the rankings, Leeds would have to move up. It is, however, of note that although Leeds was at the bottom of the rankings Newcastle was just outside the last three, some five points ahead of Liverpool.
The closeness of the scoring and the relationship of those scores to Leeds was noted at the public meeting of the JCPCT on 4 July 2012. The note of the meeting includes the following:
“Mr Buck noted that the proposed scores for B and G were three and two respectively and the only difference was the presence of Leeds. Miss Banks confirmed this; Leeds had scored less well than Newcastle in the Kennedy Assessment which was the reason for this result. Mr Glyde explained that the report was in the public domain but the Committee had decided not to consider the sub-scores so it could not respond as to the specific strengths and weaknesses in each trust. For that reason, KPMG had focused on the overall score, which had placed Newcastle higher than Leeds in terms of overall compliance with standards. However, the next agenda item would explore the submissions put to the Committee of the relevant strengths of its service compared to Newcastle.”
The claimant relies on this entry as demonstrating the point at the core of its challenge. The scoring is close, the only difference between B and G being the presence of Leeds which scored less well by reason of the Kennedy assessment. Crucially, the JCPCT acknowledged that it could not respond to the specific strengths and weaknesses in Leeds and Newcastle because it had decided not to consider the sub-scores. Mr Havers QC summarised the position thus: QED.
The question for this Court is: did the duty of fairness require disclosure of the Kennedy Panel’s sub-scores? The sub-scores represented an expert evaluation which translated into a score which was the purpose of the assessment exercise. In my view the following matters are relevant to this question:
The score assumed increasing importance and thus significance in the evaluation process and was ultimately determinative of the difference in the ‘Quality’ score as between Leeds and Newcastle;
The importance of ‘Quality’ has to be considered against a background in which a) it was identified as an important component by the many respondents to the consultation process; and b) ‘important’ and ‘material differences’ between the centres were said to have been identified by the Kennedy Panel, hence the advice given in October 2011 and recorded in the DMBC;
The DMBC advised the JCPCT that ‘high quality service’ had the greatest influence on the total score for ‘Quality’ and that ‘quality of service’ should be the most important of the JCPCT’s considerations;
The Chair of the JCPCT identified ‘two key reasons’ for favouring Option B, the first being B’s higher scoring for ‘Quality’;
This was a consultation process relating to the provision of paediatric cardiac surgical services; a matter of the highest importance to any child requiring such care and his or her family.
Leeds, together with the other centres, was given a Self-Assessment Template which provided considerable detail as to the process. It completed the Template, received feedback and, subsequently, the total score and the narrative contained in the Kennedy Report. Was this sufficient? Leeds did not consider it to be so because in its response to the Consultation Document it requested the sub-scores, the JCPCT refused the request. I do not regard Leeds’ request as unreasonable. I accept the claimant’s contention that ‘Quality’ was not well differentiated in the Kennedy Panel scoring. The narrative in the Kennedy Report identified areas of compliance and noncompliance, but, this was not an audit, it was scoring.
As to the submission that as the information emanated from Leeds it would know what it was providing; this, in my view, misses the fundamental point namely that Leeds did not know how such information was being evaluated and scored. On any view the information was of relevance. For the reasons identified it became significant in the context of the process.
The sub-scores provided the clearest indication of the Panel’s judgment upon separate sub-criteria. The fact that such scoring contained an exercise of professional judgment does not preclude it from being a useful guide to the assessment still less prevent any request for reassessment or reappraisal. As evidence of the JCPCT’s willingness to revert to the Kennedy Panel when queries arose relevant to their assessment are the instances when the JCPCT referred questions from Leeds and Leicester for further consideration. A similar process could have been carried out in respect of any queries upon sub-scores. Had this been done Leeds would have been better informed as to how to direct its response upon specific issues which became central to the appraisal process.
The submission that, in any event, the importance of the transplantation work at Newcastle would have ‘trumped’ the Leeds bid is at odds with the comment of Sir Neil McKay that following the AGNSS Report there were no ‘showstoppers’ and by
his concession identified in paragraph 75 above. Further, the argument that disclosure of the sub-scores would have made no difference to the final result given that Option B maintained its highest score during sensitivity testing ignores the point that within such testing the same scores based upon the same sub-scores were being used.
For the reasons identified in paragraphs 112-116 above I am satisfied that fairness did require disclosure of the sub-scores to enable Leeds to provide a properly focussed and meaningful response. The refusal of the JCPCT to a specific request by Leeds for disclosure was, in my view, ill judged. The JCPCT was on notice of the importance of the criteria of ‘Quality’ and within it the use being made of the Kennedy Panel scores. With these considerations in mind, even if the JCPCT chose not to look at the subscores, consultees should have been given such an opportunity.
Scores used as comparators
In essence the claimant’s case is that as the scores were being used by the JCPCT as comparators as between the centres this adds weight to the argument for disclosure of the sub-scores. There is no good evidence as to the thinking or practice of the JCPCT upon this point. A Secretariat briefing paper was relied upon but that goes only so far and is not direct evidence of what the JCPCT thought. In any event, the claimant, having succeeded upon the substance of Ground One, this submission takes the case little further.
Appendix One
The inclusion of Appendix One in the claimant’s case arose following disclosure of Newcastle’s Self Assessment Template. It was not identified at the outset of these proceedings. It has not been directly commented upon in witness statements provided by the defendant, that is an observation not a criticism. In the absence of specific evidence I proceed with a considerable degree of caution. In my view there is force in the defence submission that reference to the financial appendix was not relevant to question (c). If that is correct, why did Newcastle include the reference in its identical answers to the same specific question? As the evidence stands there is no satisfactory, or indeed, any answer. The defendant contends that this issue has nothing to do with the non-disclosure of the Kennedy Panel’s sub-scores, it is the claimant’s case that it would have further added to the need to disclose those sub-scores. Given the unsatisfactory evidential position relating to this late point I do not believe the Court is in a position to make a determination.
Ground 2
The sub-scores provided the basis for the consensus score which was ultimately one of the most significant tools in the assessment of ‘Quality’ of the respective centres. The JCPCT knew that one of its observers (Dr Carroll) had raised the issue of scrutiny of the sub-scores, as had consultees. The JCPCT also knew that ‘Quality’ was becoming more significant as the process developed. In my view, and commensurate with their duty to properly scrutinise and assess all relevant evidence, the JCPCT should have considered the sub-scores. The JCPCT’s stance, to the effect: ‘it is appropriate to leave this to the experts’, failed to reflect the significance of the subscores in that they provided the basis of what ultimately was the difference of one point in the critical ‘Quality’ scoring as between Leeds and Newcastle. If the JCPCT
wished for clarification it could have sought the assistance of the Kennedy Panel. It follows, and I so find, that the sub-scores were a material consideration. Accordingly I find that the claimant succeeds upon its challenge upon Ground Two.
Annexe One
A.Witness complaint about KP assessment of Leeds | B.Communication of KP assessment during the Review | C.Was the issue addressed during the Review? | D.Claimant’s response to D’s submission |
Leadership and Strategic Vision KP was wrong to criticise the Trust’s strategy as not giving sufficient emphasis to paediatric cardiac surgery: Hunter §21 [5/13/213] | Feedback letter [8/9/79] Kennedy Panel Report December 2010 [1/8/201] | Not raised by Trust (see Hunter w/s §21 [5/13/214] | C scored 3/5. ‘Acceptable’ C. did not know this. It appeared from the KP narrative ‘compliance’ that ‘The Trust’s overall strategy is clear, and demonstrates a clear direction of Travel for the Trust as a whole’ One might have thought a score of ‘4’ or ‘5’ was appropriate. One couldn’t guess that the matter mentioned in narrative would result in a score of ‘3’ acceptable. Had Leeds known the scores they could have made submissions on this point as said in Hunter’s statement. |
Strength of Network KP was wrong to criticise the Trust’s lack of plans to provide an effective Network in the north: Hunter §40.1- 40.3 [5/13/223-225 | Feedback letter [8/9/79] KP Dec 2010 Report “no robust development plans” [1/8/204] | Response to consultation includes section on “future network arrangements” [3/1/12] | Having identified that the existing network was ‘strong’ Leeds only scored, 4, 4, 3 for the respective questions. 4 when they might reasonably have thought they would score 5, and 3, on the most weighted question, when they might reasonably have scored at least 4. Had they had the scores, Leeds could have focussed on these issues in their consultation response and sought a remarking of these aspects of the assessment based on further evidence. |
A.Witness complaint about KP assessment of Leeds | B.Communication of KP assessment during the Review | C.Was the issue addressed during the Review? | D.Claimant’s response to D’s submission |
Without the scores they did not know to what extent, if at all, the identified ‘gaps in compliance’ weighed with the Panel. They were have been shooting in the dark. | |||
Staffing and Activity KP was wrong to criticise staffing capacity in PICU Hunter §41-43 [226-227] | Feedback letter [8/9/79] KP Dec 2010 Report – does not meet minimum activity thresholds and concerns about consultant cover for PICU [1/8/206] | Correspondence about PICU configuration alleged to be “factually inaccurate” [10/13/250251, 10/15/256-257, and 10/19/271], KP Report October 2011 [3/4/63-64] | Again it is the scores that explain what weight if any, is attached to particular issues. The 400+ staffing and activity question was worth a maximum of 80 points. Leeds scored 3 x 16 =48), and would been able cogently to argue for a 4. That alone would have resulted in Leeds obtaining 16 more points overall. Leeds would have argued that objectively they should have scored better than Newcastle, on the basis of the evidence given. Newcastle however also scored 3. No such argument could be made without the scores. |
Staffing and Activity KP was wrong to criticise the division of the PICU: Blackburn §10 [5/14/229234]; Darowski §8-9, 11 [5/8/142-144] | Feedback letter [8/9/79] “concern about sustainability of current model for paediatric intensive care across two sites” KP Dec 2010 Report [1/8/206-207] | As above | Again, without the scores this is rather a meaningless item of ‘non-compliance’. Based on the evidence it is able to provide Leeds would have been able to argue for a re-mark upwards. It seems that when KP agreed to recognise that the two PICUs were divided by a corridor |
A.Witness complaint about KP assessment of Leeds | B.Communication of KP assessment during the Review | C.Was the issue addressed during the Review? | D.Claimant’s response to D’s submission |
and not located in different hospitals they did not concede that the thrust of the criticism should be withdrawn. Armed with the scores they could have pointed out that they provided consultant cover and Newcastle did not. | |||
Interdependent Services KP failed to appreciate the value of co-location: Darowski §§13-15 [5/8/145-147] | KP Dec 2010 Report [1/8/167, 207] | Responses to consultation: Leeds [3/1/1-3, 8]; Darowski (Paediatric Critical Care Network) [16/15/276a-c]; CHSF [3/2/34-35]; JHOSC [12/5/43-46]. KP Report October 2011 [3/4/65-68] DMBC [3/7/169] | The point here is that it was the scores that mattered in comparison to Newcastle. Leeds scored 5,5,4 to Newcastle’s 4,4,3. Leeds would have been able to argue in a focussed way for a 5, re. the 400+ question, where the only relevant criticism was the panel did not feel assured that there were strong plans in place to achieve the move of patients to the network. Leeds would also have been able to point out that the differential between Leeds and Newcastle did not represent what it perceived as the gulf between the centres. |
Facilities and Capacity KP was wrong to mark Leeds down for having long waiting lists: Illingworth (2) §16(i) [5/10/166-167] | KP Dec 2010 Report “long-waiting lists ...not sufficiently identified as a risk [1/8/202] and “inefficiencies in current working practices” [1/8/209] | Not responded to by Leeds JHOSC response to consultation [12/5/47 ] | Again without the scores (Leeds in fact scored 3,3,3 to Newcastle’s 4,4,4), Leeds could not mount a focussed attack on the supposed compliance deficiencies that resulted in a lower score. The issue (in the comparative |
A.Witness complaint about KP assessment of Leeds | B.Communication of KP assessment during the Review | C.Was the issue addressed during the Review? | D.Claimant’s response to D’s submission |
assessment between Newcastle and Leeds) was worth 14 points overall. One can see from the KP report that Newcastle had a key gap in compliance ‘concerns over capacity in PICU’. Which does not appear to be reflected in its uniformly higher scores. Indeed one learns from Newcastle’s self assessment template that an additional wing was required that could only be accommodated subject to funding [CB1/2/28]. As Leeds has now learnt, the KP did not assess the financial viability of these plans at all. | |||
Leadership and Strategic Vision Score for Estates and IT was unfair: recently reconfigured services and creation of Children’s Hospital showed great leadership and vision Hunter §22-26 [5/13/214] | Feedback letter [8/9/79], Dec 2010 report [1/8/201] | Leeds refer to estate reconfiguration and Children’s Hospital in self-assessment Template [1/3/45] and in Response to consultation [3/1/2-3] Hunter did not submit document referred to in her w/s §21 | The same point as already made above. Without the scores Leeds could not know the importance or weight attached by the Panel to the matters identified in its narrative report. The focussed comments Leeds would have been able to make are articulated by Ms Hunter. They would have allowed Leeds to submit that Leeds ought to have scored 4 rather than 3 on two or three separate aspects of the assessment. |
Strength of Network Differential in scores | Submission (formulated in §7 | Submission made in Leeds’ response to | The points above are repeated. Without the |
A.Witness complaint about KP assessment of Leeds | B.Communication of KP assessment during the Review | C.Was the issue addressed during the Review? | D.Claimant’s response to D’s submission |
should be greater: Illingworth §§39-41 [5/10/176]; Hunter §§27- 40.3 [5/13/217-225]; Watterson (4) §§9-12 [5/9/154] | Counsel’s written note 11.02.13) relies on KP Dec 2010 Report See also Note on PwC Report | consultation [3/1/7-8]; and JHOSC [17/1/17 §32] | scores, it is impossible to know what if any weight has been attached to what aspects of the identified ‘compliance’ or ‘gaps in compliance’ either in respect of Leeds in isolation, or in comparison with Newcastle. Leeds would have had a strong argument for a re-mark where Leeds only scored 4,4,3 to Newcastle’s 3,4,3. |
Staffing and Activity Scores not fair reflection of reality given Leeds had more staff and operating with waiting lists: Illingworth §42 [5/10/177], Hunter §42 | Submission has no factual basis: centres have same staff patient ratio. See Kennedy w/s §35 [6/6/48] is a qualitative not numerical assessment KP Report Dec 2010 identified waiting lists as a risk [1/8/209] | Response to consultation compared L with N PICU [3/1/11] | Again, the point relates to the actual scores given under each heading. Armed with the scores a focussed criticism could be made that Leeds had been undervalued by the assessment panel on the basis of the objective evidence. |
Facilities and Capacity Unclear why Newcastle scored so much higher than Leeds: Illingworth §42 [5/10/177] | No substantive submission is made. Sub-scores do not answer the question posed – why Newcastle scored higher | The sub-scores reveal that Leeds 3,3,3, scored lower than Newcastle 4,4,4, on each sub-question. Whether these are fair comparative scores knowing what Leeds knows about its own facilities and what it can read from the KP report about Newcastle’s is precisely the sort of focussed submission Leeds would have been able to make. | |
Age Appropriate Care Scores do not reflect differences between the centres – Leeds children are | KP Dec 2010 report makes it clear Freeman is not an adult hospital. Hunter’s repeated | Point made in Response to consultation [3/1/2-3 ] | Leeds scored 4,4,3, Newcastle 3,4,3. Yet Leeds children are treated in a dedicated |
A.Witness complaint about KP assessment of Leeds | B.Communication of KP assessment during the Review | C.Was the issue addressed during the Review? | D.Claimant’s response to D’s submission |
treated in a dedicated Children’s hospital: Watterson §30-32 ; Hunter §44 [5/13/227] | assertion to contrary is incorrect. See Hasan (1) [5/16/249-253, 257] and (2)[ 5/17/297 - para 5.10: Watterson misunderstands relationship: Freeman unit operates as part of the Children’s Hospital ] | hospital and Newcastle is not. How Newcastle managed to score 4, to Leeds 3, on development plans is unexplained by the Kennedy narrative which says ‘the panel did not deem all development plans complete as they did not demonstrate a grasp of the risks associated with sustaining the provision of age appropriate care’[CB1/8/169] Leeds would have been able to make a focussed submission for a remrk, and an increase from 3 to 4. | |
Interdependent services Score did not properly reflect the differences: notably that Leeds is a single-site hospital Illingworth (2) §41(c) [5/10/177], failed appreciate value of colocation Darowski §§14, 16, 17 [5/8/146] | KP approach to assessment of colocation in Dec 2010 report [1/8/167, 207] | Point made by many respondents to consultation eg Leeds Response [3/1/1-3, 8]; JHOSC [12/5/43-46] Darowski [16/15/276a-c] Revisited in KP Report Oct 2011 [3/44/65-68] | The points above are repeated. |
Information and choices Leeds should have got a higher score on “choices” to show respect for review’s patient choice agenda; Watterson §47 [5/1/20] | The PwC work on patient flow is irrelevant to this criterion. This criterion is about ensuring patients and their families have access to good information and support | CHSF made the submission in consultation that indicated networks went against principle of patient choice [3/2/37] Considered and rejected by D (decided that was consistent with principle): DMBC [3/7/110] and 4/7 meeting [3/9/281-282] | PwC is not irrelevant. It is objective evidence that undermines the assumption that the Kennedy Panel truly assessed quality. The points above apply as to focussed submissions on issues by reference to the scores. On Information and Choices Leeds scored 4,4,3, to Newcastle’s 3,3,3. The real focus would have been on |
A.Witness complaint about KP assessment of Leeds | B.Communication of KP assessment during the Review | C.Was the issue addressed during the Review? | D.Claimant’s response to D’s submission |
Leeds’ score of 3 on the 400+ question, particularly in the light of the very positive KP ‘compliance’ narrative at [CB1/8/211] and the limited area of noncompliance identified on the same page. This alone would have been worth 5 points. |