The review addressed a clear research question supported by appropriate inclusion criteria. Searching for relevant studies was limited to studies published in English from only one electronic database and inspection of reference lists, so it is possible that some studies may have been missed. The authors did not state how many reviewers selected studies for the review or extracted data, so reviewer error and bias cannot be ruled out. Some of the studies were phase I, II, III or pilot clinical trials but the remainder were retrospective and none were assessed for quality, which made it difficult to interpret the reliability of the findings. Characteristics of the participants were not reported, so it was not possible to determine applicability or whether there were risk factors relating to participants which influenced the outcome.
Features of the intervention varied between trials and the authors appropriately compared incidence of carotid blowout in subgroups. Subgroups were defined either in terms of regimen of re-irradiation, or according to whether chemotherapy was used concurrently or salvage surgery preceded the intervention. However, for some studies details were insufficient for allocation to an appropriate subgroup and the authors excluded these studies in sensitivity analyses to determine whether the findings differed.
Although there was potential bias in the review process, no assessment of quality and clinical heterogeneity between studies, the authors' cautious conclusions appear appropriate and are likely to be reliable.