Publication bias is just one type of a group of biases termed reporting bias. We have quite a lot of evidence that these biases exist, so it is fair to assume that most systematic reviews will be subject to reporting bias to some extent.
Publication bias and other related biases can be summarised as statistically significant, 'positive' results being:
- more likely to be published (publication bias)
- more likely to be published rapidly (time lag bias)
- more likely to be published in English (language bias)
- more likely to be published more than once (multiple publication bias)
- more likely to be cited by others (citation bias)
All of these reporting biases make positive studies easier to find than those with non-significant results, something that we can try to minimise by extensive searching.
Managing publication bias
If we accept that your review will almost certainly be subject to publication bias to some extent, we are left with the problem of estimating how big a problem it is in your review, and what to do about it. There are several methods for getting an idea about how much of a problem this may be, and the method available in RevMan is the funnel plot. This means you should use the funnel plot option to investigate the presence of publication bias in your review and then discuss this in the Discussion section of the text of your review. If you suspect there may be a problem in your review, you need to bear this in mind when making your conclusions and recommendations. The likeliest scenario is that the results of your review are biased to the positive.