Faculty of 1000, the post-publication peer review service, has been looking at a new alternative to the journal impact factor. The F1000 Journal Rankings are based on the evaluations provided by the site’s contributors. The approach is based on qualitative judgements and uses an algorithm developed collaboratively. The biggest problem seems to be whether to permit evaluations by editors of articles in their own journals.