Isn't that how Yahoo worked in the early days? They had humans categorize web sites? Well, the only way to make that scale massively is exactly what amazon (mentioned in the article) currently does...have human reviewers work (but for free.) Google essentially did the same thing with pagerank.