User-agent: *
Disallow: /archives
User-Agent: W3C-checklink
Disallow: /links/tags.php
Disallow: /weblog