# Define access-restrictions for robots/spiders # http://www.robotstxt.org/wc/norobots.html # By default we allow robots to access all areas of our site # already accessible to anonymous users User-agent: * Disallow: # Add Googlebot-specific syntax extension to exclude forms # that are repeated for each piece of content in the site # the wildcard is only supported by Googlebot # http://www.google.com/support/webmasters/bin/answer.py?answer=40367&ctx=sibling # Plone 3, ZWiki (from editform down) and Quills (from topics) excludes User-Agent: Googlebot Disallow: /*sendto_form$ Disallow: /*folder_factories$ Disallow: /*acl_users$ Disallow: /*setskin$ Disallow: /*editform$ Disallow: /*useroptions$ Disallow: /*subscribeform$ Disallow: /*diff$ Disallow: /*recentchanges$ Disallow: /*revisions$ Disallow: /*manage_change_history_page$ Disallow: /*external_edit$ Disallow: /*vote$ Disallow: /*object_cut$ Disallow: /*object_copy$ Disallow: /*delete_confirmation$ Disallow: /*object_rename$ Disallow: /*vote$ Disallow: /*topics$ Disallow: /*authors$ Disallow: /*folder_contents$