# Default modx exclusions User-agent: * Disallow: /assets/cache/ Disallow: /assets/docs/ Disallow: /assets/export/ Disallow: /assets/import/ Disallow: /assets/modules/ Disallow: /assets/plugins/ Disallow: /assets/snippets/ Disallow: /install/ Disallow: /manager/ # For sitemaps.xml autodiscovery. Uncomment if you have one: # Sitemap: http://www.webvivantpress.com/sitemap.xml User-agent: BecomeBot Disallow: / # Google Images User-agent: Googlebot-Image Disallow: / # images.live.com User-agent: MSNBot-Media Disallow: / # old MSN picsearch bot User-agent: psbot Disallow: / # archive.org - wayback machine User-agent: ia_archiver Disallow: /