User-Agent: * Disallow: /cgi-bin/ Disallow: /assets/ Disallow: /modx/ Disallow: /wordpress/ Disallow: /wp/