User-agent: * Allow: /assets/js/ Allow: /assets/images/ Disallow: /assests/ Disallow: /assets/ Disallow: /cgi-bin/ Disallow: /test/