User-agent: * #Disallow: /assets/ #Disallow: /site/ ##