User-agent: * Allow: /sitemap.xml Disallow:*admin* Disallow:*login* Disallow:*pdf* Disallow:*?*