User-Agent: * Allow: / Allow: /md/ Allow: /llms.txt Allow: /llms-full.txt Disallow: /app/ Disallow: /auth/ Disallow: /api/indexnow User-Agent: GPTBot Allow: / Allow: /md/ Allow: /blog/ Allow: /faq Allow: /about Disallow: /app/ Disallow: /auth/ User-Agent: ChatGPT-User Allow: / Allow: /md/ Allow: /blog/ Allow: /faq Allow: /about Disallow: /app/ Disallow: /auth/ User-Agent: Google-Extended Allow: / Allow: /md/ Allow: /blog/ Disallow: /app/ Disallow: /auth/ User-Agent: anthropic-ai Allow: / Allow: /md/ Allow: /blog/ Allow: /faq Allow: /about Disallow: /app/ Disallow: /auth/ User-Agent: PerplexityBot Allow: / Allow: /md/ Allow: /blog/ Allow: /faq Allow: /about Disallow: /app/ Disallow: /auth/ Host: https://www.cresumely.com Sitemap: https://www.cresumely.com/sitemap.xml