modelsnova.com
robots.txt

Robots Exclusion Standard data for modelsnova.com

Resource Scan

Scan Details

Site Domain modelsnova.com
Base Domain modelsnova.com
Scan Status Ok
Last Scan2025-10-25T23:54:17+00:00
Next Scan 2025-11-24T23:54:17+00:00

Last Scan

Scanned2025-10-25T23:54:17+00:00
URL https://modelsnova.com/robots.txt
Domain IPs 160.153.0.55
Response IP 160.153.0.55
Found Yes
Hash 0f8336816398e50b185d866cfbad0289ae39317e0fad69f120cd8456c1b1da7d
SimHash 64e81900e533

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

google-extended

Rule Path
Disallow

gptbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.modelsnova.com/sitemap_index.xml

Comments

  • Rules for all crawlers
  • Explicit rule to ensure Google's AI can crawl for search results
  • Explicit rule for OpenAI's crawler (for ChatGPT)
  • Sitemap location (Corrected capitalization)