Log In Sign Up

myvirtualscribe.us
robots.txt

Robots Exclusion Standard data for myvirtualscribe.us

Resource Scan

Scan Details

Site Domain myvirtualscribe.us
Base Domain myvirtualscribe.us
Scan Status Ok
Last Scan2025-12-25T06:00:56+00:00
Next Scan 2026-01-24T06:00:56+00:00

Last Scan

Scanned2025-12-25T06:00:56+00:00
URL https://myvirtualscribe.us/robots.txt
Domain IPs 35.208.63.30
Response IP 35.208.63.30
Found Yes
Hash fa0dbc6318c66b36ff5223b9022ce7d0309d1212440739d5a7b02055e89b904e
SimHash 6b28b850ee93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wpforms/

Other Records

Field Value
crawl-delay 10

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot
bingbot
claude-web
claudebot
gptbot
google-extended

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://myvirtualscribe.us/sitemap_index.xml
Back to top

Comments

  • Default rules
  • -------------------------------------------
  • Allowed AI Agents (Search & Assistants)
  • -------------------------------------------
Back to top