beyond2020vs.com
robots.txt

Robots Exclusion Standard data for beyond2020vs.com

Resource Scan

Scan Details

Site Domain beyond2020vs.com
Base Domain beyond2020vs.com
Scan Status Ok
Last Scan2025-08-25T04:36:33+00:00
Next Scan 2025-09-24T04:36:33+00:00

Last Scan

Scanned2025-08-25T04:36:33+00:00
URL https://beyond2020vs.com/robots.txt
Domain IPs 192.124.249.156
Response IP 192.124.249.156
Found Yes
Hash 36f64f63f31dea90fbba09e70ae2e179d1d8c6d8211f5d8ba7716e5165883d02
SimHash 71174950c690

Groups

*

Rule Path
Disallow /admin/
Disallow /site/
Disallow /wire/
Allow /site/templates/
Allow /site/assets/

anthropic-ai
bytespider
ccbot
claritybot
claude-web
claudebot
cohere-ai
diffbot
etaospider
google-extended
gptbot
magpie-crawler
omgili
omgilibot
perplexitybot
petalbot
scrapy
turnitinbot
webreaper
youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://beyond2020vs.com/sitemap.xml