forosuse.org
robots.txt

Robots Exclusion Standard data for forosuse.org

Resource Scan

Scan Details

Site Domain forosuse.org
Base Domain forosuse.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-08T21:10:40+00:00
Next Scan 2026-01-06T21:10:40+00:00

Last Successful Scan

Scanned2025-05-19T12:53:26+00:00
URL https://forosuse.org/robots.txt
Domain IPs 198.38.76.22
Response IP 198.38.76.22
Found Yes
Hash 86c1842cb17534debb14f680a818b9360c8fcd07b864bd6d733761e5fd9faa57
SimHash bc098450ca41

Groups

*

Rule Path
Disallow /admincp/
Disallow /modcp/
Disallow /o.php?

petalbot

Rule Path
Disallow /

sensikabot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

toplistbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

urlmetriken

Rule Path
Disallow /

urlfan-bot

Rule Path
Disallow /

webalta crawler

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

riddler

Rule Path
Disallow /

webwiki

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

whitevector crawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

superfeedr

Rule Path
Disallow /

whitevector

Rule Path
Disallow /

converacrawler/0.9d

Rule Path
Disallow /

converacrawler/0.9e

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.forosuse.org/forosuse/store_sitemap/vbulletin_sitemap_index.xml.gz
sitemap https://www.forosuse.org/forosuse/store_sitemap/vbulletin_sitemap_forum_3.xml.gz
sitemap https://www.forosuse.org/forosuse/store_sitemap/vbulletin_sitemap_thread_1.xml.gz
sitemap https://www.forosuse.org/forosuse/store_sitemap/vbulletin_sitemap_thread_2.xml.gz
sitemap https://www.forosuse.org/forosuse/store_sitemap/vbulletin_sitemap_cms_4.xml.gz
sitemap https://www.forosuse.org/forosuse/store_sitemap/vbulletin_sitemap_blog_0.xml.gz