revitforum.org
robots.txt

Robots Exclusion Standard data for revitforum.org

Resource Scan

Scan Details

Site Domain revitforum.org
Base Domain revitforum.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-31T01:31:13+00:00
Next Scan 2024-10-29T01:31:13+00:00

Last Successful Scan

Scanned2024-04-03T01:29:44+00:00
URL https://www.revitforum.org/robots.txt
Domain IPs 104.18.208.24, 2606:4700::6812:cffe, 2606:4700::6812:d018, 2606:4700::6812:dffe, 2606:4700::6812:e014, 2606:4700::6812:e018
Response IP 104.18.208.24
Found Yes
Hash e9acee9d5c09614d9ec5ea203f418a9c198f1fab684aaf10d7f27103637ffd78
SimHash 302cdc70a013

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /admincp/
Disallow /modcp/
Disallow /attachments/
Disallow /images/
Disallow /members/
Disallow /search/
Disallow /new-content/
Disallow /auth/
Disallow /register
Disallow /uploader/url

baiduspider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap /core/xmlsitemap.php