interfans.org
robots.txt

Robots Exclusion Standard data for interfans.org

Resource Scan

Scan Details

Site Domain interfans.org
Base Domain interfans.org
Scan Status Ok
Last Scan2024-09-26T18:27:57+00:00
Next Scan 2024-10-03T18:27:57+00:00

Last Scan

Scanned2024-09-26T18:27:57+00:00
URL https://interfans.org/robots.txt
Domain IPs 209.42.193.94
Response IP 209.42.193.94
Found Yes
Hash cf19d25fb0bed50a097b10ed1914095099dab9cbd285ddd44c14d47f161ed498
SimHash d00c54e2cf31

Groups

*

Rule Path
Disallow /forum/members/*

grapeshot

Rule Path
Disallow /

petalbot
aspiegelbot
ahrefsbot
semrushbot
dotbot
mauibot
mj12bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /forum/threads/*/reply

*

Rule Path
Disallow /forum/whats-new/
Disallow /forum/account/
Disallow /forum/attachments/
Disallow /forum/goto/
Disallow /forum/posts/
Disallow /forum/login/
Disallow /forum/search/
Disallow /forum/data/
Disallow /forum/styles/
Disallow /forum/misc/
Disallow /forum/resources/*/download
Disallow /forum/css.php
Disallow /forum/admin.php
Allow /

Other Records

Field Value
sitemap https://interfans.org/sitemap.xml