writingforums.org
robots.txt

Robots Exclusion Standard data for writingforums.org

Resource Scan

Scan Details

Site Domain writingforums.org
Base Domain writingforums.org
Scan Status Ok
Last Scan2024-10-12T07:31:07+00:00
Next Scan 2024-10-19T07:31:07+00:00

Last Scan

Scanned2024-10-12T07:31:07+00:00
URL https://writingforums.org/robots.txt
Redirect https://www.writingforums.org/robots.txt
Redirect Domain www.writingforums.org
Redirect Base writingforums.org
Domain IPs 162.0.226.184
Redirect IPs 162.0.226.184
Response IP 162.0.226.184
Found Yes
Hash 9be95139c7c1e006870258836af72e8c3b87a702c0c7a1bb14e346aa8ac75fb6
SimHash 0c6a6ee24c9b

Groups

*

Rule Path
Disallow /account/
Disallow /alpha/
Disallow /goto/
Disallow /login/
Disallow /search/
Disallow /conversations/
Disallow /admin.php
Disallow /banners/
Disallow /tracking/
Disallow /sitemap/
Disallow /Design/
Disallow /bdmails/
Disallow /bdpaygate/
Disallow /clientscript/
Disallow /memcached/
Disallow /cgi-bin/
Disallow admin.php
Disallow /matomo/
Allow /

mediapartners-google

Rule Path
Disallow

boardreader
boardtracker
gigabot
twiceler
dotbot
baidu
baiduspider
baiduspider-video
baiduspider-image
naverbot
sosospider
yandex
youdaobot
yeti

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.writingforums.org/sitemap.php