piratesonlineforums.com
robots.txt

Robots Exclusion Standard data for piratesonlineforums.com

Resource Scan

Scan Details

Site Domain piratesonlineforums.com
Base Domain piratesonlineforums.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-03T10:42:45+00:00
Next Scan 2026-01-01T10:42:45+00:00

Last Successful Scan

Scanned2023-09-08T20:22:56+00:00
URL https://piratesonlineforums.com/robots.txt
Domain IPs 104.21.5.179, 172.67.133.177, 2606:4700:3034::ac43:85b1, 2606:4700:3036::6815:5b3
Response IP 104.21.5.179
Found Yes
Hash 94bcd8348aa682eb4b07d9d5766c1df57b0466e455b32c9c62479581004b5929
SimHash 8c72ba8729d2

Groups

*

Rule Path
Disallow /forum/memberlist.php
Disallow /forum/attachment.php
Disallow /forum/avatar.php
Disallow /forum/editpost.php
Disallow /forum/misc.php
Disallow /forum/moderator.php
Disallow /forum/newreply.php
Disallow /forum/newthread.php
Disallow /forum/online.php
Disallow /forum/poll.php
Disallow /forum/postings.php
Disallow /forum/private.php
Disallow /forum/report.php
Disallow /forum/search.php
Disallow /forum/sendtofriend.php
Disallow /forum/threadrate.php
Disallow /forum/usercp.php
Disallow /forum/sendmessage.php
Disallow /forum/register.php
Disallow /forum/subscription.php
Disallow /forum/admincp/
Disallow /forum/modcp/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

Comments

  • robots.txt for http://www.toontowncentral.com/