mycraigslist.org
robots.txt

Robots Exclusion Standard data for mycraigslist.org

Resource Scan

Scan Details

Site Domain mycraigslist.org
Base Domain mycraigslist.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-07T10:47:51+00:00
Next Scan 2025-08-06T10:47:51+00:00

Last Successful Scan

Scanned2025-03-17T10:39:16+00:00
URL https://mycraigslist.org/robots.txt
Redirect https://pg88.fishing/robots.txt
Redirect Domain pg88.fishing
Redirect Base pg88.fishing
Domain IPs 104.21.83.64, 172.67.215.84, 2606:4700:3035::6815:5340, 2606:4700:3035::ac43:d754
Redirect IPs 104.21.74.22, 172.67.195.124, 2606:4700:3030::6815:4a16, 2606:4700:3035::ac43:c37c
Response IP 172.67.195.124
Found Yes
Hash aeeef5c0e5a49219a6f9dce40951c2a43e584a055919c7bcaa7b3c806340a8c1
SimHash 61015c404f93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://pg88.fishing/sitemap_index.xml