investorplace.com
robots.txt
Robots Exclusion Standard data for investorplace.com
Resource Scan
Scan Details
Site Domain | investorplace.com |
Base Domain | investorplace.com |
Scan Status | Ok |
Last Scan | 2024-05-02T04:51:30+00:00 |
Next Scan | 2024-05-09T04:51:30+00:00 |
Last Scan
Scanned | 2024-05-02T04:51:30+00:00 |
URL | https://investorplace.com/robots.txt |
Domain IPs | 104.16.190.134, 104.16.191.134, 2606:4700::6810:be86, 2606:4700::6810:bf86 |
Response IP | 104.16.191.134 |
Found | Yes |
Hash | 843801684dd5c6b609714eba0ccb80fd206c3a64441d27faa023add13ef8f0eb |
SimHash | 6600c0508635 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /special-reports/ |
Disallow | /free/ |
Disallow | /order/ |
Disallow | /print/ |
Disallow | /xmlrpc.php |
swiftbot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /special-reports/ |
Disallow | /free/ |
Disallow | /order/ |
Disallow | /print/ |
Disallow | /xmlrpc.php |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
bingbot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /special-reports/ |
Disallow | /free/ |
Disallow | /order/ |
Disallow | /print/ |
Disallow | /xmlrpc.php |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |