butterflyonline.com
robots.txt
Robots Exclusion Standard data for butterflyonline.com
Resource Scan
Scan Details
Site Domain | butterflyonline.com |
Base Domain | butterflyonline.com |
Scan Status | Ok |
Last Scan | 2024-06-21T16:20:47+00:00 |
Next Scan | 2024-07-21T16:20:47+00:00 |
Last Scan
Scanned | 2024-06-21T16:20:47+00:00 |
URL | https://butterflyonline.com/robots.txt |
Domain IPs | 184.154.120.237 |
Response IP | 184.154.120.237 |
Found | Yes |
Hash | ef788b9a5894160b3fb8544b2dfe8da07156fdc40fd42c92d9ad7c31f4622558 |
SimHash | 526152a3c0fe |
Groups
*
Rule | Path |
---|---|
Disallow | /Butterfly-Team/ |
Disallow | /BtyInv/ |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /bowmarsports/ |
ia_archiver
Rule | Path |
---|---|
Disallow | /Butterfly-Team/ |
Disallow | /BtyInv/ |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /WCTTA/ |
Disallow | /bowmarsports/ |
alexa site audit
Rule | Path |
---|---|
Disallow | /Butterfly-Team/ |
Disallow | /BtyInv/ |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /WCTTA/ |
Disallow | /bowmarsports/ |
alexabot
Rule | Path |
---|---|
Disallow | /Butterfly-Team/ |
Disallow | /BtyInv/ |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /WCTTA/ |
Disallow | /bowmarsports/ |
*
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wp-import-export-lite/ |
Other Records
Field | Value |
---|---|
sitemap | https://butterflyonline.com/sitemap.xml |
Warnings
- 17 invalid lines.
- `https` is not a known field.
Comments