whatsmyrugsize.com
robots.txt
Robots Exclusion Standard data for whatsmyrugsize.com
Resource Scan
Scan Details
Site Domain | whatsmyrugsize.com |
Base Domain | whatsmyrugsize.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-20T11:29:15+00:00 |
Next Scan | 2024-10-20T11:29:15+00:00 |
Last Successful Scan
Scanned | 2024-08-22T07:46:03+00:00 |
URL | https://whatsmyrugsize.com/robots.txt |
Domain IPs | 104.21.3.19, 172.67.130.11, 2606:4700:3036::6815:313, 2606:4700:3037::ac43:820b |
Response IP | 104.21.3.19 |
Found | Yes |
Hash | e8b56a6bd478822f85c975e9249a454d2ce571cef6c11077ca586ff654a95772 |
SimHash | 4a085d426931 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /linkout/ |
Disallow | /recommended/ |
Disallow | /comments/feed/ |
Disallow | /trackback/ |
Disallow | /index.php |
Disallow | /xmlrpc.php |
Disallow | /readme.html |
Disallow | /license.txt |
Disallow | /ezwp.txt |
Disallow | /php.ini |
Other Records
Field | Value |
---|---|
sitemap | https://whatsmyrugsize.com/sitemap_index.xml |
Warnings
- 2 invalid lines.
Comments