crazypetguy.com
robots.txt
Robots Exclusion Standard data for crazypetguy.com
Resource Scan
Scan Details
Site Domain | crazypetguy.com |
Base Domain | crazypetguy.com |
Scan Status | Ok |
Last Scan | 2025-05-19T02:21:35+00:00 |
Next Scan | 2025-05-26T02:21:35+00:00 |
Last Scan
Scanned | 2025-05-19T02:21:35+00:00 |
URL | https://crazypetguy.com/robots.txt |
Redirect | https://www.crazypetguy.com/robots.txt |
Redirect Domain | www.crazypetguy.com |
Redirect Base | crazypetguy.com |
Domain IPs | 194.1.147.79, 194.1.147.89 |
Redirect IPs | 194.1.147.79, 194.1.147.89 |
Response IP | 194.1.147.89 |
Found | Yes |
Hash | 9590c0b5bbb1ac84d357af01510a910e9c3d91b4667c43f53dc6bd898a7644b5 |
SimHash | d964dcc0a41b |
Groups
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Disallow | /wp-json/ |
Disallow | /?rest_route= |
Other Records
Field | Value |
---|---|
sitemap | https://www.crazypetguy.com/sitemap_index.xml |
Comments