cravingtech.com
robots.txt
Robots Exclusion Standard data for cravingtech.com
Resource Scan
Scan Details
Site Domain | cravingtech.com |
Base Domain | cravingtech.com |
Scan Status | Ok |
Last Scan | 2024-11-08T07:53:22+00:00 |
Next Scan | 2024-11-15T07:53:22+00:00 |
Last Scan
Scanned | 2024-11-08T07:53:22+00:00 |
URL | https://cravingtech.com/robots.txt |
Domain IPs | 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138 |
Response IP | 52.221.42.138 |
Found | Yes |
Hash | 189d3c5a4d2f9d9ba7053bb5508643450b33e19d96d838fb77043993da1aa87c |
SimHash | 09415a404b12 |
Groups
*
Rule | Path |
---|---|
Disallow | /recommends/ |
Disallow | /blog/wp-admin/ |
Disallow | /blog/wp-includes/ |