meanwhileinamerica.com
robots.txt
Robots Exclusion Standard data for meanwhileinamerica.com
Resource Scan
Scan Details
Site Domain | meanwhileinamerica.com |
Base Domain | meanwhileinamerica.com |
Scan Status | Ok |
Last Scan | 4/12/2025, 8:16:26 AM |
Next Scan | 5/12/2025, 8:16:26 AM |
Last Scan
Scanned | 4/12/2025, 8:16:26 AM |
URL | https://meanwhileinamerica.com/robots.txt |
Domain IPs | 104.21.3.13, 172.67.130.5, 2606:4700:3031::6815:30d, 2606:4700:3033::ac43:8205 |
Response IP | 172.67.130.5 |
Found | Yes |
Hash | eb0f11b83c86e71d83d9191ad957928cea7a185437d54eba5417186c046bd883 |
SimHash | 635df1d2c439 |
Groups
*
Rule | Path |
---|---|
Disallow | /x/ |
Disallow | /LICENSE.txt |
Disallow | /error_log |
Disallow | /google430f9c71cc66dacd.html |
Disallow | /pinterest-ebbff.html |
Disallow | /ganalytics.js |
Disallow | /xmlrpc.php |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Comments