slateandtell.com
robots.txt
Robots Exclusion Standard data for slateandtell.com
Resource Scan
Scan Details
Site Domain | slateandtell.com |
Base Domain | slateandtell.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-05T00:44:57+00:00 |
Next Scan | 2024-06-19T00:44:57+00:00 |
Last Successful Scan
Scanned | 2024-04-28T00:34:40+00:00 |
URL | https://slateandtell.com/robots.txt |
Redirect | https://www.slateandtell.com/robots.txt |
Redirect Domain | www.slateandtell.com |
Redirect Base | slateandtell.com |
Domain IPs | 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80 |
Redirect IPs | 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80 |
Response IP | 104.26.4.133 |
Found | Yes |
Hash | a00097647f7ab2afb9d2bde0e6ca5c40ead43a520babc8c716d106d8e4321074 |
SimHash | 69548d36f2d2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cgi-bin/ |
Disallow | /exec/ |
Disallow | /admin/ |
pinterest/0.2 (+https://www.pinterest.com/bot.html)
mozilla/5.0 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)
mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/41.0.2272.96 mobile safari/537.36 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
sitemap | https://www.slateandtell.com/sitemap.xml |
sitemap | https://www.slateandtell.com/sitemap-product.xml |