slateandtell.com
robots.txt

Robots Exclusion Standard data for slateandtell.com

Resource Scan

Scan Details

Site Domain slateandtell.com
Base Domain slateandtell.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-05T00:44:57+00:00
Next Scan 2024-06-19T00:44:57+00:00

Last Successful Scan

Scanned2024-04-28T00:34:40+00:00
URL https://slateandtell.com/robots.txt
Redirect https://www.slateandtell.com/robots.txt
Redirect Domain www.slateandtell.com
Redirect Base slateandtell.com
Domain IPs 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80
Redirect IPs 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80
Response IP 104.26.4.133
Found Yes
Hash a00097647f7ab2afb9d2bde0e6ca5c40ead43a520babc8c716d106d8e4321074
SimHash 69548d36f2d2

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /exec/
Disallow /admin/

googlebot
googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

pinterest

Rule Path
Disallow

pinterestbot

Rule Path
Disallow

pinterestbot/1.0

Rule Path
Disallow

pinterest/0.2 (+https://www.pinterest.com/bot.html)
mozilla/5.0 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)
mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/41.0.2272.96 mobile safari/537.36 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.slateandtell.com/sitemap.xml
sitemap https://www.slateandtell.com/sitemap-product.xml