herpaperroute.com
robots.txt

Robots Exclusion Standard data for herpaperroute.com

Resource Scan

Scan Details

Site Domain herpaperroute.com
Base Domain herpaperroute.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-06T07:14:11+00:00
Next Scan 2024-10-13T07:14:11+00:00

Last Successful Scan

Scanned2024-09-28T07:13:28+00:00
URL https://herpaperroute.com/robots.txt
Domain IPs 23.29.145.206
Response IP 23.29.145.206
Found Yes
Hash 4505e36f5d47dfec3e91f1d42bdac79ae4b215c70da18a0ebc0b050b37aed392
SimHash 0c15d100c151

Groups

msnbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Allow /

twitterbot

Rule Path
Allow /images

facebookexternalhit

Rule Path
Allow /images

duckduckbot

Rule Path
Allow /

pinterestbot

Rule Path
Disallow

rogerbot

Rule Path
Disallow

ahrefssiteaudit

Rule Path
Disallow

bingbot

Rule Path
Disallow

yandex

Rule Path
Disallow

yandexbot

Rule Path
Disallow

gptbot

Rule Path
Disallow /