herpaperroute.com
robots.txt

Robots Exclusion Standard data for herpaperroute.com

Resource Scan

Scan Details

Site Domain herpaperroute.com
Base Domain herpaperroute.com
Scan Status Ok
Last Scan2024-11-10T17:22:48+00:00
Next Scan 2024-11-17T17:22:48+00:00

Last Scan

Scanned2024-11-10T17:22:48+00:00
URL https://herpaperroute.com/robots.txt
Domain IPs 23.29.145.206
Response IP 23.29.145.206
Found Yes
Hash 94c515812ca6c9f7bf05068248712043d0d2ae94a0e2d391e1dc86aca31347c6
SimHash 0c15d000c333

Groups

msnbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Allow /

twitterbot

Rule Path
Allow /images

facebookexternalhit

Rule Path
Allow /images

duckduckbot

Rule Path
Allow /

pinterestbot

Rule Path
Disallow

rogerbot

Rule Path
Disallow

ahrefssiteaudit

Rule Path
Disallow

bingbot

Rule Path
Disallow

yandex

Rule Path
Disallow

yandexbot

Rule Path
Disallow

gptbot

Rule Path
Disallow /
Disallow /*/feed/