joseilbo.com
robots.txt

Robots Exclusion Standard data for joseilbo.com

Resource Scan

Scan Details

Site Domain joseilbo.com
Base Domain joseilbo.com
Scan Status Ok
Last Scan2024-07-03T03:50:44+00:00
Next Scan 2024-07-10T03:50:44+00:00

Last Scan

Scanned2024-07-03T03:50:44+00:00
URL https://joseilbo.com/robots.txt
Redirect http://www.joseilbo.com/robots.txt
Redirect Domain www.joseilbo.com
Redirect Base joseilbo.com
Domain IPs 13.33.88.109, 13.33.88.122, 13.33.88.73, 13.33.88.87
Redirect IPs 13.33.88.109, 13.33.88.122, 13.33.88.73, 13.33.88.87
Response IP 13.33.88.122
Found Yes
Hash 7799c693f84dea618922171623a9eb1af60d3a4f114a249a3cfb6af7d439f0a5
SimHash 492dd8f15740

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /bodo/
Disallow /cM2ajno0As1eg4r7/
Disallow /NewsManagement/
Disallow /reporter/
Disallow /intranet/
Disallow /fastcat/
Disallow /lib/
Disallow /Common/
Disallow /Contents/
Disallow /Ent/banner/
Disallow /Error/
Disallow /Banner/
Disallow /banner/
Disallow /fr/

googlebot

Rule Path
Disallow /bodo/
Disallow /cM2ajno0As1eg4r7/
Disallow /NewsManagement/
Disallow /reporter/
Disallow /intranet/
Disallow /fastcat/
Disallow /lib/
Disallow /Contents/
Disallow /Ent/banner/
Disallow /Error/
Disallow /Banner/
Disallow /banner/
Disallow /fr/

mediapartners-google

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

quantcastbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /