Log In Sign Up

promethazinehuji.com
robots.txt

Robots Exclusion Standard data for promethazinehuji.com

Resource Scan

Scan Details

Site Domain promethazinehuji.com
Base Domain promethazinehuji.com
Scan Status Ok
Last Scan3/19/2025, 7:02:36 AM
Next Scan 4/18/2025, 7:02:36 AM

Last Scan

Scanned3/19/2025, 7:02:36 AM
URL https://promethazinehuji.com/robots.txt
Redirect https://globalcaballos.com/robots.txt
Redirect Domain globalcaballos.com
Redirect Base globalcaballos.com
Domain IPs 104.21.42.161, 172.67.163.136, 2606:4700:3035::6815:2aa1, 2606:4700:3037::ac43:a388
Redirect IPs 104.21.11.28, 172.67.165.22, 2606:4700:3035::6815:b1c, 2606:4700:3037::ac43:a516
Response IP 172.67.165.22
Found Yes
Hash 7a8de1020c715c082f38915f05cbe01c7bd4b14631795546c5dda68c3171157a
SimHash 401c95408512

Groups

googlebot

Rule Path
Disallow /info/
Disallow /search/

mediapartners-google

Rule Path
Disallow /info/
Disallow /search/

yahoo! slurp

Rule Path
Allow /$
Disallow /

bingbot

Rule Path
Allow /$
Disallow /

yandex

Rule Path
Allow /$
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow

ips-agent

Rule Path
Disallow /parking.php4

blexbot

Rule Path
Disallow /

pandalytics

Rule Path
Disallow /info/
Disallow /search/

ioncrawl

Rule Path
Disallow /info/
Disallow /search/

rogerbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

bytespider
baiduspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

oncrawl

Rule Path
Disallow /

botify

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top