happy-reptiles.eu
robots.txt

Robots Exclusion Standard data for happy-reptiles.eu

Resource Scan

Scan Details

Site Domain happy-reptiles.eu
Base Domain happy-reptiles.eu
Scan Status Ok
Last Scan2024-05-11T22:47:43+00:00
Next Scan 2024-06-10T22:47:43+00:00

Last Scan

Scanned2024-05-11T22:47:43+00:00
URL https://happy-reptiles.eu/robots.txt
Redirect https://www.happy-reptiles.eu/robots.txt
Redirect Domain www.happy-reptiles.eu
Redirect Base happy-reptiles.eu
Domain IPs 104.26.8.174, 104.26.9.174, 172.67.71.120, 2606:4700:20::681a:8ae, 2606:4700:20::681a:9ae, 2606:4700:20::ac43:4778
Redirect IPs 104.26.8.174, 104.26.9.174, 172.67.71.120, 2606:4700:20::681a:8ae, 2606:4700:20::681a:9ae, 2606:4700:20::ac43:4778
Response IP 104.26.9.174
Found Yes
Hash 77979c751ad604dba99ed78f1763aafb850db11398224b0d2d8316c7c759705b
SimHash 611c58f1ce91

Groups

*

Rule Path
Allow /
Disallow /cart/
Disallow /checkout/
Disallow /customer/*
Disallow /search/

Other Records

Field Value
crawl-delay 30

alphabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.happy-reptiles.eu/rss/