heavenschild.com.au
robots.txt

Robots Exclusion Standard data for heavenschild.com.au

Resource Scan

Scan Details

Site Domain heavenschild.com.au
Base Domain heavenschild.com.au
Scan Status Ok
Last Scan2025-04-09T19:27:39+00:00
Next Scan 2025-04-16T19:27:39+00:00

Last Scan

Scanned2025-04-09T19:27:39+00:00
URL https://heavenschild.com.au/robots.txt
Redirect https://www.heavenschild.com.au/robots.txt
Redirect Domain www.heavenschild.com.au
Redirect Base heavenschild.com.au
Domain IPs 104.21.32.105, 172.67.185.142, 2606:4700:3030::ac43:b98e, 2606:4700:3035::6815:2069
Redirect IPs 104.21.32.105, 172.67.185.142, 2606:4700:3030::ac43:b98e, 2606:4700:3035::6815:2069
Response IP 172.67.185.142
Found Yes
Hash 32f8eda31bdcbe8b30ecb2260a7d4f09413f6cd1da6a68a186ff5212668a6f3a
SimHash 301d81c06632

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

ahrefsbot/4.0

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

xenu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

gsitecrawler

Rule Path
Disallow /

spyfu

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

linkdex.com/v2.0

Rule Path
Disallow /

linkdex.com/v2.1

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.heavenschild.com.au/sitemap-astrology.xml
sitemap https://www.heavenschild.com.au/sitemap-daily-horoscope.xml
sitemap https://www.heavenschild.com.au/sitemap-horoscope.xml

Comments

  • SEARCH TOOLS
  • ALL