southperthchiro.com.au
robots.txt

Robots Exclusion Standard data for southperthchiro.com.au

Resource Scan

Scan Details

Site Domain southperthchiro.com.au
Base Domain southperthchiro.com.au
Scan Status Ok
Last Scan2024-11-05T16:25:19+00:00
Next Scan 2024-11-19T16:25:19+00:00

Last Scan

Scanned2024-11-05T16:25:19+00:00
URL https://southperthchiro.com.au/robots.txt
Redirect https://www.southperthchiro.com.au/robots.txt
Redirect Domain www.southperthchiro.com.au
Redirect Base southperthchiro.com.au
Domain IPs 18.155.68.108, 18.155.68.38, 18.155.68.4, 18.155.68.56
Redirect IPs 18.155.68.108, 18.155.68.38, 18.155.68.4, 18.155.68.56
Response IP 18.155.68.38
Found Yes
Hash b8e893b7dec3a5f0572f5755b40ab7bc572fd94c4380f82781a271c5b73acaae
SimHash 6149dc64a38b

Groups

*

Rule Path
Disallow /dash/
Disallow /pp*
Disallow /trackback
Disallow /cgi-bin
Disallow /search
Disallow /rss
Disallow /comments/feed
Disallow /*/trackback/$
Disallow /hero_slides
Disallow /banners

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.southperthchiro.com.au/sitemap.xml