serenesmilesperth.com.au
robots.txt

Robots Exclusion Standard data for serenesmilesperth.com.au

Resource Scan

Scan Details

Site Domain serenesmilesperth.com.au
Base Domain serenesmilesperth.com.au
Scan Status Ok
Last Scan2024-11-05T02:12:19+00:00
Next Scan 2024-11-19T02:12:19+00:00

Last Scan

Scanned2024-11-05T02:12:19+00:00
URL https://serenesmilesperth.com.au/robots.txt
Redirect https://www.serenesmilesperth.com.au/robots.txt
Redirect Domain www.serenesmilesperth.com.au
Redirect Base serenesmilesperth.com.au
Domain IPs 13.33.88.119, 13.33.88.19, 13.33.88.72, 13.33.88.97
Redirect IPs 13.33.88.119, 13.33.88.19, 13.33.88.72, 13.33.88.97
Response IP 13.33.88.97
Found Yes
Hash 42a63d3c3ed7aa31785c9d5f3af5dcba8b25f012ebd71f7ac6b926f388b4bb75
SimHash 79599c40a388

Groups

*

Rule Path
Disallow /dash/
Disallow /pp*
Disallow /trackback
Disallow /cgi-bin
Disallow /search
Disallow /rss
Disallow /comments/feed
Disallow /*/trackback/$
Disallow /hero_slides
Disallow /banners

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.serenesmilesperth.com.au/sitemap.xml