justgirls.co.nz
robots.txt

Robots Exclusion Standard data for justgirls.co.nz

Resource Scan

Scan Details

Site Domain justgirls.co.nz
Base Domain justgirls.co.nz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-12-29T05:24:15+00:00
Next Scan 2025-03-29T05:24:15+00:00

Last Successful Scan

Scanned2023-08-14T18:49:01+00:00
URL https://justgirls.co.nz/robots.txt
Redirect https://www.justgirls.co.nz/robots.txt
Redirect Domain www.justgirls.co.nz
Redirect Base justgirls.co.nz
Domain IPs 104.21.9.208, 172.67.131.8, 2606:4700:3035::6815:9d0, 2606:4700:3035::ac43:8308
Redirect IPs 104.21.9.208, 172.67.131.8, 2606:4700:3035::6815:9d0, 2606:4700:3035::ac43:8308
Response IP 172.67.131.8
Found Yes
Hash f2fbc38a385df59cd9d0e2d081f1f646ecfc0ec435abc43841a87722273abda3
SimHash e81dbc448d13

Groups

*

Rule Path
Disallow /index.php*
Disallow /ajax/city/list

Other Records

Field Value
sitemap http://www.justgirls.co.nz/sitemap.xml