bargainrentalcars.co.nz
robots.txt

Robots Exclusion Standard data for bargainrentalcars.co.nz

Resource Scan

Scan Details

Site Domain bargainrentalcars.co.nz
Base Domain bargainrentalcars.co.nz
Scan Status Ok
Last Scan2024-06-25T13:26:58+00:00
Next Scan 2024-07-25T13:26:58+00:00

Last Scan

Scanned2024-06-25T13:26:58+00:00
URL https://bargainrentalcars.co.nz/robots.txt
Redirect https://www.bargainrentalcars.co.nz/robots.txt
Redirect Domain www.bargainrentalcars.co.nz
Redirect Base bargainrentalcars.co.nz
Domain IPs 103.145.192.123
Redirect IPs 18.155.68.124, 18.155.68.57, 18.155.68.82, 18.155.68.85, 2600:9000:23d2:0:18:85b2:7ec0:93a1, 2600:9000:23d2:2400:18:85b2:7ec0:93a1, 2600:9000:23d2:2a00:18:85b2:7ec0:93a1, 2600:9000:23d2:4400:18:85b2:7ec0:93a1, 2600:9000:23d2:5400:18:85b2:7ec0:93a1, 2600:9000:23d2:5800:18:85b2:7ec0:93a1, 2600:9000:23d2:9600:18:85b2:7ec0:93a1, 2600:9000:23d2:a000:18:85b2:7ec0:93a1
Response IP 18.155.68.124
Found Yes
Hash af7a97ddfe11b71d74cd0384aa693ae293d5e8610ee8fc8b3eb0fcebf819c5b3
SimHash 6158d046c3b3

Groups

*

Rule Path
Disallow /enquiry
Disallow /private_38013TGg36356t
Disallow /email_list_38013TGg36356t
Allow /

shopwiki

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

scanalert

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://www.bargainrentalcars.co.nz/sitemap.xml

Warnings

  • 1 invalid line.