acquire.co.nz
robots.txt

Robots Exclusion Standard data for acquire.co.nz

Resource Scan

Scan Details

Site Domain acquire.co.nz
Base Domain acquire.co.nz
Scan Status Ok
Last Scan2024-11-12T22:42:42+00:00
Next Scan 2024-12-12T22:42:42+00:00

Last Scan

Scanned2024-11-12T22:42:42+00:00
URL https://acquire.co.nz/robots.txt
Domain IPs 202.89.35.205
Response IP 202.89.35.205
Found Yes
Hash 515fb21885078814e5848180a359fb3750e1f40a9fab235a272706afa15be874
SimHash 511c5d33ceca

Groups

*

Rule Path
Disallow /you/
Disallow /basket/
Disallow /scripts/
Disallow /styles/
Disallow /js/
Disallow /css/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://acquire.co.nz/sitemap.xml