findoutmore-supportinggrowth.nz
robots.txt

Robots Exclusion Standard data for findoutmore-supportinggrowth.nz

Resource Scan

Scan Details

Site Domain findoutmore-supportinggrowth.nz
Base Domain findoutmore-supportinggrowth.nz
Scan Status Ok
Last Scan2024-10-03T05:30:24+00:00
Next Scan 2024-10-17T05:30:24+00:00

Last Scan

Scanned2024-10-03T05:30:24+00:00
URL https://findoutmore-supportinggrowth.nz/robots.txt
Domain IPs 13.237.143.163, 13.238.234.141, 54.66.255.198
Response IP 13.238.234.141
Found Yes
Hash 357db13e29bf9807c4af0605ce8294a17a6700c7ca5a0caec1c29ddbea3ad500
SimHash 4b40d460c730

Groups

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

experibot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Comments

  • https://megaindex.com/crawler
  • https://amirkr.wixsite.com/experibot