human-et.one
robots.txt

Robots Exclusion Standard data for human-et.one

Resource Scan

Scan Details

Site Domain human-et.one
Base Domain human-et.one
Scan Status Ok
Last Scan2024-09-23T06:44:52+00:00
Next Scan 2024-09-30T06:44:52+00:00

Last Scan

Scanned2024-09-23T06:44:52+00:00
URL http://human-et.one/robots.txt
Redirect https://human-et-one.mn.co/robots.txt
Redirect Domain human-et-one.mn.co
Redirect Base mn.co
Domain IPs 185.104.29.36, 2a06:2ec0:1::95
Redirect IPs 162.159.128.53, 162.159.138.52
Response IP 162.159.138.52
Found Yes
Hash 5b5dbc312206260849702288d60919486c4891e279c5e0864f0df9ad930d3f77
SimHash 6b069a12cbb2

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Allow /$
Disallow /

Other Records

Field Value
sitemap https://human-et-one.mn.co/sitemap.xml