asure.network
robots.txt

Robots Exclusion Standard data for asure.network

Resource Scan

Scan Details

Site Domain asure.network
Base Domain asure.network
Scan Status Ok
Last Scan2025-09-20T12:04:01+00:00
Next Scan 2025-10-20T12:04:01+00:00

Last Scan

Scanned2025-09-20T12:04:01+00:00
URL https://asure.network/robots.txt
Redirect https://www.asure.network/robots.txt
Redirect Domain www.asure.network
Redirect Base asure.network
Domain IPs 104.21.0.196, 172.67.128.60, 2606:4700:3036::6815:c4, 2606:4700:3037::ac43:803c
Redirect IPs 104.21.0.196, 172.67.128.60, 2606:4700:3036::6815:c4, 2606:4700:3037::ac43:803c
Response IP 104.21.0.196
Found Yes
Hash 8ad26b1c11d7c1ac0990d842c6658ba9478d86c676b568dedd0c04a41cf51219
SimHash a85058848753

Groups

*

Rule Path
Disallow

spambot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

penthesilea

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.asure.network/sitemap.xml