Log In Sign Up

nexion.com
robots.txt

Robots Exclusion Standard data for nexion.com

Resource Scan

Scan Details

Site Domain nexion.com
Base Domain nexion.com
Scan Status Ok
Last Scan2025-11-15T20:01:34+00:00
Next Scan 2025-12-15T20:01:34+00:00

Last Scan

Scanned2025-11-15T20:01:34+00:00
URL https://nexion.com/robots.txt
Domain IPs 104.18.12.108, 104.18.13.108, 2606:4700::6812:c6c, 2606:4700::6812:d6c
Response IP 104.18.13.108
Found Yes
Hash 14941911525e9e31644a7666c6eb5a88cba13f5e93a25fb53ec85231523bfe85
SimHash 6a4cdc9086b5

Groups

*

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://nexion.com/sitemap_index.xml
Back to top