nsm.s35.xrea.com
robots.txt

Robots Exclusion Standard data for nsm.s35.xrea.com

Resource Scan

Scan Details

Site Domain nsm.s35.xrea.com
Base Domain xrea.com
Scan Status Ok
Last Scan2025-10-26T00:04:42+00:00
Next Scan 2025-11-25T00:04:42+00:00

Last Scan

Scanned2025-10-26T00:04:42+00:00
URL http://nsm.s35.xrea.com/robots.txt
Domain IPs 160.251.150.135
Response IP 160.251.150.135
Found Yes
Hash 731d43389f0a2b023b019b68cc050343d217325f36c545cc8f8c24c4e16caa9f
SimHash 01105073edb1

Groups

*

Rule Path
Disallow /dws/bbs.php
Disallow /kisha/
Disallow /soft/download.php
Disallow /soft/arc/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mail.ru/1.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

daum

Rule Path
Disallow /

keybot translation-search-machine

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.