nexedi.com
robots.txt

Robots Exclusion Standard data for nexedi.com

Resource Scan

Scan Details

Site Domain nexedi.com
Base Domain nexedi.com
Scan Status Ok
Last Scan2025-05-11T12:03:18+00:00
Next Scan 2025-06-10T12:03:18+00:00

Last Scan

Scanned2025-05-11T12:03:18+00:00
URL https://nexedi.com/robots.txt
Redirect https://www.nexedi.com/robots.txt
Redirect Domain www.nexedi.com
Redirect Base nexedi.com
Domain IPs 212.129.18.209, 46.4.4.145
Redirect IPs 209.151.149.235, 5.161.20.13
Response IP 209.151.149.235
Found Yes
Hash 60b350f2ce5a9205de562129eae5a8e05e9d4624b6f728a7863fe2f3f1ee8084
SimHash d00d4002f038

Groups

scrapy

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

simplecrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

*

Rule Path
Disallow /test_result_module/
Disallow /web_site_module/

Comments

  • robotstxt.org/