context.reverso.net
robots.txt

Robots Exclusion Standard data for context.reverso.net

Resource Scan

Scan Details

Site Domain context.reverso.net
Base Domain reverso.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-16T16:54:53+00:00
Next Scan 2025-08-15T16:54:53+00:00

Last Successful Scan

Scanned2025-02-17T16:47:20+00:00
URL https://context.reverso.net/robots.txt
Domain IPs 51.254.91.152
Response IP 51.254.91.152
Found Yes
Hash 4d2ca3e532c60f73d547231302c5c5bd3c875dc52fb5dfd14f05a8efae6829b9
SimHash db1cd862eb93

Groups

*

Rule Path
Disallow /bst-web-*
Disallow /2629866/
Disallow /*/in%2Bmaster%2Bsimon%2Bwe%2Btrust
Disallow /favourites/*

megaindex

Rule Path
Disallow /

digitalpebble

Rule Path
Disallow /

eissab

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

criteobot/0.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /