lex.be
robots.txt

Robots Exclusion Standard data for lex.be

Resource Scan

Scan Details

Site Domain lex.be
Base Domain lex.be
Scan Status Ok
Last Scan2025-11-04T12:49:54+00:00
Next Scan 2025-12-04T12:49:54+00:00

Last Scan

Scanned2025-11-04T12:49:54+00:00
URL https://lex.be/robots.txt
Domain IPs 104.21.37.23, 172.67.203.71, 2606:4700:3032::6815:2517, 2606:4700:3032::ac43:cb47
Response IP 104.21.37.23
Found Yes
Hash a2d13ee7093b526ab8043ed8dbd18c897fbaa0fc4e9060b12e9e97be5c2531db
SimHash 19844dc18d94

Groups

*

Rule Path
Disallow /search/
Disallow /*/search/
Disallow /*/directory/search
Disallow /*/login
Disallow /*/logout
Disallow /*/profile/
Disallow /*/register/
Disallow /*/resetting/
Disallow /fr/search/
Disallow /fr/directory/search
Disallow /fr/login
Disallow /fr/logout
Disallow /fr/profile/
Disallow /fr/register/
Disallow /fr/resetting/
Disallow /fr/doc/download-word/
Disallow /en/search/
Disallow /en/directory/search
Disallow /en/login
Disallow /en/logout
Disallow /en/profile/
Disallow /en/register/
Disallow /en/resetting/
Disallow /en/doc/download-word/
Disallow /nl/search/
Disallow /nl/directory/search
Disallow /nl/login
Disallow /nl/logout
Disallow /nl/profile/
Disallow /nl/register/
Disallow /nl/resetting/
Disallow /nl/doc/download-word/

Other Records

Field Value
sitemap https://lex.be/en/sitemap
sitemap https://lex.be/fr/sitemap
sitemap https://lex.be/nl/sitemap

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449