Log In Sign Up

lex.page
robots.txt

Robots Exclusion Standard data for lex.page

Resource Scan

Scan Details

Site Domain lex.page
Base Domain lex.page
Scan Status Ok
Last Scan2024-06-22T01:52:37+00:00
Next Scan 2024-07-22T01:52:37+00:00

Last Scan

Scanned2024-06-22T01:52:37+00:00
URL https://lex.page/robots.txt
Domain IPs 104.26.4.105, 104.26.5.105, 172.67.68.141, 2606:4700:20::681a:469, 2606:4700:20::681a:569, 2606:4700:20::ac43:448d
Response IP 104.26.4.105
Found Yes
Hash 0468738c0b2238a98aa991aae4109e10af3c9cfe8138f8fb5d13d33e0961271c
SimHash a8512b8ff7d1

Groups

*
adsbot-google

Rule Path
Disallow /d/
Disallow /read/
Back to top

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
Back to top