nexlec.com
robots.txt

Robots Exclusion Standard data for nexlec.com

Resource Scan

Scan Details

Site Domain nexlec.com
Base Domain nexlec.com
Scan Status Ok
Last Scan2025-09-23T18:28:31+00:00
Next Scan 2025-09-30T18:28:31+00:00

Last Scan

Scanned2025-09-23T18:28:31+00:00
URL https://nexlec.com/robots.txt
Domain IPs 104.26.10.89, 104.26.11.89, 172.67.69.96, 2606:4700:20::681a:a59, 2606:4700:20::681a:b59, 2606:4700:20::ac43:4560
Response IP 104.26.11.89
Found Yes
Hash 3c88e5969474ef0d884db0c7ee45c6e09b0d7cc8481d8ec7f1323f9432945fcd
SimHash be850d05bd64

Groups

*

Rule Path
Disallow /admin
Disallow /filter
Disallow /*like$
Disallow /*unlike$
Disallow /providers/
Disallow /my/
Disallow /cart
Disallow /login
Disallow /cdn-cgi
Disallow /users/password/new

Other Records

Field Value
sitemap https://nexlec.com/sitemap

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /