Log In Sign Up

plind.us
robots.txt

Robots Exclusion Standard data for plind.us

Resource Scan

Scan Details

Site Domain plind.us
Base Domain plind.us
Scan Status Ok
Last Scan2024-05-21T17:38:04+00:00
Next Scan 2024-06-20T17:38:04+00:00

Last Scan

Scanned2024-05-21T17:38:04+00:00
URL https://plind.us/robots.txt
Domain IPs 2600:9000:2163:200:0:123f:d80:93a1, 2600:9000:2163:4200:0:123f:d80:93a1, 2600:9000:2163:5200:0:123f:d80:93a1, 2600:9000:2163:6800:0:123f:d80:93a1, 2600:9000:2163:ba00:0:123f:d80:93a1, 2600:9000:2163:c00:0:123f:d80:93a1, 2600:9000:2163:de00:0:123f:d80:93a1, 2600:9000:2163:f800:0:123f:d80:93a1, 99.84.66.13, 99.84.66.43, 99.84.66.51, 99.84.66.67
Response IP 18.165.171.79
Found Yes
Hash 1ffe6c1adc4811aaae4060ec8faa421513606d704bd54f1fc89d3baf67e409dd
SimHash 2020a9d72cd6

Groups

*

Rule Path
Disallow /css/
Disallow /img/
Disallow /js/
Disallow /ssi/
Back to top

Comments

  • File Name robots.txt
  • Project plind.us
  • Version 9.0.0
  • Author Peter Lindstrom
  • Purpose Used by spiders to allow/disallow indexing of certain pages.
  • Copyright 2003-2022, Peter Lindstrom
  • Link https://github.com/plindstrom/plind.us
Back to top