Log In Sign Up

poison.org
robots.txt

Robots Exclusion Standard data for poison.org

Resource Scan

Scan Details

Site Domain poison.org
Base Domain poison.org
Scan Status Ok
Last Scan2024-09-08T10:48:07+00:00
Next Scan 2024-10-08T10:48:07+00:00

Last Scan

Scanned2024-09-08T10:48:07+00:00
URL https://poison.org/robots.txt
Redirect https://www.poison.org/robots.txt
Redirect Domain www.poison.org
Redirect Base poison.org
Domain IPs 52.136.127.131
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash f79c23d1861340a151778657ed7febbd608d77290c68d2aae2dd03db32d7c30c
SimHash 29851d450fd0

Groups

*

Rule Path
Disallow /App_Browsers/
Disallow /App_config/
Disallow /App_Data/
Disallow /aspnet_client/
Disallow /bin
Disallow /Library/
Disallow /packages/
Disallow /seotoolkit/
Disallow /sitecore_files/
Disallow /temp/
Disallow /upload/
Back to top

Other Records

Field Value
sitemap https://www.poison.org/site-map.xml
Back to top

Comments

  • webPoisonControl robots.txt file
  • Prevent crawlers from indexing site infrastructure.
Back to top

Warnings

  • 1 invalid line.
Back to top