Log In Sign Up

anglo-list.com
robots.txt

Robots Exclusion Standard data for anglo-list.com

Resource Scan

Scan Details

Site Domain anglo-list.com
Base Domain anglo-list.com
Scan Status Ok
Last Scan2025-12-24T12:34:28+00:00
Next Scan 2025-12-31T12:34:28+00:00

Last Scan

Scanned2025-12-24T12:34:28+00:00
URL https://anglo-list.com/robots.txt
Domain IPs 139.162.154.66
Response IP 139.162.154.66
Found Yes
Hash cb93ae82c8b19cb0fc5e441a8e7e8f2afd70c9291e647d5faacebc71100deb34
SimHash 1a3f43050392

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/
Back to top

Other Records

Field Value
sitemap https://anglo-list.com/post-sitemap1.xml
Back to top

Comments

  • This robots.txt file requests that search engines and other
  • automated web-agents don't try to index the files in this
  • directory (/). This file is required in the event that you
  • use OpenX without virtual domains (i.e. you use a single URL
  • to run both the admin interface and the delivery engine),
  • and have the web root set to this directory.
Back to top