Log In Sign Up

physicslog.com
robots.txt

Robots Exclusion Standard data for physicslog.com

Resource Scan

Scan Details

Site Domain physicslog.com
Base Domain physicslog.com
Scan Status Ok
Last Scan2024-06-10T02:35:39+00:00
Next Scan 2024-07-10T02:35:39+00:00

Last Scan

Scanned2024-06-10T02:35:39+00:00
URL https://physicslog.com/robots.txt
Redirect https://www.physicslog.com/robots.txt
Redirect Domain www.physicslog.com
Redirect Base physicslog.com
Domain IPs 104.21.27.169, 172.67.169.148, 2606:4700:3032::ac43:a994, 2606:4700:3033::6815:1ba9
Redirect IPs 104.21.27.169, 172.67.169.148, 2606:4700:3032::ac43:a994, 2606:4700:3033::6815:1ba9
Response IP 104.21.27.169
Found Yes
Hash 58d7f78e92aef65e4945f338e01d4474f6bf4957b495abb702783731339e0c58
SimHash a80a8f09aed7

Groups

*

Rule Path
Disallow /categories/
Disallow /tags/

ia_archiver

Rule Path
Disallow /

archive.org

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.physicslog.com/sitemap.xml
Back to top

Comments

  • robots.txt for https://www.physicslog.com/
  • Please respect the copyright policy.
  • Please be aware that copying whole contents of physicslog.com is not allowed.
  • Instead please follow https://www.physicslog.com/rss.xml
  • Sorry, categories and tags webpage is not available.
  • Sorry internet archive, you should not archive this website.
  • Sorry, wget in its recursive mode is blocked.
  • Sorry, grub client is blocked.
  • Sorry 80legs, you should not crawl vigorously
Back to top

Warnings

  • 2 invalid lines.
Back to top