bershatsky.net
robots.txt

Robots Exclusion Standard data for bershatsky.net

Resource Scan

Scan Details

Site Domain bershatsky.net
Base Domain bershatsky.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-04-07T12:29:07+00:00
Next Scan 2025-04-14T12:29:07+00:00

Last Successful Scan

Scanned2025-03-30T12:28:52+00:00
URL https://bershatsky.net/robots.txt
Domain IPs 104.21.94.142, 172.67.136.218, 2606:4700:3035::6815:5e8e, 2606:4700:3037::ac43:88da
Response IP 172.67.136.218
Found Yes
Hash b7870ca481ed9747d03066bc7a22e3f163d96ab0e87ad3c945fb2b1afdb7fa1b
SimHash a24403a265b3

Groups

*

Rule Path
Allow /share/
Allow /api/assets/

*

Rule Path
Disallow /

Comments

  • Allow social media access og Tags
  • https://www.robotstxt.org/robotstxt.html