widnr.widen.net
robots.txt

Robots Exclusion Standard data for widnr.widen.net

Resource Scan

Scan Details

Site Domain widnr.widen.net
Base Domain widen.net
Scan Status Ok
Last Scan2024-11-11T17:51:07+00:00
Next Scan 2024-11-25T17:51:07+00:00

Last Scan

Scanned2024-11-11T17:51:07+00:00
URL https://widnr.widen.net/robots.txt
Domain IPs 108.156.133.115, 108.156.133.21, 108.156.133.76, 108.156.133.86
Response IP 108.156.133.21
Found Yes
Hash be1733ac447528238c415708ba201513acb5a494c435efebc62924c7f7e8149d
SimHash c844cb16cfb1

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /content/
Allow /view/
Disallow /

Comments

  • Twitter cards require Twitterbot access to all paths