osepeense.com
robots.txt

Robots Exclusion Standard data for osepeense.com

Resource Scan

Scan Details

Site Domain osepeense.com
Base Domain osepeense.com
Scan Status Ok
Last Scan2024-11-13T05:55:46+00:00
Next Scan 2024-11-20T05:55:46+00:00

Last Scan

Scanned2024-11-13T05:55:46+00:00
URL https://osepeense.com/robots.txt
Domain IPs 191.6.212.61, 2804:10:8001::212:61
Response IP 191.6.212.61
Found Yes
Hash 2131c6459600e330c325d493f68e9b92071cc4c985807d228126c4dc301fa072
SimHash 48505091c7e5

Groups

*
googlebot

Rule Path
Allow *

feedfetcher-google

Rule Path
Allow *

bingbot

Rule Path
Allow *

slurp

Rule Path
Allow *

facebot

Rule Path
Allow *

facebookexternalhit

Rule Path
Allow *

ia_archiver

Rule Path
Allow *

twitterbot

Rule Path
Allow *

*

Rule Path
Disallow /