minbebis.com
robots.txt

Robots Exclusion Standard data for minbebis.com

Resource Scan

Scan Details

Site Domain minbebis.com
Base Domain minbebis.com
Scan Status Ok
Last Scan2024-11-11T02:53:36+00:00
Next Scan 2024-11-18T02:53:36+00:00

Last Scan

Scanned2024-11-11T02:53:36+00:00
URL https://minbebis.com/robots.txt
Redirect https://www.familjeliv.se/robots.txt
Redirect Domain www.familjeliv.se
Redirect Base familjeliv.se
Domain IPs 104.21.92.252, 172.67.201.183, 2606:4700:3032::ac43:c9b7, 2606:4700:3036::6815:5cfc
Redirect IPs 104.26.0.172, 104.26.1.172, 172.67.75.42, 2606:4700:20::681a:1ac, 2606:4700:20::681a:ac, 2606:4700:20::ac43:4b2a
Response IP 104.26.1.172
Found Yes
Hash cecd5095e01025c7973c6a0c48b7918a63a3574a10c043ad9cf42a9dd0a6412b
SimHash 804489554761

Groups

*

Rule Path
Allow /
Disallow /media/cache
Disallow /leave*
Disallow /create/
Disallow /redir*
Disallow /login*
Disallow /report/

grapeshot

Rule Path
Disallow

Comments

  • Allow the Grapeshot crawler full access