familjeliv.se
robots.txt

Robots Exclusion Standard data for familjeliv.se

Resource Scan

Scan Details

Site Domain familjeliv.se
Base Domain familjeliv.se
Scan Status Ok
Last Scan2024-04-26T06:19:35+00:00
Next Scan 2024-05-03T06:19:35+00:00

Last Scan

Scanned2024-04-26T06:19:35+00:00
URL https://familjeliv.se/robots.txt
Redirect https://www.familjeliv.se/robots.txt
Redirect Domain www.familjeliv.se
Redirect Base familjeliv.se
Domain IPs 104.26.0.172, 104.26.1.172, 172.67.75.42, 2606:4700:20::681a:1ac, 2606:4700:20::681a:ac, 2606:4700:20::ac43:4b2a
Redirect IPs 104.26.0.172, 104.26.1.172, 172.67.75.42, 2606:4700:20::681a:1ac, 2606:4700:20::681a:ac, 2606:4700:20::ac43:4b2a
Response IP 172.67.75.42
Found Yes
Hash cecd5095e01025c7973c6a0c48b7918a63a3574a10c043ad9cf42a9dd0a6412b
SimHash 804489554761

Groups

*

Rule Path
Allow /
Disallow /media/cache
Disallow /leave*
Disallow /create/
Disallow /redir*
Disallow /login*
Disallow /report/

grapeshot

Rule Path
Disallow

Comments

  • Allow the Grapeshot crawler full access