mammasidan.se
robots.txt

Robots Exclusion Standard data for mammasidan.se

Resource Scan

Scan Details

Site Domain mammasidan.se
Base Domain mammasidan.se
Scan Status Ok
Last Scan2024-11-10T22:23:08+00:00
Next Scan 2024-11-17T22:23:08+00:00

Last Scan

Scanned2024-11-10T22:23:08+00:00
URL https://mammasidan.se/robots.txt
Redirect https://www.familjeliv.se/robots.txt
Redirect Domain www.familjeliv.se
Redirect Base familjeliv.se
Domain IPs 104.21.43.90, 172.67.177.105, 2606:4700:3033::6815:2b5a, 2606:4700:3034::ac43:b169
Redirect IPs 104.26.0.172, 104.26.1.172, 172.67.75.42, 2606:4700:20::681a:1ac, 2606:4700:20::681a:ac, 2606:4700:20::ac43:4b2a
Response IP 104.26.0.172
Found Yes
Hash cecd5095e01025c7973c6a0c48b7918a63a3574a10c043ad9cf42a9dd0a6412b
SimHash 804489554761

Groups

*

Rule Path
Allow /
Disallow /media/cache
Disallow /leave*
Disallow /create/
Disallow /redir*
Disallow /login*
Disallow /report/

grapeshot

Rule Path
Disallow

Comments

  • Allow the Grapeshot crawler full access