booli.se
robots.txt

Robots Exclusion Standard data for booli.se

Resource Scan

Scan Details

Site Domain booli.se
Base Domain booli.se
Scan Status Ok
Last Scan2024-09-26T15:53:12+00:00
Next Scan 2024-10-03T15:53:12+00:00

Last Scan

Scanned2024-09-26T15:53:12+00:00
URL https://booli.se/robots.txt
Redirect https://www.booli.se/robots.txt
Redirect Domain www.booli.se
Redirect Base booli.se
Domain IPs 75.2.112.240
Redirect IPs 52.222.144.108, 52.222.144.129, 52.222.144.14, 52.222.144.85
Response IP 13.226.2.128
Found Yes
Hash 4f6341f5ab4bc387a87243be069472e50800bfc1cc9026425ed0070f8e6a44fc
SimHash 712cd25b8dd2

Groups

*

Rule Path
Disallow /auth/
Disallow /save/
Disallow /error/
Disallow /rss/
Disallow /user/
Disallow /mail/
Disallow /siteFull.html
Disallow /503.html
Disallow /redirect
Disallow /redirect/
Disallow /embed*

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

nettrapport crawler

Rule Path
Disallow /

genieo

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.booli.se/sitemap.xml