str.se
robots.txt

Robots Exclusion Standard data for str.se

Resource Scan

Scan Details

Site Domain str.se
Base Domain str.se
Scan Status Ok
Last Scan2025-08-09T20:05:15+00:00
Next Scan 2025-09-08T20:05:15+00:00

Last Scan

Scanned2025-08-09T20:05:15+00:00
URL https://str.se/robots.txt
Domain IPs 20.31.244.143
Response IP 20.31.244.143
Found Yes
Hash d03fe6eb026d1f1584a10dd386ba64318cbfe0ba5c677019f6b7a64d2681e476
SimHash a142c560df39

Groups

*

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

candroid

Rule Path
Disallow /

python-httpx

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

typo3cms

Rule Path
Disallow /

newsmachine

Rule Path
Disallow /

vizzit

Rule Path
Disallow /

sogou+web+spider

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

feedly

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.str.se/sitemap.xml