lost-in-code.com
robots.txt
Robots Exclusion Standard data for lost-in-code.com
Resource Scan
Scan Details
Site Domain | lost-in-code.com |
Base Domain | lost-in-code.com |
Scan Status | Ok |
Last Scan | 2024-11-11T03:05:30+00:00 |
Next Scan | 2024-11-18T03:05:30+00:00 |
Last Scan
Scanned | 2024-11-11T03:05:30+00:00 |
URL | https://lost-in-code.com/robots.txt |
Domain IPs | 104.21.2.194, 172.67.129.150, 2606:4700:3031::6815:2c2, 2606:4700:3034::ac43:8196 |
Response IP | 104.21.2.194 |
Found | Yes |
Hash | b7ec841be876638e2198aa7e39155946f4f2e9f3b9a78725288e48a6cff3f376 |
SimHash | 29601f422452 |
Groups
semrushbot
semrushbot-sa
mj12bot
dotbot
rogerbot
megaindex.ru
megaindex.com
megaindex.ru/2.0
alexibot
surveybot
backlinkcrawler
sistrix crawler
sistrix
sistrix
uptimerobot/2.0
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | */*?vId=* |
Disallow | */*?page=* |
Disallow | */*?search=* |
Other Records
Field | Value |
---|---|
sitemap | https://lost-in-code.com/sitemap.xml.gz |
Warnings
- `host` is not a known field.
Comments