lastlog.it
robots.txt

Robots Exclusion Standard data for lastlog.it

Resource Scan

Scan Details

Site Domain lastlog.it
Base Domain lastlog.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-24T23:42:22+00:00
Next Scan 2025-12-23T23:42:22+00:00

Last Successful Scan

Scanned2023-08-27T14:04:49+00:00
URL https://lastlog.it/robots.txt
Domain IPs 66.6.44.4
Response IP 66.6.44.4
Found Yes
Hash c3b60a18b8b5f7432c208e625c88715d2fcaceee1bebc042570f5a49c240940a
SimHash 6926d861e633

Groups

*

Rule Path
Disallow /random
Disallow /day
Disallow /sticky-ad-iframe.html
Disallow /privacy/consent

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://lastlog.it/sitemap.xml

Comments

  • OpenAI's crawler