kaffein.in
robots.txt

Robots Exclusion Standard data for kaffein.in

Resource Scan

Scan Details

Site Domain kaffein.in
Base Domain kaffein.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-20T12:27:49+00:00
Next Scan 2026-02-18T12:27:49+00:00

Last Successful Scan

Scanned2025-07-17T07:57:27+00:00
URL https://kaffein.in/robots.txt
Domain IPs 13.35.37.119, 13.35.37.34, 13.35.37.60, 13.35.37.87
Response IP 13.35.37.87
Found Yes
Hash 8a912599904bf512278b465edaac65b1aa582d8f6748ec7606988dfba83dac96
SimHash 0155ea03c510

Groups

voltron

Rule Path
Disallow /

bender

Rule Path
Disallow /

gort

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://kaffein.in/sitemap.txt

Comments

  • 80legs
  • 80legs' new crawler

Warnings

  • 2 invalid lines.