kisetoto.tech
robots.txt

Robots Exclusion Standard data for kisetoto.tech

Resource Scan

Scan Details

Site Domain kisetoto.tech
Base Domain kisetoto.tech
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-15T06:34:11+00:00
Next Scan 2025-12-14T06:34:11+00:00

Last Successful Scan

Scanned2023-11-02T23:49:59+00:00
URL https://kisetoto.tech/robots.txt
Redirect https://kisetoto.dev/robots.txt
Redirect Domain kisetoto.dev
Redirect Base kisetoto.dev
Domain IPs 104.21.10.156, 172.67.131.138, 2606:4700:3035::6815:a9c, 2606:4700:3037::ac43:838a
Redirect IPs 104.21.5.158, 172.67.133.154, 2606:4700:3030::ac43:859a, 2606:4700:3036::6815:59e
Response IP 172.67.133.154
Found Yes
Hash 469593b575106270b01821f9e6ef9035c8ebe05d4f5bd613e34ea937c8c90340
SimHash 6541d38357d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://kisetoto.dev/sitemap.xml

Warnings

  • 1 invalid line.