kisetoto.click
robots.txt

Robots Exclusion Standard data for kisetoto.click

Resource Scan

Scan Details

Site Domain kisetoto.click
Base Domain kisetoto.click
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-03-29T00:45:04+00:00
Next Scan 2024-06-27T00:45:04+00:00

Last Successful Scan

Scanned2023-11-07T23:44:15+00:00
URL https://kisetoto.click/robots.txt
Redirect https://kisetotojp.com/robots.txt
Redirect Domain kisetotojp.com
Redirect Base kisetotojp.com
Domain IPs 104.21.30.155, 172.67.173.52, 2606:4700:3033::6815:1e9b, 2606:4700:3033::ac43:ad34
Redirect IPs 104.21.37.185, 172.67.212.77, 2606:4700:3032::ac43:d44d, 2606:4700:3035::6815:25b9
Response IP 104.21.37.185
Found Yes
Hash a4f02843be7c3d3af7b718ffe87504042e1253810d7efeea63472df706581c80
SimHash 6141d38357d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://kisetotojp.com/sitemap.xml/

Warnings

  • 1 invalid line.