kodomo99pesona.com
robots.txt

Robots Exclusion Standard data for kodomo99pesona.com

Resource Scan

Scan Details

Site Domain kodomo99pesona.com
Base Domain kodomo99pesona.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan5/29/2025, 12:12:39 AM
Next Scan 6/12/2025, 12:12:39 AM

Last Successful Scan

Scanned4/20/2025, 11:43:12 PM
URL https://kodomo99pesona.com/robots.txt
Redirect https://kodomo99suka.com/robots.txt
Redirect Domain kodomo99suka.com
Redirect Base kodomo99suka.com
Domain IPs 104.21.54.181, 172.67.141.6, 2606:4700:3030::6815:36b5, 2606:4700:3036::ac43:8d06
Redirect IPs 104.21.37.120, 172.67.208.24, 2606:4700:3030::6815:2578, 2606:4700:3033::ac43:d018
Response IP 172.67.208.24
Found Yes
Hash 02a542548ae82be36d78742326c34ea7d9492b706ae7bf570be04b58cbc01818
SimHash 6159d38555d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://kodomo99suka.com/sitemap.xml/

Warnings

  • 1 invalid line.