kodomo99mari.com
robots.txt

Robots Exclusion Standard data for kodomo99mari.com

Resource Scan

Scan Details

Site Domain kodomo99mari.com
Base Domain kodomo99mari.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2025-08-06T00:25:49+00:00
Next Scan 2025-11-04T00:25:49+00:00

Last Successful Scan

Scanned2024-12-17T00:24:11+00:00
URL https://kodomo99mari.com/robots.txt
Redirect https://kodomo99sepuh.com/robots.txt
Redirect Domain kodomo99sepuh.com
Redirect Base kodomo99sepuh.com
Domain IPs 104.21.26.160, 172.67.137.46, 2606:4700:3030::ac43:892e, 2606:4700:3035::6815:1aa0
Redirect IPs 104.21.18.63, 172.67.180.180, 2606:4700:3030::6815:123f, 2606:4700:3037::ac43:b4b4
Response IP 172.67.180.180
Found Yes
Hash 34936ecac138062cab26b90499cf0242e3f70c6ca6a697503977d85de6bbd6fa
SimHash 6141d30555d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://kodomo99sepuh.com/sitemap.xml/

Warnings

  • 1 invalid line.