sizi99mantul.com
robots.txt

Robots Exclusion Standard data for sizi99mantul.com

Resource Scan

Scan Details

Site Domain sizi99mantul.com
Base Domain sizi99mantul.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-09-24T00:21:11+00:00
Next Scan 2024-12-23T00:21:11+00:00

Last Successful Scan

Scanned2024-02-04T23:44:07+00:00
URL https://sizi99mantul.com/robots.txt
Redirect https://sizi99terbaru.com/robots.txt
Redirect Domain sizi99terbaru.com
Redirect Base sizi99terbaru.com
Domain IPs 104.21.15.63, 172.67.161.194, 2606:4700:3033::6815:f3f, 2606:4700:3037::ac43:a1c2
Redirect IPs 104.21.90.216, 172.67.161.110, 2606:4700:3033::ac43:a16e, 2606:4700:3036::6815:5ad8
Response IP 172.67.161.110
Found Yes
Hash 7f8715d46e2d313d260df0938e3479df2fc2e040d78ee4aa2ca6338a0807d5ae
SimHash 6159d30557d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://sizi99terbaru.com/sitemap.xml

Warnings

  • 1 invalid line.