wen4dutama.com
robots.txt

Robots Exclusion Standard data for wen4dutama.com

Resource Scan

Scan Details

Site Domain wen4dutama.com
Base Domain wen4dutama.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2025-10-08T10:20:42+00:00
Next Scan 2026-01-06T10:20:42+00:00

Last Successful Scan

Scanned2025-05-18T22:45:47+00:00
URL https://wen4dutama.com/robots.txt
Redirect https://wen4dselalu.com/robots.txt
Redirect Domain wen4dselalu.com
Redirect Base wen4dselalu.com
Domain IPs 104.21.92.50, 172.67.186.139, 2606:4700:3031::6815:5c32, 2606:4700:3034::ac43:ba8b
Redirect IPs 104.21.38.132, 172.67.222.243, 2606:4700:3032::ac43:def3, 2606:4700:3034::6815:2684
Response IP 104.21.38.132
Found Yes
Hash f6429c5d029945f168a1af081a23b731063c6292f3dcba7fae2d3fab7a0fd831
SimHash 6541c30355d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://wen4dselalu.com/sitemap.xml/

Warnings

  • 1 invalid line.