Log In Sign Up

hue.web.id
robots.txt

Robots Exclusion Standard data for hue.web.id

Resource Scan

Scan Details

Site Domain hue.web.id
Base Domain hue.web.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-05T21:48:56+00:00
Next Scan 2026-01-04T21:48:56+00:00

Last Successful Scan

Scanned2025-09-06T18:17:18+00:00
URL https://hue.web.id/robots.txt
Domain IPs 104.21.17.142, 172.67.176.212, 2606:4700:3033::ac43:b0d4, 2606:4700:3035::6815:118e
Response IP 172.67.176.212
Found Yes
Hash b9a573d4c64768231bbe74c03eb42fbe034348f6d537604b107beab89a2ffb16
SimHash 78089942a9a2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

amazonbot
applebot-extended
ccbot
claudebot
gptbot
google-extended
googleother
meta-externalagent
facebookbot

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit
barkrowler
dataforseobot
dotbot
rogerbot
semrushbot
siteauditbot
semrushbot-ba

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://hue.web.id/sitemap.xml
Back to top