mahfudh.web.id
robots.txt

Robots Exclusion Standard data for mahfudh.web.id

Resource Scan

Scan Details

Site Domain mahfudh.web.id
Base Domain mahfudh.web.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-12T12:00:42+00:00
Next Scan 2026-02-10T12:00:42+00:00

Last Successful Scan

Scanned2024-01-22T19:04:38+00:00
URL https://mahfudh.web.id/robots.txt
Redirect https://www.mahfudh.web.id/robots.txt
Redirect Domain www.mahfudh.web.id
Redirect Base mahfudh.web.id
Domain IPs 104.21.36.188, 172.67.198.145, 2606:4700:3033::6815:24bc, 2606:4700:3037::ac43:c691
Redirect IPs 104.21.36.188, 172.67.198.145, 2606:4700:3033::6815:24bc, 2606:4700:3037::ac43:c691
Response IP 104.21.36.188
Found Yes
Hash 6c1f112e3439603c191148b67c781e129a17d8385ffc9c37be20d2eba14fdb30
SimHash 6b04de40c692

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.mahfudh.web.id/sitemap.xml