frelein.my.id
robots.txt

Robots Exclusion Standard data for frelein.my.id

Resource Scan

Scan Details

Site Domain frelein.my.id
Base Domain frelein.my.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2/15/2025, 1:36:30 AM
Next Scan 5/16/2025, 1:36:30 AM

Last Successful Scan

Scanned10/18/2024, 11:31:39 PM
URL https://www.frelein.my.id/robots.txt
Domain IPs 104.21.73.46, 172.67.140.149, 2606:4700:3030::6815:492e, 2606:4700:3031::ac43:8c95
Response IP 172.67.140.149
Found Yes
Hash 8f9991d9a1a7ee6d2cf559e10977a8ad29f1490ced7f1ee1d9094cfd9e4ce9db
SimHash 4d1152527753

Groups

*

Rule Path
Allow /
Disallow /search
Disallow /search/label/

Other Records

Field Value
sitemap https://www.frelein.my.id/sitemap.xml
sitemap https://www.frelein.my.id/feeds/posts/default
sitemap https://www.frelein.my.id/atom.xml
sitemap https://www.frelein.my.id/rss.xml