awdev.my.id
robots.txt

Robots Exclusion Standard data for awdev.my.id

Resource Scan

Scan Details

Site Domain awdev.my.id
Base Domain awdev.my.id
Scan Status Ok
Last Scan2025-10-02T08:47:10+00:00
Next Scan 2025-10-09T08:47:10+00:00

Last Scan

Scanned2025-10-02T08:47:10+00:00
URL https://www.awdev.my.id/robots.txt
Domain IPs 104.21.40.18, 172.67.174.130, 2606:4700:3034::6815:2812, 2606:4700:3034::ac43:ae82
Response IP 104.21.40.18
Found Yes
Hash daf0232ab044b0980f339da80e2a4df04d3b9d3eda580fdacaadb0096c70c6c5
SimHash cb1556504626

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://awdev.my.id/sitemap.txt
sitemap https://www.awdev.my.id/sitemap.txt
sitemap https://blog.awdev.my.id/sitemap.txt
sitemap https://blog.awdev.my.id/sitemap.xml
sitemap https://docker.awdev.my.id/sitemap.txt
sitemap https://docker.awdev.my.id/sitemap.xml
sitemap https://aframe.awdev.my.id/sitemap.txt
sitemap https://aframe.awdev.my.id/sitemap.xml
sitemap https://codeigniter.awdev.my.id/sitemap.txt
sitemap https://codeigniter.awdev.my.id/sitemap.xml
sitemap https://app.awdev.my.id/sitemap.txt
sitemap https://app.awdev.my.id/sitemap.xml
sitemap https://qr.awdev.my.id/sitemap.txt
sitemap https://qr.awdev.my.id/sitemap.xml