drijek.my.id
robots.txt

Robots Exclusion Standard data for drijek.my.id

Resource Scan

Scan Details

Site Domain drijek.my.id
Base Domain drijek.my.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-09T03:15:52+00:00
Next Scan 2025-10-07T03:15:52+00:00

Last Successful Scan

Scanned2023-12-18T02:54:05+00:00
URL https://drijek.my.id/robots.txt
Redirect https://www.drijek.my.id/robots.txt
Redirect Domain www.drijek.my.id
Redirect Base drijek.my.id
Domain IPs 216.239.32.21
Redirect IPs 142.251.12.121, 2404:6800:4003:c0f::79
Response IP 74.125.200.121
Found Yes
Hash eed296d37349ba5c044e006fd98d0bc128e77caed4d16fbe6d26050879b780ff
SimHash 6a0d8a62cb92

Groups

mediapartners-google

Rule Path
Disallow /p/disclaimer.html
Disallow /search
Disallow /search/label/
Disallow /p/contact-us.html
Disallow /p/about-us.html
Disallow /p/priva

*

Rule Path
Allow /
Disallow /p/disclaimer.html
Disallow /search
Disallow /search/label/
Disallow /p/contact-us.html
Disallow /p/about-us.html
Disallow /p/privacy-police.html
Disallow /p/shortlink.html
Disallow /p/safelink-generator.html
Disallow /p/terms-of-service.html

Other Records

Field Value
sitemap https://www.drijek.my.id/sitemap.xml
sitemap https://www.drijek.my.id/sitemap.xml?page=1
sitemap https://www.drijek.my.id/sitemap.xml?page=2
sitemap https://www.drijek.my.id/sitemap-pages.xml
sitemap https://www.drijek.my.id/atom.xml
sitemap https://www.drijek.my.id/feeds/posts/default?orderby=updated&max-results=999