hercodigital.id
robots.txt

Robots Exclusion Standard data for hercodigital.id

Resource Scan

Scan Details

Site Domain hercodigital.id
Base Domain hercodigital.id
Scan Status Ok
Last Scan2025-10-03T21:07:20+00:00
Next Scan 2025-11-02T21:07:20+00:00

Last Scan

Scanned2025-10-03T21:07:20+00:00
URL https://hercodigital.id/robots.txt
Redirect https://www.hercodigital.id/robots.txt
Redirect Domain www.hercodigital.id
Redirect Base hercodigital.id
Domain IPs 104.21.55.205, 172.67.172.200, 2606:4700:3032::6815:37cd, 2606:4700:3032::ac43:acc8
Redirect IPs 104.21.55.205, 172.67.172.200, 2606:4700:3032::6815:37cd, 2606:4700:3032::ac43:acc8
Response IP 104.21.55.205
Found Yes
Hash 7ec65d1de4b714113c28040b29f6e283e90a49d699313b02ab104418d582c6da
SimHash 691d19006073

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /cdn-cgi/
Disallow /wp-admin
Disallow /comments/feed/
Disallow /wp-includes
Disallow /wp-login.php?itsec-hb-token=kantor&redirect_to=
Disallow /*/?utm_source=
Disallow /*/form-order
Disallow /stories/hsm-ads/
Disallow */page/
Disallow */amp/
Disallow */?gclid=
Disallow */lib-owl-carousel.min.css?ver=47f67e5d13f2b771dcd9fff3ce749ca6*
Disallow */lib-owl-carousel.min.css?ver=2.0.69.1*
Disallow */lib-owl-carousel.min.css?ver=*
Disallow */1000*
Allow /
Allow /wp-content/uploads
Allow /wp-admin/admin-ajax.php

oai-searchbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

httrack

Rule Path
Disallow /

wget

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hercodigital.id/sitemap_index.xml