adaptasibukanhalangan.idntimes.com
robots.txt

Robots Exclusion Standard data for adaptasibukanhalangan.idntimes.com

Resource Scan

Scan Details

Site Domain adaptasibukanhalangan.idntimes.com
Base Domain idntimes.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-26T18:08:18+00:00
Next Scan 2024-06-24T18:08:18+00:00

Last Successful Scan

Scanned2023-11-28T17:39:26+00:00
URL https://adaptasibukanhalangan.idntimes.com/robots.txt
Domain IPs 13.250.156.108, 3.0.84.91
Response IP 3.0.84.91
Found Yes
Hash 445018b63ffa5d2af660512425b47e8492ff6f0a96549f0053d0d1c1f629b60b
SimHash 1004d910d7d3

Groups

twitterbot

Rule Path
Allow *?utm_source=

googlebot-image

Rule Path
Allow *
Allow /

*

Rule Path
Disallow */ajax/*
Disallow /https%3A//twitter.com/
Disallow /253109699/
Disallow /author/

alexabot

Rule Path
Disallow /*/amp/

Other Records

Field Value
sitemap https://www.idntimes.com/sitemap-post.xml

Warnings

  • 4 invalid lines.