idpost.co.id
robots.txt

Robots Exclusion Standard data for idpost.co.id

Resource Scan

Scan Details

Site Domain idpost.co.id
Base Domain idpost.co.id
Scan Status Ok
Last Scan2024-11-14T12:06:54+00:00
Next Scan 2024-11-21T12:06:54+00:00

Last Scan

Scanned2024-11-14T12:06:54+00:00
URL https://idpost.co.id/robots.txt
Domain IPs 104.21.19.172, 172.67.187.3, 2606:4700:3036::6815:13ac, 2606:4700:3036::ac43:bb03
Response IP 104.21.19.172
Found Yes
Hash b43c308a7b7ba67d27e027e30b847cb75411d1535d1f276f4518b9d3e19dd549
SimHash 490cc2f676b1

Groups

*
googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

Other Records

Field Value
sitemap https://idpost.co.id/sitemap_index.xml
sitemap https://idpost.co.id/post-sitemap.xml
sitemap https://idpost.co.id/page-sitemap.xml
sitemap https://idpost.co.id/category-sitemap.xml
sitemap https://idpost.co.id/post_tag-sitemap.xml