pelita.co
robots.txt

Robots Exclusion Standard data for pelita.co

Resource Scan

Scan Details

Site Domain pelita.co
Base Domain pelita.co
Scan Status Ok
Last Scan2024-09-20T02:57:58+00:00
Next Scan 2024-09-27T02:57:58+00:00

Last Scan

Scanned2024-09-20T02:57:58+00:00
URL https://pelita.co/robots.txt
Redirect https://www.pelita.co/robots.txt
Redirect Domain www.pelita.co
Redirect Base pelita.co
Domain IPs 18.155.68.103, 18.155.68.126, 18.155.68.28, 18.155.68.45
Redirect IPs 18.155.68.103, 18.155.68.126, 18.155.68.28, 18.155.68.45
Response IP 18.155.68.45
Found Yes
Hash 894b013c87fb8d6e1302bea08f6d0cf6fb546e398cd40dadb2224ff52d3e0fe8
SimHash 61459f44c714

Groups

mediapartners-google

Rule Path
Disallow

googlebot

Rule Path
Disallow

feedfetcher-google

Rule Path
Disallow

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /
Allow /wp-json/rankmath/v1/updateCheck
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /kanal/
Disallow /topik/
Disallow /jurnalis/
Disallow /cdn-cgi/
Disallow */feed/
Disallow /amp/

Other Records

Field Value
sitemap https://www.pelita.co/sitemap_index.xml
sitemap https://www.pelita.co/news-sitemap.xml