beritafajar.com
robots.txt

Robots Exclusion Standard data for beritafajar.com

Resource Scan

Scan Details

Site Domain beritafajar.com
Base Domain beritafajar.com
Scan Status Ok
Last Scan2024-09-29T17:10:40+00:00
Next Scan 2024-10-06T17:10:40+00:00

Last Scan

Scanned2024-09-29T17:10:40+00:00
URL https://beritafajar.com/robots.txt
Domain IPs 104.21.52.40, 172.67.195.15, 2606:4700:3035::ac43:c30f, 2606:4700:3036::6815:3428
Response IP 172.67.195.15
Found Yes
Hash ea6c4b7b45fb0b5d1fe9849313a1c855511ea6ca6ec5466c40021890ae632eb4
SimHash 4925d9758933

Groups

*
googlebot

Rule Path
Allow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://beritafajar.com/sitemap_index.xml
sitemap https://beritafajar.com/post-sitemap.xml