bahasa.newsbytesapp.com
robots.txt

Robots Exclusion Standard data for bahasa.newsbytesapp.com

Resource Scan

Scan Details

Site Domain bahasa.newsbytesapp.com
Base Domain newsbytesapp.com
Scan Status Ok
Last Scan2025-11-17T22:52:24+00:00
Next Scan 2025-12-01T22:52:24+00:00

Last Scan

Scanned2025-11-17T22:52:24+00:00
URL https://bahasa.newsbytesapp.com/robots.txt
Domain IPs 96.17.180.171, 96.17.180.188
Response IP 23.32.29.9
Found Yes
Hash e43a065c8b823ab7ddb15f57e7d78e85a0a0189c9adeb49b94bbfd8782567660
SimHash b80554762b77

Groups

*

Rule Path
Disallow /iframes/*
Disallow /timeline/*
Disallow /category/*
Disallow /questions/*
Disallow /topic/*
Disallow /search*
Disallow /js/collect.*.js?*
Disallow */fetch/*

mediapartners-google

Rule Path
Disallow /js/collect.*.js?*

googleother

Rule Path
Disallow */story?sr=Glance&*
Disallow */story?gpid=*
Disallow */story?media_version=*
Disallow */story?referrer=*
Disallow */story?summary=*
Disallow */story?sdkv=*
Disallow */story?*utm_*
Disallow */tldr?sr=Glance&*
Disallow */tldr?gpid=*
Disallow */tldr?media_version=*
Disallow */tldr?referrer=*
Disallow */tldr?summary=*
Disallow */tldr?sdkv=*
Disallow */tldr?*utm_*
Disallow /quiz*?sr=Glance&*
Disallow /quiz*?gpid=*
Disallow /quiz*?media_version=*
Disallow /quiz*?referrer=*
Disallow /quiz*?summary=*
Disallow /quiz*?sdkv=*
Disallow /quiz*utm_*
Disallow /word-game*?sr=Glance&*
Disallow /word-game*?gpid=*
Disallow /word-game*?media_version=*
Disallow /word-game*?referrer=*
Disallow /word-game*?summary=*
Disallow /word-game*?sdkv=*
Disallow /word-game*utm_*

Other Records

Field Value
sitemap https://bahasa.newsbytesapp.com/sitemap/general/sitemap.xml
sitemap https://bahasa.newsbytesapp.com/sitemap/googleNews/sitemap.xml