banten.berita24.com
robots.txt

Robots Exclusion Standard data for banten.berita24.com

Resource Scan

Scan Details

Site Domain banten.berita24.com
Base Domain berita24.com
Scan Status Ok
Last Scan2024-10-22T12:34:34+00:00
Next Scan 2024-11-21T12:34:34+00:00

Last Scan

Scanned2024-10-22T12:34:34+00:00
URL https://banten.berita24.com/robots.txt
Domain IPs 142.251.12.121, 2404:6800:4003:c11::79
Response IP 172.253.118.121
Found Yes
Hash c1d6d2f522b9624434644ed3a1934d208c8a372f543968468ca6085d9087b589
SimHash 2b04d670ce92

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://banten.berita24.com/sitemap.xml