masri.id
robots.txt

Robots Exclusion Standard data for masri.id

Resource Scan

Scan Details

Site Domain masri.id
Base Domain masri.id
Scan Status Ok
Last Scan2024-09-21T08:10:22+00:00
Next Scan 2024-09-28T08:10:22+00:00

Last Scan

Scanned2024-09-21T08:10:22+00:00
URL https://masri.id/robots.txt
Redirect https://www.masri.id/robots.txt
Redirect Domain www.masri.id
Redirect Base masri.id
Domain IPs 104.21.78.183, 172.67.168.84
Redirect IPs 104.21.78.183, 172.67.168.84
Response IP 172.67.168.84
Found Yes
Hash 266a76c4c09b1047f47390db19336e1c5950601db02f258b8324db916bf9f586
SimHash 4b0898424610

Groups

mediapartners-google
*

Rule Path
Allow /search?updated-min=
Allow /search?updated-max=
Allow /search/label/*?updated-min=
Allow /search/label/*?updated-max=
Allow /search*

Other Records

Field Value
sitemap http://www.masri.id/feeds/posts/default?orderby=UPDATED