csdaily.id
robots.txt

Robots Exclusion Standard data for csdaily.id

Resource Scan

Scan Details

Site Domain csdaily.id
Base Domain csdaily.id
Scan Status Ok
Last Scan2024-09-25T22:51:59+00:00
Next Scan 2024-10-02T22:51:59+00:00

Last Scan

Scanned2024-09-25T22:51:59+00:00
URL https://csdaily.id/robots.txt
Redirect https://www.csdaily.id/robots.txt
Redirect Domain www.csdaily.id
Redirect Base csdaily.id
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.175.121, 2404:6800:4003:c01::79
Response IP 64.233.170.121
Found Yes
Hash f9f9147c7ec0a240d756ac3795f0bf727a38f2b32e8184ca52ead5dcd7593082
SimHash 6914d4504f93

Groups

*

Rule Path
Allow /
Disallow /search

Other Records

Field Value
sitemap https://www.csdaily.id/sitemap.xml