rollingstonejapan.com
robots.txt
Robots Exclusion Standard data for rollingstonejapan.com
Resource Scan
Scan Details
Site Domain | rollingstonejapan.com |
Base Domain | rollingstonejapan.com |
Scan Status | Ok |
Last Scan | 2024-10-30T07:45:49+00:00 |
Next Scan | 2024-11-06T07:45:49+00:00 |
Last Scan
Scanned | 2024-10-30T07:45:49+00:00 |
URL | https://rollingstonejapan.com/robots.txt |
Domain IPs | 18.181.58.150, 52.193.210.224, 54.92.6.222 |
Response IP | 52.193.210.224 |
Found | Yes |
Hash | 9c6d3a936ffa1e9cb631e3c69c81fb965307d3c6ef8dea93418d0770a63be3a7 |
SimHash | a8058ba483d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /articles/detail/*https%3A/ |
Disallow | /articles/detail/*http%3A/ |
Disallow | /articles/detail/*/-*/ |
Disallow | /authentication/*/ |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://rollingstonejapan.com/sitemap.xml |