mag.digle.tokyo
robots.txt
Robots Exclusion Standard data for mag.digle.tokyo
Resource Scan
Scan Details
Site Domain | mag.digle.tokyo |
Base Domain | digle.tokyo |
Scan Status | Ok |
Last Scan | 2024-11-17T10:32:55+00:00 |
Next Scan | 2024-12-17T10:32:55+00:00 |
Last Scan
Scanned | 2024-11-17T10:32:55+00:00 |
URL | https://mag.digle.tokyo/robots.txt |
Domain IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132 |
Response IP | 199.232.46.132 |
Found | Yes |
Hash | e5f2bb22cd132ba332368374077ccca0bb569aa160f35597a63f5faa78bd6198 |
SimHash | 6b98d8806392 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /tag/ |
Disallow | /tag-*/ |
Disallow | /?s= |
Disallow | /*amp%3D1 |
Disallow | /generator/ |
Disallow | /generator-event/ |
Disallow | /*feed |
Disallow | /*page/ |
Disallow | /*?articleview=true&comment=true |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://mag.digle.tokyo/sitemap-news.xml |
sitemap | https://mag.digle.tokyo/sitemap.xml.gz |
Comments