workinjapan.today
robots.txt
Robots Exclusion Standard data for workinjapan.today
Resource Scan
Scan Details
Site Domain | workinjapan.today |
Base Domain | workinjapan.today |
Scan Status | Ok |
Last Scan | 2024-11-12T13:25:53+00:00 |
Next Scan | 2024-12-12T13:25:53+00:00 |
Last Scan
Scanned | 2024-11-12T13:25:53+00:00 |
URL | https://workinjapan.today/robots.txt |
Domain IPs | 13.33.88.104, 13.33.88.4, 13.33.88.79, 13.33.88.8 |
Response IP | 13.33.88.8 |
Found | Yes |
Hash | eceb0b596410b71a9ae5b61f04388ebc3c291c213473a6a3d431c9eefea9373b |
SimHash | 2070231a1fb9 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /wp-admin/ | - |
Allow | /wp-admin/admin-ajax.php | - |
Disallow | *?s= | search |
Disallow | *%26s%3D | search |
Disallow | /search/ | search |
Disallow | /author/ | author's archive |
Disallow | /users/ | authors' archive |
Disallow | */trackback | trackbacks, comment notifications about new backlink to the page |
Disallow | */feed | all feeds |
Disallow | */rss | rss feed |
Disallow | */embed | all embeds |
Disallow | /xmlrpc.php | WordPress API file |
Other Records
Field | Value |
---|---|
sitemap | https://workinjapan.today/sitemap.xml |