autocar.jp
robots.txt
Robots Exclusion Standard data for autocar.jp
Resource Scan
Scan Details
Site Domain | autocar.jp |
Base Domain | autocar.jp |
Scan Status | Ok |
Last Scan | 2024-05-16T09:13:32+00:00 |
Next Scan | 2024-05-23T09:13:32+00:00 |
Last Scan
Scanned | 2024-05-16T09:13:32+00:00 |
URL | https://autocar.jp/robots.txt |
Redirect | https://www.autocar.jp/robots.txt |
Redirect Domain | www.autocar.jp |
Redirect Base | autocar.jp |
Domain IPs | 104.26.10.173, 104.26.11.173, 172.67.69.26, 2606:4700:20::681a:aad, 2606:4700:20::681a:bad, 2606:4700:20::ac43:451a |
Redirect IPs | 104.26.10.173, 104.26.11.173, 172.67.69.26, 2606:4700:20::681a:aad, 2606:4700:20::681a:bad, 2606:4700:20::ac43:451a |
Response IP | 172.67.69.26 |
Found | Yes |
Hash | ad66ce0433f4e3033b6ff7b8e599eea3b375873432a501cb22dfd7da5d75a283 |
SimHash | a1b0c1e28c92 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp- |
Allow | /wp-admin/admin-ajax.php |
Disallow | *paged%3D |
Disallow | /?s= |
Disallow | *%26s%3D |
Disallow | /search |
Allow | /search/ |
Disallow | /author |
Disallow | *?attachment_id= |
Disallow | */feed |
Disallow | */*feed |
Disallow | */rss |
Disallow | */embed |
Allow | /wp-content/uploads/ |
Allow | /wp-content/themes/ |
Disallow | /wp-content/themes/base/timthumb.php |
Allow | /*/*.js |
Allow | /*/*.css |
Allow | /wp-*.png |
Allow | /wp-*.jpg |
Allow | /wp-*.jpeg |
Allow | /wp-*.gif |
Allow | /wp-*.svg |
Allow | /wp-*.pdf |
Other Records
Field | Value |
---|---|
sitemap | https://www.autocar.jp/sitemap.xml |