djob.docomo.ne.jp
robots.txt
Robots Exclusion Standard data for djob.docomo.ne.jp
Resource Scan
Scan Details
Site Domain | djob.docomo.ne.jp |
Base Domain | docomo.ne.jp |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-19T16:05:49+00:00 |
Next Scan | 2024-08-17T16:05:49+00:00 |
Last Successful Scan
Scanned | 2023-06-30T08:55:09+00:00 |
URL | https://djob.docomo.ne.jp/robots.txt |
Domain IPs | 18.182.207.66, 52.193.75.232 |
Response IP | 52.193.75.232 |
Found | Yes |
Hash | 506b43277a434beb3b174e28eecf7ab61724ee0909971355d891e5c6272a8f5e |
SimHash | 6a4ef8344c1a |
Groups
*
Rule | Path |
---|---|
Disallow | /login |
Disallow | /logout |
Disallow | /entries/ |
Disallow | /mypage/ |
Disallow | /inquiries/ |
Disallow | /ajax/ |
Disallow | /keeps |
Disallow | /history |
Disallow | /search_history |
Disallow | /jump.json |
Disallow | /search |
Disallow | /keep/ |
Disallow | /kyujin/ |
Disallow | /image/ |
Disallow | /alive_check |
Disallow | /initial_display_naibu_link |
Disallow | /arubaito/ |
Disallow | /search_count.json |
Disallow | /haken/ |
Disallow | /shain/ |
Other Records
Field | Value |
---|---|
sitemap | https://djob.docomo.ne.jp/sitemap_index.xml |
sitemap | https://djob.docomo.ne.jp/zsitemaps/sitemap_index_pages.xml |