cafeglobe.com
robots.txt
Robots Exclusion Standard data for cafeglobe.com
Resource Scan
Scan Details
Site Domain | cafeglobe.com |
Base Domain | cafeglobe.com |
Scan Status | Ok |
Last Scan | 2024-09-23T14:28:51+00:00 |
Next Scan | 2024-09-30T14:28:51+00:00 |
Last Scan
Scanned | 2024-09-23T14:28:51+00:00 |
URL | https://cafeglobe.com/robots.txt |
Redirect | https://www.mashingup.jp/robots.txt |
Redirect Domain | www.mashingup.jp |
Redirect Base | mashingup.jp |
Domain IPs | 108.157.254.114, 108.157.254.6, 108.157.254.92, 108.157.254.93 |
Redirect IPs | 3.165.102.58, 3.165.102.6, 3.165.102.62, 3.165.102.92 |
Response IP | 3.165.102.62 |
Found | Yes |
Hash | adffac74678123388ce5d5fd3a1f2007518fd14f8165cb5de46d8e30770ab946 |
SimHash | 6247d0b499d3 |
Groups
slurp
Rule | Path |
---|---|
Disallow | /2019/09/ai_score_shindan_jscore_2.html |
Disallow | /2018/11/dailies_total_1.html |
Disallow | /2018/11/microsoft365_surface.html |
Disallow | /2018/11/nanox.html |
Disallow | /2018/11/kose_the_wrinkless.html |
Disallow | /2018/03/163935.html |
Disallow | /2019/12/ai_score_shindan_jscore_3.html |
Disallow | /2019/12/ai_score_shindan_jscore_4.html |
Disallow | /2020/03/ai_score_shindan_jscore_5.html |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
sitemap | https://www.cafeglobe.com/sitemap_index.xml |
sitemap | https://www.cafeglobe.com/google_news_sitemap.xml |