Log In Sign Up

mashingup.jp
robots.txt

Robots Exclusion Standard data for mashingup.jp

Resource Scan

Scan Details

Site Domain mashingup.jp
Base Domain mashingup.jp
Scan Status Ok
Last Scan2024-09-21T13:50:07+00:00
Next Scan 2024-09-28T13:50:07+00:00

Last Scan

Scanned2024-09-21T13:50:07+00:00
URL https://mashingup.jp/robots.txt
Redirect https://www.mashingup.jp/robots.txt
Redirect Domain www.mashingup.jp
Redirect Base mashingup.jp
Domain IPs 3.165.102.58, 3.165.102.6, 3.165.102.62, 3.165.102.92
Redirect IPs 3.165.102.58, 3.165.102.6, 3.165.102.62, 3.165.102.92
Response IP 3.165.102.58
Found Yes
Hash adffac74678123388ce5d5fd3a1f2007518fd14f8165cb5de46d8e30770ab946
SimHash 6247d0b499d3

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

slurp

Rule Path
Disallow /2019/09/ai_score_shindan_jscore_2.html
Disallow /2018/11/dailies_total_1.html
Disallow /2018/11/microsoft365_surface.html
Disallow /2018/11/nanox.html
Disallow /2018/11/kose_the_wrinkless.html
Disallow /2018/03/163935.html
Disallow /2019/12/ai_score_shindan_jscore_3.html
Disallow /2019/12/ai_score_shindan_jscore_4.html
Disallow /2020/03/ai_score_shindan_jscore_5.html

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.cafeglobe.com/sitemap_index.xml
sitemap https://www.cafeglobe.com/google_news_sitemap.xml
Back to top