night.jp
robots.txt

Robots Exclusion Standard data for night.jp

Resource Scan

Scan Details

Site Domain night.jp
Base Domain night.jp
Scan Status Ok
Last Scan2024-11-13T17:03:17+00:00
Next Scan 2024-12-13T17:03:17+00:00

Last Scan

Scanned2024-11-13T17:03:17+00:00
URL https://night.jp/robots.txt
Domain IPs 210.168.234.217
Response IP 210.168.234.217
Found Yes
Hash 3099c7e8a46f58a5c75ba2d9ba05b279d8ff39e8fa24d7fc62fb0b296bfea9bb
SimHash 4417f9604d9b

Groups

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

feedwordpress

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mappy

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

feedwordpress

Rule Path
Disallow /

*

Rule Path
Disallow /kanri.cgi
Disallow /webmaker.cgi
Disallow /iwebmaker.cgi
Disallow /today.cgi
Disallow /search.cgi
Disallow /i/edit/
Disallow /adv/
Disallow /info/
Disallow /mag/
Disallow /skin/
Disallow /tool/
Disallow /tool2/
Disallow /track/
Disallow /jump.php

Other Records

Field Value
sitemap https://night.jp/sitemap.xml

Comments

  • User-Agent: Googlebot-Image
  • Disallow: /