d.night.jp
robots.txt

Robots Exclusion Standard data for d.night.jp

Resource Scan

Scan Details

Site Domain d.night.jp
Base Domain night.jp
Scan Status Ok
Last Scan2024-11-14T21:10:40+00:00
Next Scan 2024-12-14T21:10:40+00:00

Last Scan

Scanned2024-11-14T21:10:40+00:00
URL https://d.night.jp/robots.txt
Domain IPs 210.168.234.214
Response IP 210.168.234.214
Found Yes
Hash fe9004b03a8528e58e32e51c1cb8dafaf03c716f1ee287e68acdfd49d4316821
SimHash 1717c8f1ee1a

Groups

amazonbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mappy

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

feedwordpress

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /img/