prompt.quel.jp
robots.txt

Robots Exclusion Standard data for prompt.quel.jp

Resource Scan

Scan Details

Site Domain prompt.quel.jp
Base Domain quel.jp
Scan Status Ok
Last Scan2025-03-03T15:11:32+00:00
Next Scan 2025-04-02T15:11:32+00:00

Last Scan

Scanned2025-03-03T15:11:32+00:00
URL https://prompt.quel.jp/robots.txt
Domain IPs 133.167.126.94
Response IP 133.167.126.94
Found Yes
Hash 45e5858cecae54a62ad3869282e2a950c7b39af28806cc9e655de2665e8d5659
SimHash 441ed0e7439a

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

yandexbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

baiduspider

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

httrack

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

urllib

Rule Path
Disallow /

puppeteer

Rule Path
Disallow /

nokogiri

Rule Path
Disallow /

guzzle

Rule Path
Disallow /

jsoup

Rule Path
Disallow /

colly

Rule Path
Disallow /

badbot

Rule Path
Disallow /

spambot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

zeus

Rule Path
Disallow /