qr.quel.jp
robots.txt

Robots Exclusion Standard data for qr.quel.jp

Resource Scan

Scan Details

Site Domain qr.quel.jp
Base Domain quel.jp
Scan Status Ok
Last Scan2025-03-03T08:48:45+00:00
Next Scan 2025-04-02T08:48:45+00:00

Last Scan

Scanned2025-03-03T08:48:45+00:00
URL https://qr.quel.jp/robots.txt
Domain IPs 160.16.226.60
Response IP 160.16.226.60
Found Yes
Hash 25137efd9652d3bb85187c492a8e84f80ccc519f6ea74e2df1108592d4e3a6e6
SimHash 4e1ed0e7439a

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

yandexbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

baiduspider

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

httrack

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

urllib

Rule Path
Disallow /

puppeteer

Rule Path
Disallow /

nokogiri

Rule Path
Disallow /

guzzle

Rule Path
Disallow /

jsoup

Rule Path
Disallow /

colly

Rule Path
Disallow /

badbot

Rule Path
Disallow /

spambot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

zeus

Rule Path
Disallow /