Log In Sign Up

makerofjacket.com
robots.txt

Robots Exclusion Standard data for makerofjacket.com

Resource Scan

Scan Details

Site Domain makerofjacket.com
Base Domain makerofjacket.com
Scan Status Ok
Last Scan2025-10-06T06:34:46+00:00
Next Scan 2025-11-05T06:34:46+00:00

Last Scan

Scanned2025-10-06T06:34:46+00:00
URL https://makerofjacket.com/robots.txt
Domain IPs 104.21.16.242, 172.67.217.23, 2606:4700:3035::ac43:d917, 2606:4700:3037::6815:10f2
Response IP 172.67.217.23
Found Yes
Hash 6e0a063075c4e7bd23d1379a0a4d318cecd818c67537c91566db87e0f13bcd0f
SimHash 7818fd92eab1

Groups

*

Rule Path
Allow /
Allow /cart/
Allow /checkout/
Disallow /wp-admin/
Disallow */search
Disallow /?s=
Disallow /*404*
Disallow /*403*
Disallow /*500*

Other Records

Field Value
crawl-delay 30

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

linkedinbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

rsiteauditor

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

siteauditbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

semrushbot-si

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

semrushbot-ba

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

semrushbot-swa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

semrushbot-ct

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

splitsignalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

semrushbot-coub

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

yeti

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

onpagebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

serendeputybot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

x09mozilla

Rule Path
Disallow /

x22mozilla

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.makerofjacket.com/sitemap_index.xml
Back to top

Comments

  • Explicit Google bots for Shopping
  • Known crawlers with delays
  • Blocked crawlers
Back to top