Log In Sign Up

dsjuog.com
robots.txt

Robots Exclusion Standard data for dsjuog.com

Resource Scan

Scan Details

Site Domain dsjuog.com
Base Domain dsjuog.com
Scan Status Ok
Last Scan2025-08-04T07:07:28+00:00
Next Scan 2025-09-03T07:07:28+00:00

Last Scan

Scanned2025-08-04T07:07:28+00:00
URL https://dsjuog.com/robots.txt
Domain IPs 104.232.28.18
Response IP 104.232.28.18
Found Yes
Hash 2e9c1c7518295d7acd4a5548f0f619a3227061b3d4d3a61f53706e968b459b8e
SimHash 587fdc7788c0

Groups

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

scanbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

openai

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bolt

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

sitelockspider

Rule Path
Disallow /

superbot

Rule Path
Disallow /

superhttp

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

phxbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

majestic12

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

qwantbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

python-requests/2.32.3

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

*
googlebot

Rule Path
Disallow /js/
Disallow /searchAction
Disallow /advSearchAction
Disallow /advanceSearchResultAction
Disallow /filterAction
Disallow /showCart
Disallow /proceedToCheckout
Disallow /redirectToPaymentGateway

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.dsjuog.com/sitemap/JPJSitemap/DSJUOG.xml
Back to top