Log In Sign Up

jsafog.com
robots.txt

Robots Exclusion Standard data for jsafog.com

Resource Scan

Scan Details

Site Domain jsafog.com
Base Domain jsafog.com
Scan Status Ok
Last Scan2025-08-20T08:08:23+00:00
Next Scan 2025-09-19T08:08:23+00:00

Last Scan

Scanned2025-08-20T08:08:23+00:00
URL https://jsafog.com/robots.txt
Domain IPs 104.232.28.18
Response IP 104.232.28.18
Found Yes
Hash b932de1b8f8e8deee1d3d3ecf3f927efaf1b09ac56535154e45bf7df9448d76a
SimHash 581f1d7788c0

Groups

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

scanbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

openai

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bolt

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

sitelockspider

Rule Path
Disallow /

superbot

Rule Path
Disallow /

superhttp

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

phxbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

majestic12

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

qwantbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

python-requests/2.32.3

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

*
googlebot

Rule Path
Disallow /js/
Disallow /searchAction
Disallow /advSearchAction
Disallow /advanceSearchResultAction
Disallow /filterAction
Disallow /showCart
Disallow /proceedToCheckout
Disallow /redirectToPaymentGateway

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.jsafog.com/sitemap/JPJSitemap/JSAFOG.xml
Back to top