designwiz.com
robots.txt

Robots Exclusion Standard data for designwiz.com

Resource Scan

Scan Details

Site Domain designwiz.com
Base Domain designwiz.com
Scan Status Ok
Last Scan2026-01-12T00:03:18+00:00
Next Scan 2026-02-11T00:03:18+00:00

Last Scan

Scanned2026-01-12T00:03:18+00:00
URL https://designwiz.com/robots.txt
Domain IPs 104.26.6.60, 104.26.7.60, 172.67.71.93, 2606:4700:20::681a:63c, 2606:4700:20::681a:73c, 2606:4700:20::ac43:475d
Response IP 104.26.6.60
Found Yes
Hash b63db20b4833fa0213876c61369315134897ec24b468c82281dc87c4b9b591ef
SimHash 73370a01c273

Groups

*

Rule Path
Disallow /admin/*
Disallow /search/*
Disallow /*/app/
Disallow /app/
Disallow /*%22
Disallow /*%22
Disallow *utm_medium%3D
Disallow *source%3D
Disallow *utm_source%3D
Disallow *utm_campaign%3D
Disallow *utm_content%3D
Disallow *ref%3D
Disallow /cdn-cgi/
Disallow /feed/
Disallow /api/public/*
Allow /

bingbot
oai-searchbot
chatgptbot
adsbot-google
adsidxbot
google-inspectiontool
facebookexternalhit
twitterbot
linkedinbot
googlebot-image
bingbot-image

Rule Path
Disallow /admin/*
Disallow /search/*
Allow /

amazonbot
bytespider
deepseekbot
mistralbot
google-extended
meta-webindexer
openai bot
gptbot
anthropic-ai
claudebot
claude-searchbot
perplexitybot
cohere-training-data-crawler
ccbot
grok
quillbot
pangubot
petalbot
timpibot
webzio
webzio-extended
aliyunsecbot
aliyun
thinkbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://designwiz.com/sitemap.xml