Log In Sign Up

digiwish.com
robots.txt

Robots Exclusion Standard data for digiwish.com

Resource Scan

Scan Details

Site Domain digiwish.com
Base Domain digiwish.com
Scan Status Ok
Last Scan2025-10-13T07:10:15+00:00
Next Scan 2025-10-20T07:10:15+00:00

Last Scan

Scanned2025-10-13T07:10:15+00:00
URL https://www.digiwish.com/robots.txt
Domain IPs 139.59.16.84
Response IP 139.59.16.84
Found Yes
Hash 866d75899a22094c20bd02ee22d3512a133b48ce0502fa3f365e9b8d1177b30a
SimHash 68d7ef71e2d3

Groups

adsbot-google

Rule Path
Allow /

applebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

slurp

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

backlink-check

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bountiibot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

copyscape

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

experibot_v1

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

extractor

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

fooooo_web_video_crawl

Rule Path
Disallow /

geliyoobot/1.0

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

linkscan

Rule Path
Disallow /

linksmanager

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

netspider

Rule Path
Disallow /

openfind

Rule Path
Disallow /

openlinkprofiler

Rule Path
Disallow /

pageanalyzer

Rule Path
Disallow /

rankflex

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

headmasterseo

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seolyticscrawler

Rule Path
Disallow /

seomoz

Rule Path
Disallow /

seoprofiler

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seostats

Rule Path
Disallow /

sexsearcher

Rule Path
Disallow /

seznam

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitebeam

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

siteimprove

Rule Path
Disallow /

sitelockspider

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

sitevigil

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

sp_auditbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

sqlworm

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

webalta

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

websiteextractor

Rule Path
Disallow /

whack

Rule Path
Disallow /

whacker

Rule Path
Disallow /

wonderbot

Rule Path
Disallow /

woobot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yunyun

Rule Path
Disallow /

zauba

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zitebot

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

zyborg

Rule Path
Disallow /
Disallow /css/
Disallow /fonts/
Disallow /js/
Disallow /cart/
Disallow /checkout/
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /wp-includes/
Disallow /wp-content/
Back to top

Other Records

Field Value
sitemap https://www.digiwish.com/sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top