sharewise.com
robots.txt

Robots Exclusion Standard data for sharewise.com

Resource Scan

Scan Details

Site Domain sharewise.com
Base Domain sharewise.com
Scan Status Ok
Last Scan2025-09-01T21:19:19+00:00
Next Scan 2025-09-08T21:19:19+00:00

Last Scan

Scanned2025-09-01T21:19:19+00:00
URL https://sharewise.com/robots.txt
Redirect https://www.sharewise.com/robots.txt
Redirect Domain www.sharewise.com
Redirect Base sharewise.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.48.1
Found Yes
Hash 405e48946606e7e94496498aa1ce83cc6942fcb1469dec6e79036cdce71c3cf4
SimHash dc155570cc0b

Groups

googlebot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

bingbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

duckduckbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

applebot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

yandexbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

baiduspider

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

linkedinbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

twitterbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

pinterestbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

facebookexternalhit

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

facebot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

ahrefsbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

semrushbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

screaming frog seo spider

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

rogerbot

Rule Path
Allow /
Disallow /v1
Disallow /de/help/no_cookies
Disallow /us/help/no_cookies
Disallow /home/share

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

sitebulb

Rule Path
Disallow /

sequentum

Rule Path
Disallow /

jetoctopus

Rule Path
Disallow /

lumar

Rule Path
Disallow /

oncrawl

Rule Path
Disallow /

netpeak spider

Rule Path
Disallow /

webharvy

Rule Path
Disallow /

visual scraper

Rule Path
Disallow /

parsehub

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sharewise.com/sitemap.xml