Log In Sign Up

de.storefitting.com
robots.txt

Robots Exclusion Standard data for de.storefitting.com

Resource Scan

Scan Details

Site Domain de.storefitting.com
Base Domain storefitting.com
Scan Status Ok
Last Scan2024-09-24T19:11:14+00:00
Next Scan 2024-10-24T19:11:14+00:00

Last Scan

Scanned2024-09-24T19:11:14+00:00
URL https://de.storefitting.com/robots.txt
Redirect https://www.storefitting.com/robots.txt
Redirect Domain www.storefitting.com
Redirect Base storefitting.com
Domain IPs 172.104.139.50
Redirect IPs 172.104.139.50
Response IP 172.104.139.50
Found Yes
Hash 5d252c860b515d4ea4c040bdf6962ea4d7ac56f5666ed6487698e5f701454790
SimHash 403c57c56699

Groups

googlebot

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

owler

Rule Path
Disallow /

tracemyfile

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

feedly

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

theoldreader.com

Rule Path
Disallow /

semantic-visions.com

Rule Path
Disallow /

proximic

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Comments

  • facebookexternalhit
  • ahrefs.com
  • http://www.trendiction.com/en/publisher/bot
  • http://www.apple.com/go/applebot
  • http://www.grapeshot.co.uk/crawler.php
  • http://www.semrush.com/bot.html
  • http://www.semrush.com/bot.html
  • http://mj12bot.com
  • http://www.opensiteexplorer.org/dotbot
  • http://www.netseer.com/crawler.html
  • http://www.pinterest.com/bot.html
  • http://getintent.com/bot.html
Back to top