status.sharing.wtf
robots.txt

Robots Exclusion Standard data for status.sharing.wtf

Resource Scan

Scan Details

Site Domain status.sharing.wtf
Base Domain sharing.wtf
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-10-01T04:34:32+00:00
Next Scan 2024-12-30T04:34:32+00:00

Last Successful Scan

Scanned2023-11-14T03:48:14+00:00
URL http://status.sharing.wtf/robots.txt
Domain IPs 45.148.123.25
Response IP 45.148.123.25
Found Yes
Hash 7c9a9a667e29fcbd95c270a71930588c91cca96d2b63fce98a359dc28919fcd1
SimHash 303c7b5066d2

Groups

trendictionbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

owler

Rule Path
Disallow /

tracemyfile

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow

boardreader

Rule Path
Disallow /

theoldreader.com

Rule Path
Disallow /

semantic-visions.com

Rule Path
Disallow /

proximic

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

Comments

  • http://www.trendiction.com/en/publisher/bot
  • http://www.semrush.com/bot.html
  • http://www.semrush.com/bot.html
  • http://mj12bot.com
  • http://www.opensiteexplorer.org/dotbot
  • http://www.netseer.com/crawler.html
  • http://getintent.com/bot.html