Log In Sign Up

sharing.wtf
robots.txt

Robots Exclusion Standard data for sharing.wtf

Resource Scan

Scan Details

Site Domain sharing.wtf
Base Domain sharing.wtf
Scan Status Ok
Last Scan2024-09-22T13:16:29+00:00
Next Scan 2024-09-29T13:16:29+00:00

Last Scan

Scanned2024-09-22T13:16:29+00:00
URL https://sharing.wtf/robots.txt
Redirect https://www.sharing.wtf/robots.txt
Redirect Domain www.sharing.wtf
Redirect Base sharing.wtf
Domain IPs 104.21.60.13, 172.67.186.217, 2606:4700:3030::6815:3c0d, 2606:4700:3033::ac43:bad9
Redirect IPs 104.21.60.13, 172.67.186.217, 2606:4700:3030::6815:3c0d, 2606:4700:3033::ac43:bad9
Response IP 172.67.186.217
Found Yes
Hash 9b3d29ab85eaae17d171ba17b49fa171dcd9b0bb472c58fe509c19db19ef42ec
SimHash b03c7b486692

Groups

trendictionbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

owler

Rule Path
Disallow /

tracemyfile

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow

boardreader

Rule Path
Disallow /

theoldreader.com

Rule Path
Disallow /

semantic-visions.com

Rule Path
Disallow /

proximic

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /
Back to top

Comments

  • http://www.trendiction.com/en/publisher/bot
  • http://www.semrush.com/bot.html
  • http://www.semrush.com/bot.html
  • http://mj12bot.com
  • http://www.opensiteexplorer.org/dotbot
  • http://www.netseer.com/crawler.html
  • http://getintent.com/bot.html
Back to top