Log In Sign Up

m.shushenwu.cc
robots.txt

Robots Exclusion Standard data for m.shushenwu.cc

Resource Scan

Scan Details

Site Domain m.shushenwu.cc
Base Domain shushenwu.cc
Scan Status Ok
Last Scan5/21/2025, 10:33:11 AM
Next Scan 6/20/2025, 10:33:11 AM

Last Scan

Scanned5/21/2025, 10:33:11 AM
URL https://m.shushenwu.cc/robots.txt
Domain IPs 104.21.37.46, 172.67.203.243, 2606:4700:3036::ac43:cbf3, 2606:4700:3037::6815:252e
Response IP 104.21.37.46
Found Yes
Hash b4a28ba5f85d4b5f2c67368b53acb60d85f83a9eada4ca3e270d791d9ea66574
SimHash c54a7923ce1d

Groups

*

Rule Path
Allow /
Disallow /*?*
Disallow /com/
Disallow /api/
Disallow /error_page/
Disallow /*.php$

webcopier

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

anthropicbot

Rule Path
Disallow /

contentcrawler

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

tumblr bot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

bardbot

Rule Path
Disallow /

websauger

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

writerlycrawler

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

similarweb/1.0

Rule Path
Disallow /

dripfeedbot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

weibobot

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

adsbot-google-mobile-apps

Rule Path
Disallow /

adbeat

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webzip

Rule Path
Disallow /

deepmindbot

Rule Path
Disallow /

alexabot

Rule Path
Disallow /

stabilityaibot

Rule Path
Disallow /

rankflexbot

Rule Path
Disallow /

websphinx

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

slackbot

Rule Path
Disallow /

webimagecollector

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

adverification

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

rankactivebot

Rule Path
Disallow /

webvac

Rule Path
Disallow /

adspider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

admediabot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

coherecrawler

Rule Path
Disallow /

scaleai-crawler

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

originalityai

Rule Path
Disallow /

perplexityai

Rule Path
Disallow /

larbin

Rule Path
Disallow /

alexa toolbar

Rule Path
Disallow /

webdataextractor

Rule Path
Disallow /

webminer

Rule Path
Disallow /

similarwebbot

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

alexa web information service

Rule Path
Disallow /

similarweb/2.0

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

webauto

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

alexa crawler

Rule Path
Disallow /

facebot

Rule Path
Disallow /

redditbot

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

copyleaksbot

Rule Path
Disallow /

alexa site audit

Rule Path
Disallow /

huggingfacebot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

netpeakchecker

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

grokonbot

Rule Path
Disallow /

mozbot

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websucker

Rule Path
Disallow /

octopus

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

sitebulb

Rule Path
Disallow /

siteanalyzerbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

adixml

Rule Path
Disallow /

contentking

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

screamingfrog

Rule Path
Disallow /

jaspercrawler

Rule Path
Disallow /

spyfubot

Rule Path
Disallow /

competebot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://m.shushenwu.cc/sitemap.xml
Back to top