itingshu.net
robots.txt

Robots Exclusion Standard data for itingshu.net

Resource Scan

Scan Details

Site Domain itingshu.net
Base Domain itingshu.net
Scan Status Ok
Last Scan2024-10-07T13:07:34+00:00
Next Scan 2024-10-14T13:07:34+00:00

Last Scan

Scanned2024-10-07T13:07:34+00:00
URL https://itingshu.net/robots.txt
Redirect https://www.itingshu.net/robots.txt
Redirect Domain www.itingshu.net
Redirect Base itingshu.net
Domain IPs 104.21.28.129, 172.67.146.49, 2606:4700:3033::ac43:9231, 2606:4700:3034::6815:1c81
Redirect IPs 104.21.28.129, 172.67.146.49, 2606:4700:3033::ac43:9231, 2606:4700:3034::6815:1c81
Response IP 104.21.28.129
Found Yes
Hash 0a11d1910309ba9aaab51ceed729cf18c4450d453c5c8d1c4c8df98aa3b66f3c
SimHash 5a14ad4be12a

Groups

*

Rule Path
Disallow /appli*
Disallow /cache*
Disallow /dat*
Disallow /pt*
Disallow /*?*
Disallow /user*

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrush

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

python

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

java

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

webdup

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

purebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wangidspider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

xbfmozilla

Rule Path
Disallow /

yottaa

Rule Path
Disallow /

jorgee

Rule Path
Disallow /

swebot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

turnitinbot-agent

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

perl

Rule Path
Disallow /

python

Rule Path
Disallow /

wget

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /