Log In Sign Up

narutoporngame.com
robots.txt

Robots Exclusion Standard data for narutoporngame.com

Resource Scan

Scan Details

Site Domain narutoporngame.com
Base Domain narutoporngame.com
Scan Status Ok
Last Scan2024-11-02T13:41:10+00:00
Next Scan 2024-12-02T13:41:10+00:00

Last Scan

Scanned2024-11-02T13:41:10+00:00
URL https://narutoporngame.com/robots.txt
Redirect https://www.narutoporngame.com/robots.txt
Redirect Domain www.narutoporngame.com
Redirect Base narutoporngame.com
Domain IPs 104.21.58.223, 172.67.209.24, 2606:4700:3031::6815:3adf, 2606:4700:3031::ac43:d118
Redirect IPs 104.21.58.223, 172.67.209.24, 2606:4700:3031::6815:3adf, 2606:4700:3031::ac43:d118
Response IP 172.67.209.24
Found Yes
Hash 2820e0b1aa206202844d5b2ef50222e6c666a821e669068f0b3bef8a7db5547d
SimHash b007d03b89a9

Groups

*

Rule Path
Disallow /?s=dmca
Disallow /?s=terms
Disallow /?s=2257
Disallow /?p=join
Disallow /members
Disallow /webmasters
Disallow /dmca
Disallow /terms
Disallow /2257
Disallow /join
Disallow /tags/
Disallow /tag/
Disallow /user/
Disallow /users/
Disallow /category/
Disallow /rating/
Disallow /video/
Disallow /feed/
Disallow /page/

wget
scrapy
simplepie
go-resty
cfnetwork
facebookexternalhit
wget
python-requests
sogou web spider
checkmarknetwork
domaincrawler
weborama-fetcher
libwww-perl
zmeu
crawler4j
curl
go-http-client
ahrefs
mj12bot
seokicks
domainsbot
komodiabot
dotbot
nimbostratus
smtbot
ccbot
semrush
xforce-security
pdrlabs.net
security.ipip.net
mail.ru
yandex
baidu
baiduboxapp
m.baidu.com
baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /js/
Disallow /ajax/
Disallow /portal
Back to top

Comments

  • __________ ___. __ __ __
  • \______ \ ____\_ |__ _____/ |_ ______ _/ |____ ____/ |_
  • | _// _ \| __ \ / _ \ __\/ ___/ \ __\ \/ /\ __\
  • | | ( <_> ) \_\ ( <_> ) | \___ \ | | > < | |
  • |____|_ /\____/|___ /\____/|__| /____ > /\ |__| /__/\_ \ |__|
  • \/ \/ \/ \/ \/
Back to top