nobokep.art
robots.txt

Robots Exclusion Standard data for nobokep.art

Resource Scan

Scan Details

Site Domain nobokep.art
Base Domain nobokep.art
Scan Status Ok
Last Scan2024-09-25T22:39:08+00:00
Next Scan 2024-10-25T22:39:08+00:00

Last Scan

Scanned2024-09-25T22:39:08+00:00
URL https://nobokep.art/robots.txt
Redirect https://nobokep.live/robots.txt
Redirect Domain nobokep.live
Redirect Base nobokep.live
Domain IPs 104.21.46.176, 172.67.168.207, 2606:4700:3034::6815:2eb0, 2606:4700:3035::ac43:a8cf
Redirect IPs 104.21.9.177, 172.67.161.37, 2606:4700:3030::ac43:a125, 2606:4700:3036::6815:9b1
Response IP 172.67.161.37
Found Yes
Hash fb8117f5d5bcb9d11478a6fa6bab0bca23595d808560f1358687c8cbec2485ae
SimHash 63107dc30431

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*/*.css
Allow /*/*.js
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */disclaimer/*
Disallow *?attachment_id=
Disallow /contact-us/
Disallow /copyright-claims/
Disallow /terms-of-use/
Disallow /18-u-s-c--2257-statement/
Disallow /privacy-policy/

googlebot-image
msnbot-media
yandeximages

Rule Path
Allow /wp-content/uploads/

googlebot
bingbot
msnbot
applebot
yandex
slurp
duckduckbot
qwantify

Rule Path
Allow /

ia_archiver
archive.org_bot
siteexplorer
spbot
wbsearchbot
linkdexbot
screaming frog seo spider
netestate ne crawler
moreover
sentibot
aboundexbot
proximic
obot
meanpathbot
nutch
turnitinbot
zoominfobot
zmeu
grapeshot
python-requests
go-http-client
apache-httpclient
libwww-perl
curl
wget
gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nobokep.live/sitemap_index.xml