ziniounlimited.com
robots.txt
Robots Exclusion Standard data for ziniounlimited.com
Resource Scan
Scan Details
Site Domain | ziniounlimited.com |
Base Domain | ziniounlimited.com |
Scan Status | Ok |
Last Scan | 2024-11-07T14:38:11+00:00 |
Next Scan | 2024-12-07T14:38:11+00:00 |
Last Scan
Scanned | 2024-11-07T14:38:11+00:00 |
URL | https://ziniounlimited.com/robots.txt |
Redirect | https://www.ziniounlimited.com:443/robots.txt |
Redirect Domain | www.ziniounlimited.com |
Redirect Base | ziniounlimited.com |
Domain IPs | 13.35.210.22, 13.35.210.59, 13.35.210.88, 13.35.210.91 |
Redirect IPs | 13.35.210.22, 13.35.210.59, 13.35.210.88, 13.35.210.91 |
Response IP | 13.35.210.88 |
Found | Yes |
Hash | 6e312838d01c1d1c688c20cef6b7801cf53ff0ef81c92ce81a14358f55a24ed4 |
SimHash | fc39d8e0ceb3 |
Groups
sitesnagger
httrack
domain re-animator bot
teleport
teleportpro
emailcollector
emailsiphon
webbandit
webzip
webreaper
webstripper
web downloader
webcopier
offline explorer
offline explorer pro
httrack website copier
offline commander
leech
websnake
blackwidow
http weazel
microsoft.url.control
xenu
download ninja
shopwiki
accelobot
sapphirewebcrawler
dotbot
charlotte
kalooga
linguee
ltx71
ahrefsbot
megaindex
blexbot
yandex
proximic
domaincrawler
ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
fetch
linko
larbin
libwww
maxthon
cncdialer
gptbot
chatgpt-user
ccbot
anthropic-ai
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /api/* |
Disallow | /*/api/* |
Disallow | /reader/* |
Disallow | /*/reader/* |
Disallow | /checkout/ |
Disallow | /*/checkout/ |
Disallow | /search |
Disallow | /*/search |
Disallow | /*/publisher/* |
Disallow | /publisher/* |
Disallow | /publisher/* |
Disallow | /explore/free/*/*-i*/*-a* |
Disallow | /explore/most-read/*/*-i*/*-a* |
Disallow | /explore/trending/*/*-i*/*-a* |
Disallow | /explore/for-you/*/*-i*/*-a* |
Disallow | /explore/recommended-articles/*/*-i*/*-a* |
Disallow | /*/explore/free/*/*-i*/*-a* |
Disallow | /*/explore/most-read/*/*-i*/*-a* |
Disallow | /*/explore/trending/*/*-i*/*-a* |
Disallow | /*/explore/for-you/*/*-i*/*-a* |
Disallow | /*/explore/recommended-articles/*/*-i*/*-a* |
Disallow | /*-c101 |
Disallow | /*/recommended/* |
Disallow | /recommended/* |
Disallow | /publication-similarities |
Disallow | /*/publication-similarities |
Disallow | *lang%3D* |
Disallow | *skuId%3D* |
Disallow | *offer%3D* |
Disallow | *offerId%3D* |
Disallow | *bd%3D* |
Disallow | *rf%3D* |
Disallow | *pss%3D* |
Disallow | *productId%3D* |
Disallow | *categoryId%3D* |
Disallow | *subscription%3D* |
Disallow | *prnt%3D* |
Allow | *page%3D* |
Other Records
Field | Value |
---|---|
sitemap | https://www.ziniounlimited.com/sitemap_index.xml |
Comments