tuseben.com
robots.txt
Robots Exclusion Standard data for tuseben.com
Resource Scan
Scan Details
Site Domain | tuseben.com |
Base Domain | tuseben.com |
Scan Status | Ok |
Last Scan | 2025-08-24T18:20:00+00:00 |
Next Scan | 2025-08-31T18:20:00+00:00 |
Last Scan
Scanned | 2025-08-24T18:20:00+00:00 |
URL | https://tuseben.com/robots.txt |
Domain IPs | 104.21.73.31, 172.67.157.55, 2606:4700:3031::ac43:9d37, 2606:4700:3035::6815:491f |
Response IP | 104.21.73.31 |
Found | Yes |
Hash | 38b6354e657eed9f57d33bc2c68e1bfa9db2fdabd4f9e0e39061f991d8cc7ea9 |
SimHash | 4416de43850b |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /layout/ |
Disallow | /dmca/ |
Disallow | /search/ |
Disallow | /print/ |
Disallow | /download/ |
Disallow | /recherche/ |
Disallow | /imprimer/ |
Disallow | /telecharger/ |
Disallow | /buscar/ |
Disallow | /imprimar/ |
Disallow | /descargar/ |
Disallow | /suchen/ |
Disallow | /drucken/ |
Disallow | /herunterladen/ |
Disallow | /?s= |
Disallow | /*?*s=* |
Disallow | /*?*q=* |
Disallow | /*?*p=* |
bingbot
Rule | Path |
---|---|
Disallow | /layout/ |
Disallow | /dmca/ |
Disallow | /search/ |
Disallow | /print/ |
Disallow | /download/ |
Disallow | /recherche/ |
Disallow | /imprimer/ |
Disallow | /telecharger/ |
Disallow | /buscar/ |
Disallow | /imprimar/ |
Disallow | /descargar/ |
Disallow | /suchen/ |
Disallow | /drucken/ |
Disallow | /herunterladen/ |
Disallow | /?s= |
Disallow | /*?*s=* |
Disallow | /*?*q=* |
Disallow | /*?*p=* |
applebot
Rule | Path |
---|---|
Disallow | /layout/ |
Disallow | /dmca/ |
Disallow | /search/ |
Disallow | /print/ |
Disallow | /download/ |
Disallow | /recherche/ |
Disallow | /imprimer/ |
Disallow | /telecharger/ |
Disallow | /buscar/ |
Disallow | /imprimar/ |
Disallow | /descargar/ |
Disallow | /suchen/ |
Disallow | /drucken/ |
Disallow | /herunterladen/ |
Disallow | /?s= |
Disallow | /*?*s=* |
Disallow | /*?*q=* |
Disallow | /*?*p=* |
duckduckbot
Rule | Path |
---|---|
Disallow | /layout/ |
Disallow | /dmca/ |
Disallow | /search/ |
Disallow | /print/ |
Disallow | /download/ |
Disallow | /recherche/ |
Disallow | /imprimer/ |
Disallow | /telecharger/ |
Disallow | /buscar/ |
Disallow | /imprimar/ |
Disallow | /descargar/ |
Disallow | /suchen/ |
Disallow | /drucken/ |
Disallow | /herunterladen/ |
Disallow | /?s= |
Disallow | /*?*s=* |
Disallow | /*?*q=* |
Disallow | /*?*p=* |
yandex
Rule | Path |
---|---|
Disallow | /layout/ |
Disallow | /dmca/ |
Disallow | /search/ |
Disallow | /print/ |
Disallow | /download/ |
Disallow | /recherche/ |
Disallow | /imprimer/ |
Disallow | /telecharger/ |
Disallow | /buscar/ |
Disallow | /imprimar/ |
Disallow | /descargar/ |
Disallow | /suchen/ |
Disallow | /drucken/ |
Disallow | /herunterladen/ |
Disallow | /?s= |
Disallow | /*?*s=* |
Disallow | /*?*q=* |
Disallow | /*?*p=* |
baiduspider
Rule | Path |
---|---|
Disallow | /layout/ |
Disallow | /dmca/ |
Disallow | /search/ |
Disallow | /print/ |
Disallow | /download/ |
Disallow | /recherche/ |
Disallow | /imprimer/ |
Disallow | /telecharger/ |
Disallow | /buscar/ |
Disallow | /imprimar/ |
Disallow | /descargar/ |
Disallow | /suchen/ |
Disallow | /drucken/ |
Disallow | /herunterladen/ |
Disallow | /?s= |
Disallow | /*?*s=* |
Disallow | /*?*q=* |
Disallow | /*?*p=* |
*
Rule | Path |
---|---|
Disallow | /layout/ |
Disallow | /dmca/ |
Disallow | /search/ |
Disallow | /print/ |
Disallow | /download/ |
Disallow | /recherche/ |
Disallow | /imprimer/ |
Disallow | /telecharger/ |
Disallow | /buscar/ |
Disallow | /imprimar/ |
Disallow | /descargar/ |
Disallow | /suchen/ |
Disallow | /drucken/ |
Disallow | /herunterladen/ |
Disallow | /?s= |
Disallow | /*?*s=* |
Disallow | /*?*q=* |
Disallow | /*?*p=* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://tuseben.com/sitemap.xml |
Warnings
- 6 invalid lines.