Log In Sign Up

answear.si
robots.txt

Robots Exclusion Standard data for answear.si

Resource Scan

Scan Details

Site Domain answear.si
Base Domain answear.si
Scan Status Ok
Last Scan2024-10-07T05:56:19+00:00
Next Scan 2024-10-21T05:56:19+00:00

Last Scan

Scanned2024-10-07T05:56:19+00:00
URL https://answear.si/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bcd, 2600:1413:b000:6::17d5:2bd1, 96.17.96.13, 96.17.96.32
Response IP 23.44.4.186
Found Yes
Hash 6e427a82be2cc4dba06fc44ed3df8a4dc72791ac5dcfe86f081c056beb4c52cf
SimHash a8d8594ace73

Groups

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

adsbot-google

Rule Path
Allow /

*

Rule Path
Disallow /cart
Disallow /checkout
Disallow /channable/products.xml
Disallow /feed/
Disallow /*%7D%7D$
Disallow /priljubljeno
Disallow /moj-racun
Back to top

Other Records

Field Value
sitemap https://answear.si/sitemap.xml
Back to top