axioart.com
robots.txt

Robots Exclusion Standard data for axioart.com

Resource Scan

Scan Details

Site Domain axioart.com
Base Domain axioart.com
Scan Status Ok
Last Scan2024-06-28T10:06:24+00:00
Next Scan 2024-07-05T10:06:24+00:00

Last Scan

Scanned2024-06-28T10:06:24+00:00
URL https://axioart.com/robots.txt
Domain IPs 23.88.80.237
Response IP 23.88.80.237
Found Yes
Hash 81c7d1a4b0592a16ceca524362570f096388bc1505762c20ba4073ca7e8fd971
SimHash 390d5017cdd0

Groups

*
mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webmirror

Rule Path
Disallow /

webcopy

Rule Path
Disallow /

czxt2s

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin

Other Records

Field Value
sitemap https://axioart.com/index_sitemap.xml

Comments

  • User-agent: SemrushBot
  • Disallow /kereses
  • SemrushBot kereséseket indexel

Warnings

  • 1 invalid line.