aceto.com
robots.txt

Robots Exclusion Standard data for aceto.com

Resource Scan

Scan Details

Site Domain aceto.com
Base Domain aceto.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-20T18:35:19+00:00
Next Scan 2025-10-18T18:35:19+00:00

Last Successful Scan

Scanned2023-09-07T06:33:59+00:00
URL https://aceto.com/robots.txt
Redirect https://actylis.com/robots.txt
Redirect Domain actylis.com
Redirect Base actylis.com
Domain IPs 20.96.57.124
Redirect IPs 20.96.57.124
Response IP 20.96.57.124
Found Yes
Hash d36cdcdafd2ee2f5014a453d5c8cfd30c3f81b353e3fb1f0a851c6952235be01
SimHash 58dcce71afb0

Groups

*

Rule Path
Disallow /xsl/
Disallow /temp/
Disallow /upload/
Disallow /sitecore/
Disallow /Sitecore/
Disallow /App_Data/
Disallow /App_config/
Disallow /App_Browsers/
Disallow /sitecore_files/
Disallow /thank-you
Disallow /Contact-us-thank-you
Disallow /Thank-you-competition

aihitbot
barkrowler
bdcbot
blexbot
blp_bbot
brokenlinkcheck.com
buck
ccbot
cliqzbot
cyencebot
domaincrawler
dow jones searchbot
exabot
extlinksbot
femtosearchbot
fever
garlikcrawler
gigabot
gobuster
grapeshotcrawler
heritrix
istellabot
jersey
jobkicks
libwww-perl
linkdexbot
linkpadbot
ltx71 - (https://protect-eu.mimecast.com/s/pkbxcpq5dio7w0efzitvi?domain=ltx71.com)
lua-resty-http
lumtelbot
magpie-crawler
magus bot
mail.ru_bot
megaindex.ru
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com
nl-crawler
onpagebot
riddler
scoutjet
scrapy
seekport
seznambot
siteimprove
smtbot
uptimerobot
velenpublicwebcrawler
wget
yacybot
yeti
yisouspider
yunsecuritybot
zoominfobot

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit
caliperbot
dotbot
hubspot
mj12bot
rogerbot
semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://actylis.com/sitemap.xml

Comments

  • -- Spam Bots & Other Unwanted Bots --
  • -- SEO Tools & Service - Set Crawl Delay for Optimal Performance --

Warnings

  • 1 invalid line.