atticsalt.com
robots.txt

Robots Exclusion Standard data for atticsalt.com

Resource Scan

Scan Details

Site Domain atticsalt.com
Base Domain atticsalt.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-19T05:27:40+00:00
Next Scan 2024-08-17T05:27:40+00:00

Last Successful Scan

Scanned2023-12-29T05:18:12+00:00
URL https://atticsalt.com/robots.txt
Redirect https://www.atticsalt.com/robots.txt
Redirect Domain www.atticsalt.com
Redirect Base atticsalt.com
Domain IPs 34.206.32.203
Redirect IPs 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bd5, 96.17.96.11, 96.17.96.5
Response IP 104.88.70.144
Found Yes
Hash de1a3c109a6ccd5d3b818280600c11ec6be329fbcc9083042cfb8e1c817f1c95
SimHash 23919732477b

Groups

*

Rule Path
Allow /
Disallow /admin*
Disallow /cart*
Disallow /checkout*
Disallow /myaccount*
Disallow /user/*
Disallow /search*
Disallow /util/*
Disallow /storefront/email/render/*
Disallow /print-return*
Disallow /guest-checkout*
Disallow /print-order*
Disallow /nomore*
Disallow /registrations-sign-in*
Disallow /home-temp*
Disallow /test-pricelist*

ahrefssiteaudit

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.atticsalt.com/sitemap.xml

Comments

  • robots.txt for https://www.atticsalt.com updated 08-25-2021
  • added line to allow ahrefs and disallow Baidu spider on 08-25-21
  • added Allow statement on 11-10-22