mactabeauty.com
robots.txt

Robots Exclusion Standard data for mactabeauty.com

Resource Scan

Scan Details

Site Domain mactabeauty.com
Base Domain mactabeauty.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-21T14:21:43+00:00
Next Scan 2025-10-20T14:21:43+00:00

Last Successful Scan

Scanned2025-05-30T11:57:17+00:00
URL https://mactabeauty.com/robots.txt
Redirect https://www.mactabeauty.com/robots.txt
Redirect Domain www.mactabeauty.com
Redirect Base mactabeauty.com
Domain IPs 104.26.0.10, 104.26.1.10, 172.67.70.16, 2606:4700:20::681a:10a, 2606:4700:20::681a:a, 2606:4700:20::ac43:4610
Redirect IPs 104.26.0.10, 104.26.1.10, 172.67.70.16, 2606:4700:20::681a:10a, 2606:4700:20::681a:a, 2606:4700:20::ac43:4610
Response IP 104.26.0.10
Found Yes
Hash b26e878a228c62bac38fcf28b698dbed1cbdfd52919685af8ef4716bc0fcdaf6
SimHash 610c89644bb1

Groups

*

Rule Path
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow */review/
Disallow */catalogsearch/
Disallow */catalog/product_compare/
Disallow */sendfriend/
Disallow */customer/account/
Disallow /*SID%3D
Allow *?p=
Disallow */*?*p=*&
Disallow */*%26p%3D
Disallow */blog/tag
Disallow */*?product_list_order=
Disallow */*?product_list_mode=
Disallow */*?product_list_limit=

Other Records

Field Value
sitemap https://www.mactabeauty.com/pub/media/sitemap.xml
sitemap https://www.mactabeauty.com/pub/media/sitemap_ru.xml
sitemap https://www.mactabeauty.com/pub/media/sitemap_lt.xml
sitemap https://www.mactabeauty.com/pub/media/sitemap_lv.xml
sitemap https://www.mactabeauty.com/pub/media/sitemap_fi.xml
sitemap https://www.mactabeauty.com/pub/media/sitemap_en.xml

Comments

  • Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Paths (not clean URLs)
  • Disallow: /*?*
  • Sorting parameters
  • Website Sitemap