rebelleftc.com
robots.txt

Robots Exclusion Standard data for rebelleftc.com

Resource Scan

Scan Details

Site Domain rebelleftc.com
Base Domain rebelleftc.com
Scan Status Ok
Last Scan2025-07-02T11:57:59+00:00
Next Scan 2025-08-01T11:57:59+00:00

Last Scan

Scanned2025-07-02T11:57:59+00:00
URL https://rebelleftc.com/robots.txt
Redirect https://www.rebelleftc.com/IT/robots.txt
Redirect Domain www.rebelleftc.com
Redirect Base rebelleftc.com
Domain IPs 104.21.3.182, 172.67.131.2, 2606:4700:3030::6815:3b6, 2606:4700:3035::ac43:8302
Redirect IPs 104.21.3.182, 172.67.131.2, 2606:4700:3030::6815:3b6, 2606:4700:3035::ac43:8302
Response IP 172.67.131.2
Found Yes
Hash 39cb55495b68480df13dfec4e33f032e9a73336d9eca9e885b06d248cec7bebc
SimHash 200ad8664b90

Groups

*

Rule Path
Disallow */customer/*
Disallow */customer/
Disallow */customer/account/
Disallow */customer/account/create/
Disallow */customer/account/forgotpassword/
Disallow */checkout/*
Disallow */checkout/
Disallow */checkout/cart/
Disallow */stores/*
Disallow */stores/
Disallow */stores/store/
Disallow */stores/store/redirect/
Disallow */wishlist/
Disallow */configurabili/
Disallow */app/
Disallow */bin/
Disallow */dev/
Disallow */lib/
Disallow */phpserver/
Disallow */LICENSE.html
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */README.txt
Disallow */RELEASE_NOTES.txt
Disallow */CONTRIBUTING.md
Disallow */CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow */COPYING.txt
Disallow */*?dir*
Disallow */*?dir=desc
Disallow */*?dir=asc
Disallow */*?limit=all
Disallow */?mode

facebookexternalhit/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

meta-externalagent/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.rebelleftc.com/pub/media/sitemap/sitemap_en.xml
sitemap https://www.rebelleftc.com/pub/media/sitemap/sitemap.xml