solidere.com
robots.txt

Robots Exclusion Standard data for solidere.com

Resource Scan

Scan Details

Site Domain solidere.com
Base Domain solidere.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-11T01:08:51+00:00
Next Scan 2025-12-10T01:08:51+00:00

Last Successful Scan

Scanned2023-02-01T00:49:47+00:00
URL https://solidere.com/robots.txt
Redirect https://www.solidere.com/robots.txt
Redirect Domain www.solidere.com
Redirect Base solidere.com
Domain IPs 104.21.32.201, 172.67.154.146, 2606:4700:3033::ac43:9a92, 2606:4700:3034::6815:20c9
Redirect IPs 104.21.32.201, 172.67.154.146, 2606:4700:3033::ac43:9a92, 2606:4700:3034::6815:20c9
Response IP 104.21.32.201
Found Yes
Hash fadeae8df3d139836e05e9864c3ea4aee0b59abe0a38c42f6c8e5d62b63a63db
SimHash 337c8360cd56

Groups

*

Rule Path
Disallow /cgi-bin/

*

Rule Path
Disallow /archive/beirut-souks/wp-content/themes/beirut-souks/gallery/

*

Rule Path
Disallow /archive/beirut-souks/wp-content/themes/beirut-souks/discover/

*

Rule Path
Disallow /archive/gallery/

*

Rule Path
Disallow /bbn/

*

Rule Path
Disallow /archive/

*

Rule Path
Disallow /bbn/v2/

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow

Comments

  • Disallow directory /cgi-bin/
  • Disallow directory /beirut-souks/wp-content/themes/beirut-souks/gallery/
  • Disallow directory /beirut-souks/wp-content/themes/beirut-souks/discover/
  • Disallow directory /gallery/
  • Disallow directory /bbn/
  • Disallow directory /bbn/
  • Disallow directory /bbn/
  • Disallow PetalBot
  • For domain: http://www.solidere-online.com
  • All robots are encouraged to spider this domain. :)