crystalelysium.patternbyetsy.com
robots.txt

Robots Exclusion Standard data for crystalelysium.patternbyetsy.com

Resource Scan

Scan Details

Site Domain crystalelysium.patternbyetsy.com
Base Domain patternbyetsy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-20T14:00:47+00:00
Next Scan 2025-09-18T14:00:47+00:00

Last Successful Scan

Scanned2023-05-07T10:06:37+00:00
URL https://crystalelysium.patternbyetsy.com/robots.txt
Domain IPs 130.211.40.170
Response IP 130.211.40.170
Found Yes
Hash c7c9e20677e239ab16c5bb13f932383526a9aa747475bc88c68daef846d17e57
SimHash 291c4410a612

Groups

spinn3r

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /thanks
Disallow */listing/*/similar

Other Records

Field Value
sitemap https://crystalelysium.patternbyetsy.com/sitemaps.xml?sitemap=listings&offset=0
sitemap https://crystalelysium.patternbyetsy.com/sitemaps.xml?sitemap=blogs&offset=0
sitemap https://crystalelysium.patternbyetsy.com/sitemaps.xml?sitemap=pages&offset=0

Comments

  • \
  • -----
  • | . . |
  • -----
  • \--|-|--/
  • | |
  • |-------|