agora-gallery.com
robots.txt

Robots Exclusion Standard data for agora-gallery.com

Resource Scan

Scan Details

Site Domain agora-gallery.com
Base Domain agora-gallery.com
Scan Status Ok
Last Scan2026-01-29T11:53:53+00:00
Next Scan 2026-02-28T11:53:53+00:00

Last Scan

Scanned2026-01-29T11:53:53+00:00
URL https://agora-gallery.com/robots.txt
Domain IPs 34.120.190.48, 34.149.120.3, 34.149.36.179, 35.227.194.51
Response IP 34.149.120.3
Found Yes
Hash e2cff8c98e430b1ab8d2b353d981493a1ff57848c3b08d60e9cf365863d36b8d
SimHash 41399a0bcbe2

Groups

siteauditbot

Rule Path
Disallow

semrushbot

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow *.pdf

screaming frog seo spider

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /ag-exhibitions/digitally-represented-artists/*
Disallow /cart/
Disallow /checkout/
Disallow /confirm-your-subscription/
Disallow /my-account/
Disallow /monthly-content-planning/
Disallow /page-not-found/
Disallow /online-art-workshops-thank-you/
Disallow /thanks-articlass-corporate/
Disallow /ag-exhibitions/a-splendid-summer-showcase-august-24-september-14-2019/artist/uncategorized/
Disallow /search-results/*
Disallow /documents/shippingfaq.pdf

Other Records

Field Value
crawl-delay 30

perplexitybot

Rule Path
Allow /

Other Records

Field Value
sitemap https://agora-gallery.com/page-sitemap.xml
sitemap https://agora-gallery.com/ag-exhibitions-sitemap.xml
sitemap https://agora-gallery.com/artists-sitemap.xml
sitemap https://agora-gallery.com/product_cat-sitemap.xml

Comments

  • Grant access to Semrush Site Audit Bot
  • Grant access to SemrushBot
  • Block access to PDF files
  • Grant access to Screaming Frog
  • Block all other crawlers
  • Grant Perplexity Bot

Warnings

  • `noindex` is not a known field.