artmarketingnews.com
robots.txt

Robots Exclusion Standard data for artmarketingnews.com

Resource Scan

Scan Details

Site Domain artmarketingnews.com
Base Domain artmarketingnews.com
Scan Status Ok
Last Scan4/23/2025, 4:10:12 PM
Next Scan 5/23/2025, 4:10:12 PM

Last Scan

Scanned4/23/2025, 4:10:12 PM
URL https://artmarketingnews.com/robots.txt
Domain IPs 104.21.75.152, 172.67.178.106, 2606:4700:3032::ac43:b26a, 2606:4700:3035::6815:4b98
Response IP 104.21.75.152
Found Yes
Hash 94d71e649779fdd3cec771b648459924edc7da134508e6cc2c7b409ec24211ab
SimHash 6a0459050571

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /trackback
Disallow /*/trackback
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /*.php$
Disallow /*.inc$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*.xlsx$
Disallow /*.doc$
Disallow /*.pdf$
Disallow /*.zip$
Disallow /*/amp/
Disallow /*?amp=1
Disallow /barneybot
Disallow /barneybot-art-print-market-expert/
Disallow /apimonthly

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://artmarketingnews.com/sitemap_index.xml

Comments

  • Block AMP remnants
  • Block private/hidden pages