artmarketingnews.com
robots.txt
Robots Exclusion Standard data for artmarketingnews.com
Resource Scan
Scan Details
Site Domain | artmarketingnews.com |
Base Domain | artmarketingnews.com |
Scan Status | Ok |
Last Scan | 4/23/2025, 4:10:12 PM |
Next Scan | 5/23/2025, 4:10:12 PM |
Last Scan
Scanned | 4/23/2025, 4:10:12 PM |
URL | https://artmarketingnews.com/robots.txt |
Domain IPs | 104.21.75.152, 172.67.178.106, 2606:4700:3032::ac43:b26a, 2606:4700:3035::6815:4b98 |
Response IP | 104.21.75.152 |
Found | Yes |
Hash | 94d71e649779fdd3cec771b648459924edc7da134508e6cc2c7b409ec24211ab |
SimHash | 6a0459050571 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /trackback |
Disallow | /*/trackback |
Disallow | /wp-login.php |
Disallow | /xmlrpc.php |
Disallow | /*.php$ |
Disallow | /*.inc$ |
Disallow | /*.cgi$ |
Disallow | /*.xhtml$ |
Disallow | /*.xlsx$ |
Disallow | /*.doc$ |
Disallow | /*.pdf$ |
Disallow | /*.zip$ |
Disallow | /*/amp/ |
Disallow | /*?amp=1 |
Disallow | /barneybot |
Disallow | /barneybot-art-print-market-expert/ |
Disallow | /apimonthly |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://artmarketingnews.com/sitemap_index.xml |
Comments