Log In Sign Up

artsopolis.com
robots.txt

Robots Exclusion Standard data for artsopolis.com

Resource Scan

Scan Details

Site Domain artsopolis.com
Base Domain artsopolis.com
Scan Status Ok
Last Scan2025-08-28T14:48:19+00:00
Next Scan 2025-09-04T14:48:19+00:00

Last Scan

Scanned2025-08-28T14:48:19+00:00
URL https://artsopolis.com/robots.txt
Domain IPs 35.215.80.41
Response IP 35.215.80.41
Found Yes
Hash d07dc7da6a39bccf3cd4faa6486085759bc1dfb846b6a7c8318174a6dad39c7d
SimHash 56544de053d9

Groups

awariorssbot
awariosmartbot

Rule Path
Disallow /

perplexitybot
perplexity-user

Rule Path
Disallow /

bingbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

ccbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/

googlebot-image

Rule Path
Disallow /*apd%3D
Disallow /*view%3Dtable
Disallow /*orderby%3D
Disallow /*print_event_search_result%3D
Disallow /print/event/
Back to top

Comments

  • www.robotstxt.org/
  • ===== Limit crawlers on heavy dynamic pages =====
  • prevent huge print/listing variants from being crawled
  • (applies per-agent below)
  • Google family: ignores Crawl-delay; still disallow heavy queries
Back to top