Log In Sign Up

assets.sk-static.com
robots.txt

Robots Exclusion Standard data for assets.sk-static.com

Resource Scan

Scan Details

Site Domain assets.sk-static.com
Base Domain sk-static.com
Scan Status Ok
Last Scan2024-09-04T16:25:50+00:00
Next Scan 2024-10-04T16:25:50+00:00

Last Scan

Scanned2024-09-04T16:25:50+00:00
URL https://assets.sk-static.com/robots.txt
Domain IPs 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217
Response IP 199.232.46.217
Found Yes
Hash fd8e5ada816ccf0b6acb87246de3109df56a68b2fd7ec1ea52968e5a97d7f060
SimHash 2b52f14c4dc3

Groups

blexbot

Rule Path
Disallow /

beetlebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

import.io

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

netseer

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

botify

Rule Path
Disallow /

blekkobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seznambot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /44522520/*
Disallow /announcements/seen
Disallow /artists/*/images/new
Disallow /artists/*/videos/new
Disallow /behaviour
Disallow /concerts/*/edit
Disallow /concerts/*/images/new
Disallow /concerts/*/posters/new
Disallow /concerts/*/setlists/*
Disallow /concerts/*/videos/new
Disallow /concerts/new
Disallow /festival_instances/new
Disallow /festivals/*/edit
Disallow /festivals/*/id/*/images/new
Disallow /festivals/*/id/*/posters/new
Disallow /festivals/*/id/*/setlists/*
Disallow /festivals/*/id/*/videos/new
Disallow /images/new
Disallow /images/api/
Disallow /iphone/
Disallow /light_signups/new
Disallow /password_reset_requests
Disallow /posters/new
Disallow /problems/new
Disallow /record-share
Disallow /rx
Disallow /search
Disallow /session/create
Disallow /session/filter_metro_area/edit
Disallow /session/new
Disallow /store/events/*/unavailable_allocations
Disallow /store/reservation_orders*
Disallow /store/payments*
Disallow /store/confirmation
Disallow /tickets/
Disallow /tracker
Disallow /trackings
Disallow /venues/*/edit
Disallow /venues/*/images/new
Allow /users/*/calendars.ics
Disallow /venues/*/videos/new
Disallow /venues/new
Disallow /videos/new
Disallow /harming/humans
Disallow /ignoring/human/orders
Disallow /harm/to/self
Disallow /artists/9115824
Disallow /artists/9115824-songkickloadtesting1
Disallow /events/30168404
Disallow /events/30168429
Disallow /events/30168489
Disallow /events/30168499
Disallow /events/30168504
Disallow /events/30168539
Disallow /events/30168549
Disallow /events/30168554
Disallow /events/30168559
Disallow /events/30168564
Disallow /events/30181959
Disallow /events/30181969
Disallow /events/30181984
Disallow /events/30181994
Disallow /events/30182004
Disallow /events/30182014
Disallow /events/30182029
Disallow /events/30182039
Disallow /events/30182044
Disallow /events/30182049
Disallow /events/30181949
Disallow /events/30181964
Disallow /events/30181989
Disallow /events/30181999
Disallow /events/30182009
Disallow /events/30182034
Disallow /events/30182249
Disallow /events/30182254
Disallow /events/30182264
Disallow /events/30182274
Disallow /events/30182284
Disallow /events/30182289
Disallow /events/30182294
Disallow /events/30182559
Disallow /events/30182584
Disallow /events/30182594
Disallow /events/30182644
Disallow /events/30182559
Disallow /events/30182694
Disallow /events/30182774
Disallow /page-view.png
Disallow /*/callbackRegistryFactory
Disallow /*/id/utils
Disallow /*/utils/utils
Disallow /*/id/child/Message
Disallow /*/id/Message
Disallow /*/id/utils/constants
Disallow /*/utils/constants
Back to top

Other Records

Field Value
sitemap https://www.songkick.com/sitemap.xml
Back to top

Comments

  • If you add a new exclusion to this file please ensure that route is removed
  • from the sitemap.xml.
  • The songkick.com sitemaps are generated by this project through cron
  • regularly, and stored in S3 via media-service whence they can be served
  • directly by apache. see the README for more
  • These rules are specifically to prevent google from crawling our adobe launch script
Back to top

Warnings

  • 2 invalid lines.
Back to top