comiccon2016.sched.com
robots.txt

Robots Exclusion Standard data for comiccon2016.sched.com

Resource Scan

Scan Details

Site Domain comiccon2016.sched.com
Base Domain sched.com
Scan Status Ok
Last Scan2024-10-04T08:20:27+00:00
Next Scan 2024-10-18T08:20:27+00:00

Last Scan

Scanned2024-10-04T08:20:27+00:00
URL https://comiccon2016.sched.com/robots.txt
Domain IPs 108.62.103.29
Response IP 108.62.103.29
Found Yes
Hash f4825f7e3070064bf29baf237aed5a7302883cf3ac4edaa775463863ffb05e09
SimHash eddf3152ced3

Groups

*

Rule Path
Disallow /api
Disallow */print
Disallow /mapdata.geojson
Disallow /mapdata.geojson*
Disallow /ticket-assign
Disallow /editor/*
Disallow /connect/*
Disallow /*?*
Disallow /venue/*
Disallow /overview/*
Disallow /popular
Disallow /grid/*
Disallow /map
Disallow /search
Disallow /print

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

sistrix

Rule Path
Disallow /