rotowire.com
robots.txt

Robots Exclusion Standard data for rotowire.com

Resource Scan

Scan Details

Site Domain rotowire.com
Base Domain rotowire.com
Scan Status Ok
Last Scan2024-11-13T09:59:14+00:00
Next Scan 2024-11-20T09:59:14+00:00

Last Scan

Scanned2024-11-13T09:59:14+00:00
URL https://rotowire.com/robots.txt
Redirect https://www.rotowire.com/robots.txt
Redirect Domain www.rotowire.com
Redirect Base rotowire.com
Domain IPs 66.170.31.120
Redirect IPs 104.22.16.78, 104.22.17.78, 172.67.14.18
Response IP 104.22.17.78
Found Yes
Hash f1b86b3d05d5d3db9e7e0e3e2e640094f1e7cf6ca730f75c368a5f464e736eca
SimHash a0da1242c877

Groups

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

marketdefenderbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /users/login.php?
Disallow /account/
Disallow /forum/
Disallow /mlbcommish02/
Disallow /MLBCommish02/
Disallow /mlbCommish02/
Disallow /MLBcommish02/
Disallow /mlbcommish03/
Disallow /MLBCommish03/
Disallow /mlbCommish03/
Disallow /MLBcommish03/
Disallow /mlbcommish04/
Disallow /MLBCommish04/
Disallow /mlbCommish04/
Disallow /MLBcommish04/
Disallow /mlbcommish05/
Disallow /MLBCommish05/
Disallow /mlbCommish05/
Disallow /MLBcommish05/
Disallow /mlbcommish06/
Disallow /MLBCommish06/
Disallow /mlbCommish06/
Disallow /MLBcommish06/
Disallow /mlbcommish07/
Disallow /MLBCommish07/
Disallow /mlbCommish07/
Disallow /MLBcommish07/
Disallow /mlbcommish08/
Disallow /MLBCommish08/
Disallow /mlbCommish08/
Disallow /MLBcommish08/
Disallow /mlbcommish09/
Disallow /MLBCommish09/
Disallow /mlbCommish09/
Disallow /MLBcommish09/
Disallow /mlbcommish10/
Disallow /MLBCommish10/
Disallow /mlbCommish10/
Disallow /MLBcommish10/
Disallow /mlbcommish11/
Disallow /MLBCommish11/
Disallow /mlbCommish11/
Disallow /MLBcommish11/
Disallow /mlbcommish12/
Disallow /MLBCommish12/
Disallow /mlbCommish12/
Disallow /MLBcommish12/
Disallow /mlbcommish13/
Disallow /MLBCommish13/
Disallow /mlbCommish13/
Disallow /MLBcommish13/
Disallow /mlbcommish14/
Disallow /MLBCommish14/
Disallow /mlbCommish14/
Disallow /MLBcommish14/
Disallow /mlbcommish15/
Disallow /MLBCommish15/
Disallow /mlbCommish15/
Disallow /MLBcommish15/
Disallow /mlbcommish16/
Disallow /MLBCommish16/
Disallow /mlbCommish16/
Disallow /MLBcommish16/
Disallow /mlbcommish17/
Disallow /MLBCommish17/
Disallow /mlbCommish17/
Disallow /MLBcommish17/
Disallow /nbacommish02/
Disallow /NBACommish02/
Disallow /nbaCommish02/
Disallow /NBAcommish02/
Disallow /nbacommish03/
Disallow /NBACommish03/
Disallow /nbaCommish03/
Disallow /NBAcommish03/
Disallow /nbacommish04/
Disallow /NBACommish04/
Disallow /nbaCommish04/
Disallow /NBAcommish04/
Disallow /nbacommish05/
Disallow /NBACommish05/
Disallow /nbaCommish05/
Disallow /NBAcommish05/
Disallow /nbacommish06/
Disallow /NBACommish06/
Disallow /nbaCommish06/
Disallow /NBAcommish06/
Disallow /nflcommish02/
Disallow /NFLCommish02/
Disallow /nflCommish02/
Disallow /NFLcommish02/
Disallow /nflcommish03/
Disallow /NFLCommish03/
Disallow /nflCommish03/
Disallow /NFLcommish03/
Disallow /nflcommish04/
Disallow /NFLCommish04/
Disallow /nflCommish04/
Disallow /NFLcommish04/
Disallow /nflcommish05/
Disallow /NFLCommish05/
Disallow /nflCommish05/
Disallow /NFLcommish05/
Disallow /nflcommish06/
Disallow /NFLCommish06/
Disallow /nflCommish06/
Disallow /NFLcommish06/
Disallow /nflcommish07/
Disallow /NFLCommish07/
Disallow /nflCommish07/
Disallow /NFLcommish07/
Disallow /nhlcommish02/
Disallow /NHLCommish02/
Disallow /nhlCommish02/
Disallow /NHLcommish02/
Disallow /nhlcommish03/
Disallow /NHLCommish03/
Disallow /nhlCommish03/
Disallow /NHLcommish03/
Disallow /nhlcommish04/
Disallow /NHLCommish04/
Disallow /nhlCommish04/
Disallow /NHLcommish04/
Disallow /nhlcommish05/
Disallow /NHLCommish05/
Disallow /nhlCommish05/
Disallow /NHLcommish05/
Disallow /nhlcommish06/
Disallow /NHLCommish06/
Disallow /nhlCommish06/
Disallow /NHLcommish06/
Disallow /nhlcommish07/
Disallow /NHLCommish07/
Disallow /nhlCommish07/
Disallow /NHLcommish07/
Disallow /partners/
Disallow /rotoboards/
Disallow /updates/
Disallow /53520651/

Other Records

Field Value
sitemap https://www.rotowire.com/sitemap.xml
sitemap https://www.rotowire.com/news-sitemap.php

Comments

  • Sitemaps

Warnings

  • 2 invalid lines.