m.gameknot.com
robots.txt

Robots Exclusion Standard data for m.gameknot.com

Resource Scan

Scan Details

Site Domain m.gameknot.com
Base Domain gameknot.com
Scan Status Ok
Last Scan2024-05-16T05:32:20+00:00
Next Scan 2024-05-30T05:32:20+00:00

Last Scan

Scanned2024-05-16T05:32:20+00:00
URL https://m.gameknot.com/robots.txt
Domain IPs 104.21.45.38, 172.67.208.197
Response IP 104.21.45.38
Found Yes
Hash ed1ce623bcde418a3c9a4563387c41004ce15ebb39e090e2efda1eed94429525
SimHash 6b764150f531

Groups

*

Rule Path
Disallow /robot-trap.pl
Disallow /pgn/
Disallow /annotate.pl
Disallow /analyze-board.pl
Disallow /blitz-attack-board.pl
Disallow /print.pl
Disallow /conditional-moves.pl
Disallow /conditional-moves-preload.pl
Disallow /chess-puzzle.pl
Disallow /chess-puzzle-edit.pl
Disallow /all-chess-players.pl
Disallow /profile.pl
Disallow /rtable.pl
Disallow /amaster.pl
Disallow /cgi-bin/
Disallow /club_rp.pl
Disallow /club_to.pl
Disallow /club_lg.pl
Disallow /blitz.pl
Disallow /verify.pl
Disallow /top_mt.pl
Disallow /cancel_account.pl
Disallow /thankyou
Disallow /bookmarks.pl
Disallow /pay
Disallow /mt.pl
Disallow /rss.pl
Disallow /find.pl
Disallow /ttable.pl
Disallow /aaa/
Disallow /aa/
Disallow /a/
Disallow /mini-stats.pl
Disallow /requestor.pl
Disallow /mini-board.pl
Disallow /login.pl
Disallow /logout.pl
Disallow /list-games.pl
Disallow /online.pl
Disallow /past-daily-puzzles.pl
Disallow /top-list.pl
Disallow /daily-puzzle.js
Disallow /ichess.js
Disallow /js/ichess.js
Disallow /search.pl
Disallow /rivals.pl
Disallow /send.pl
Disallow /ignore.pl
Disallow /buddy.pl
Disallow /start-game.pl
Disallow /my_mts.pl
Disallow /chess-puzzles.pl?
Disallow /chess-diagram-img.pl
Disallow /tactics-board.pl
Disallow /checkmates.pl
Disallow /mrtg/

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

fasterfox

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

dotbot

Rule Path
Disallow /

expo9

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap http://gameknot.com/gk-sitemap.xml.gz

Warnings

  • 2 invalid lines.