Log In Sign Up

matchtime.com
robots.txt

Robots Exclusion Standard data for matchtime.com

Resource Scan

Scan Details

Site Domain matchtime.com
Base Domain matchtime.com
Scan Status Ok
Last Scan2024-10-13T07:35:33+00:00
Next Scan 2024-10-20T07:35:33+00:00

Last Scan

Scanned2024-10-13T07:35:33+00:00
URL https://matchtime.com/robots.txt
Redirect https://www.matchtime.com:443/robots.txt
Redirect Domain www.matchtime.com
Redirect Base matchtime.com
Domain IPs 23.21.186.102, 3.210.169.248, 34.206.109.121
Redirect IPs 23.21.186.102, 3.210.169.248, 34.206.109.121
Response IP 34.206.109.121
Found Yes
Hash 35236cc3048a8bf2d294ea5618b01910316ea014ff487583f9148e9493c9437b
SimHash b2400b20070b

Groups

fast enterprise crawler 6

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

sensis.com.au web crawler

Rule Path
Disallow /

worio bot heritrix

Rule Path
Disallow /

*

Rule Path
Disallow /private/
Disallow /signup/*
Disallow /?event=printScoreCard*
Disallow /?event=reviewAttention*
Disallow /?event=createTeamSchedule
Disallow /?event=archiveTeam*
Disallow /?event=createNewTeamPP*
Disallow /?event=setMyAvailability*
Disallow /?event=sendMessage*
Disallow /?event=SendReferralEmails*
Disallow /?event=processSendReferralEmails*
Disallow /?event=*&goto=*
Disallow /?event=viewAllMyMatches&goto=*
Disallow /?event=dashboard&goto=*
Disallow /app/?event=printScoreCard*
Disallow /app/?event=reviewAttention*
Disallow /app/?event=createTeamSchedule
Disallow /app/?event=archiveTeam*
Disallow /app/?event=createNewTeamPP*
Disallow /app/?event=setMyAvailability*
Disallow /app/?event=sendMessage*
Disallow /app/?event=SendReferralEmails*
Disallow /app/?event=processSendReferralEmails*
Disallow /app/?event=*&goto=*
Disallow /app/?event=viewAllMyMatches&goto=*
Disallow /app/?event=dashboard&goto=*
Back to top

Other Records

Field Value
sitemap https://www.matchtime.com/sitemap/sitemap_index.xml
Back to top

Comments

  • added by SD on 11/30/06 bot causing a lot of CF errors to occur
  • russian search engine
  • japaneese search engine
  • Baidu spider for china
  • chinnese spider
  • another chineese spider
  • added by SD on 12/30/04 bot causing a lot of CF errors to occur
  • added by SD on 12/30/04 another bot wreaking havoc
  • User-agent: ia_archiver
  • Disallow: /
  • added by SD on 7/5/07
Back to top