Log In Sign Up

soccerbar.cc
robots.txt

Robots Exclusion Standard data for soccerbar.cc

Resource Scan

Scan Details

Site Domain soccerbar.cc
Base Domain soccerbar.cc
Scan Status Ok
Last Scan2025-11-21T11:01:52+00:00
Next Scan 2025-12-21T11:01:52+00:00

Last Scan

Scanned2025-11-21T11:01:52+00:00
URL http://soccerbar.cc/robots.txt
Redirect http://www.soccerbar.cc/robots.txt
Redirect Domain www.soccerbar.cc
Redirect Base soccerbar.cc
Domain IPs 161.117.82.214
Redirect IPs 161.117.82.214
Response IP 161.117.82.214
Found Yes
Hash 941fca7c9c97f4f7c541ab7fd466d4a30bb734cf99e06f87cd4e2d9d8579e7c6
SimHash 713f43d64a9b

Groups

*

Rule Path
Disallow /api/
Disallow /data/
Disallow /source/
Disallow /install/
Disallow /template/
Disallow /config/
Disallow /uc_client/
Disallow /uc_server/
Disallow /static/
Disallow /admin.php
Disallow /search.php
Disallow /member.php
Disallow /api.php
Disallow /misc.php
Disallow /mobcent/
Disallow /connect.php
Disallow /advertisement/
Disallow /forum.php?mod=redirect*
Disallow /forum.php?mod=post*
Disallow /home.php?mod=spacecp*
Disallow /userapp.php?mod=app&*
Disallow /?*
Disallow /*?mod=misc*
Disallow /*?mod=attachment*
Disallow /*mobile%3Dyes*
Disallow /home.php/member.php*
Disallow /home.php/home.php*
Disallow /home.php?uid=*

sogou web spider

Rule Path
Disallow /home.php/*
Disallow /home.php?mod=*
Disallow /forum.php?aid=*
Disallow /forum.php?dateline=*
Disallow /index.php/home.php*
Disallow /forum.php?mod=*
Disallow /forum.php?mobile=*
Disallow /forum.php?digest=*
Disallow /forum.php?filter=*
Disallow /forum.php?fid=*

Other Records

Field Value
crawl-delay 1

bytespider

Rule Path
Disallow /forum.php?aid=*
Disallow /forum.php?dateline=*
Disallow /index.php/*
Disallow /forum.php?mod*
Disallow /forum.php?mobile=*
Disallow /forum.php?digest=*
Disallow /forum.php?filter=*
Disallow /forum.php?fid=*
Disallow /forum.php?key=*
Disallow /forum.php?pid=*
Disallow /forum.php?ordertype*
Disallow /misc.php?id=*
Disallow /home.php/home.php?*

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

synthesio crawler release monalisa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazonadbot

Rule Path
Disallow /

wordpress.com mshots

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mega-index

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

thinkchaos

Rule Path
Disallow /

thinkbot

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

aliyunsecbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.soccerbar.cc/sitemap_index.xml
Back to top

Comments

  • robots.txt for Discuz! X3
Back to top

Warnings

  • 12 invalid lines.
Back to top