wrestling-titles.com
robots.txt
Robots Exclusion Standard data for wrestling-titles.com
Resource Scan
Scan Details
| Site Domain | wrestling-titles.com |
| Base Domain | wrestling-titles.com |
| Scan Status | Ok |
| Last Scan | 2024-10-05T08:02:35+00:00 |
| Next Scan | 2024-10-12T08:02:35+00:00 |
Last Scan
| Scanned | 2024-10-05T08:02:35+00:00 |
| URL | https://wrestling-titles.com/robots.txt |
| Redirect | https://www.wrestling-titles.com/robots.txt |
| Redirect Domain | www.wrestling-titles.com |
| Redirect Base | wrestling-titles.com |
| Domain IPs | 66.198.240.47 |
| Redirect IPs | 66.198.240.47 |
| Response IP | 66.198.240.47 |
| Found | Yes |
| Hash | d5fb99661b93043fa22d52083348a5b74d730c586773fd1412bfc417528bf117 |
| SimHash | 4e4c7160d4e2 |
Groups
ahrefsbot
alphabot
alphaseobot
baiduspider
bubing
easouspider
ezooms
yandexbot
mauibot
mj12bot
sitesucker
httrack
sistrix
sistrix crawler
sistrix
seokicks-robot
jobs.de-robot
unisterbot
dotbot
searchmetricsbot
surveybot
seodiver
spbot
wotbox
dotbot
meanpathbot
backlinkcrawler
magpie-crawler
obot
fr-crawler
blexbot
megaindex
megaindex.ru
megaindex.com
cloudservermarketspider
trendictionbot
exabot
careerbot
lipperhey-kaus-australis
seoscanners.net
metajobbot
spiderbot
linkstats
jobboersebot
iccrawler
plista
domain re-animator bot
lipperhey-kaus-australis
turnitinbot
coccoc
um-ic
mindupbot
sg-orbiter
ccbot
qwantify
kraken
plukkie
safednsbot
haosouspider
rogerbot
openhosebot
screaming frog seo spider
thumbsniper
r6_commentreader
implisensebot
cliqzbot
aihitbot
trendictionbot
wbsearchbot
istellabot
edisterbot
discobot
huaweisymantecspider
jikespider
npbot
sogou spider
sosospider
yandex
nyu internet census
dnyzbot
semrushbot
psbot
the knowledge ai
sogou web spider
sogou
crawler.feedback
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /scgi-bin/ |
| Disallow | /images/ |
| Disallow | /javascripts/ |
| Disallow | /countrycodes.html |
| Disallow | /map-test/ |
| Disallow | /forum/adm/ |
| Disallow | /forum/posting.php |
| Disallow | /forum/search.php? |
| Disallow | /forum/ucp.php |
| Disallow | /forum/mcp.php |
| Disallow | /forum/member |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/faq.php |
| Disallow | /forum/app.php |
| Disallow | /forum/groupcp.php |
| Disallow | /forum/login.php |
| Disallow | /forum/modcp.php |
| Disallow | /forum/posting%2C |
| Disallow | /forum/posting.php |
| Disallow | /forum/privmsg%2C |
| Disallow | /forum/privmsg.php |
| Disallow | /forum/profile.php |
| Disallow | /forum/viewonline.php |
| Disallow | /forum/viewforum.php |
| Disallow | /forum/viewtopic.php |
Warnings
- 1 invalid line.