zeperfs.com
robots.txt
Robots Exclusion Standard data for zeperfs.com
Resource Scan
Scan Details
| Site Domain | zeperfs.com |
| Base Domain | zeperfs.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T10:34:16+00:00 |
| Next Scan | 2024-11-20T10:34:16+00:00 |
Last Scan
| Scanned | 2024-11-13T10:34:16+00:00 |
| URL | https://zeperfs.com/robots.txt |
| Domain IPs | 92.243.1.198 |
| Response IP | 92.243.1.198 |
| Found | Yes |
| Hash | 6a0896b607a36516dcb6e776f609c169b7a85e9991dbf18bc8ce8b1f71dac70b |
| SimHash | da38f792ca75 |
Groups
ahrefsbot
audisto
baiduspider
blexbot
botify
bubing
ccbot
chatgpt-user
cirrusexplorer
cliqzbot
daum
deepcrawl
dotbot
doximity-diffbot
echoboxbot
exabot
ezooms
findxbot
gigabot
googleother
gptbot
hailoobot
istellabot
lieboafast
linespider
linguee
lotayabot
lumar
magpie-crawler
mauibot
mazbot
mb2345browser
megaindex.ru
melodibot
meta-externalagent
meta-externalfetcher
mj12bot
mtrobot
nativeaibot
obot
oncrawl
onespot-scraperbot
pinterest-crawler
petalbot
plukkie
quora-bot
rogerbot
rsiteauditor
ruby
scooperbot
screaming frog seo spider
seekport crawler
semrushbot-si
seznambot
sirdatabot
siteauditbot
sitebot
sitebulb
sitesucker
soso
speedy spider
surdotlybot
teleport
trendictionbot
ttd-content
turnitinbot
webcopier
weborama-fetcher
wikiwix-bot
yacybot
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /quarry.php |
| Disallow | /robots.php |
| Disallow | */iframe* |
| Disallow | */robots.p* |
| Disallow | */accounts.p* |
| Disallow | */dbase.p* |
| Disallow | */admin.p* |
| Disallow | */asp* |
| Disallow | */charts* |
| Disallow | */compt* |
| Disallow | */jpgraph* |
| Disallow | */charts* |
| Disallow | */piwi* |
| Disallow | */adm* |
| Disallow | */wp-* |
| Disallow | */phpmy* |
| Disallow | */MAJ* |
| Disallow | */calcp* |
| Disallow | */eval* |
| Disallow | */profil* |
| Disallow | */gmatch.php* |
| Disallow | */xmlrpc* |
| Disallow | */vtiger* |
| Disallow | /en/fr/ |
| Disallow | /en/forum/ |
| Disallow | /en/es/ |
| Disallow | /en/it/ |
| Disallow | /es/fr/ |
| Disallow | /es/forum/ |
| Disallow | /es/en/ |
| Disallow | /es/it/ |
| Disallow | /it/fr/ |
| Disallow | /it/forum/ |
| Disallow | /it/en/ |
| Disallow | /it/es/ |
| Disallow | /mobile/ |
| Disallow | /api/ |
| Disallow | /m/ |
| Disallow | /dev/ |
| Disallow | */crawlp* |
| Disallow | */matchsel.p* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Warnings
- 1 invalid line.