zeperfs.com
robots.txt
Robots Exclusion Standard data for zeperfs.com
Resource Scan
Scan Details
| Site Domain | zeperfs.com |
| Base Domain | zeperfs.com |
| Scan Status | Ok |
| Last Scan | 2024-06-16T10:27:07+00:00 |
| Next Scan | 2024-06-23T10:27:07+00:00 |
Last Scan
| Scanned | 2024-06-16T10:27:07+00:00 |
| URL | https://zeperfs.com/robots.txt |
| Domain IPs | 92.243.1.198 |
| Response IP | 92.243.1.198 |
| Found | Yes |
| Hash | 91c280cbb7cc26ecceb647a842bd3062d9432441dd5c4d203ead95a41aa53e64 |
| SimHash | da38f292ca71 |
Groups
ahrefsbot
audisto
baiduspider
blexbot
botify
bubing
ccbot
chatgpt-user
cirrusexplorer
cliqzbot
daum
deepcrawl
exabot
findxbot
gigabot
googleother
gptbot
istellabot
linespider
lumar
magpie-crawler
mauibot
melodibot
mj12bot
mauibot
obot
oncrawl
petalbot
plukkie
rogerbot
rsiteauditor
screaming frog seo spider
semrushbot-si
seznambot
sirdatabot
siteauditbot
sitebot
sitebulb
soso
speedy spider
teleport
ttd-content
turnitinbot
webcopier
wikiwix-bot
yacybot
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /quarry.php |
| Disallow | /robots.php |
| Disallow | */iframe* |
| Disallow | */robots.p* |
| Disallow | */accounts.p* |
| Disallow | */dbase.p* |
| Disallow | */admin.p* |
| Disallow | */asp* |
| Disallow | */charts* |
| Disallow | */compt* |
| Disallow | */jpgraph* |
| Disallow | */charts* |
| Disallow | */piwi* |
| Disallow | */adm* |
| Disallow | */wp-* |
| Disallow | */phpmy* |
| Disallow | */MAJ* |
| Disallow | */calcp* |
| Disallow | */eval* |
| Disallow | */profil* |
| Disallow | */gmatch.php* |
| Disallow | */xmlrpc* |
| Disallow | */vtiger* |
| Disallow | /en/fr/ |
| Disallow | /en/forum/ |
| Disallow | /en/es/ |
| Disallow | /en/it/ |
| Disallow | /es/fr/ |
| Disallow | /es/forum/ |
| Disallow | /es/en/ |
| Disallow | /es/it/ |
| Disallow | /it/fr/ |
| Disallow | /it/forum/ |
| Disallow | /it/en/ |
| Disallow | /it/es/ |
| Disallow | /mobile/ |
| Disallow | /api/ |
| Disallow | /m/ |
| Disallow | /dev/ |
| Disallow | */crawlp* |
| Disallow | */matchsel.p* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Warnings
- 1 invalid line.