jyt.com
robots.txt
Robots Exclusion Standard data for jyt.com
Resource Scan
Scan Details
| Site Domain | jyt.com |
| Base Domain | jyt.com |
| Scan Status | Ok |
| Last Scan | 2025-05-28T20:52:11+00:00 |
| Next Scan | 2025-06-27T20:52:11+00:00 |
Last Scan
| Scanned | 2025-05-28T20:52:11+00:00 |
| URL | https://jyt.com/robots.txt |
| Domain IPs | 209.182.197.8 |
| Response IP | 209.182.197.8 |
| Found | Yes |
| Hash | 20a870ebde03934bf1070d13f50d1163e6652a43f1e1a198889309a7e9941b44 |
| SimHash | 0863cae062f2 |
Groups
emailsiphon
kilroy
whacker
flashsite
netjet
snarf
testapp/1.0 libwww/4.1b5
getwww-robot/2.0
memoweb
net.sweep/v1.2e-t1-chi
ffinet32.dll/3.1 libwww/3.1
javachapman:05/19/19-15:35
lascow-trace/1.0
| Product | Comment |
|---|---|
| kilroy | OCLC |
| whacker | WebWhacker |
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /cgi/ |
| Disallow | /mail/ |
| Disallow | /httpd/auth/ |
| Disallow | /httpd/cgi-bin/ |
| Disallow | /httpd/conf/ |
Comments