geekdrop.com
robots.txt
Robots Exclusion Standard data for geekdrop.com
Resource Scan
Scan Details
| Site Domain | geekdrop.com |
| Base Domain | geekdrop.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T09:20:56+00:00 |
| Next Scan | 2024-11-22T09:20:56+00:00 |
Last Scan
| Scanned | 2024-11-15T09:20:56+00:00 |
| URL | https://geekdrop.com/robots.txt |
| Domain IPs | 162.159.140.104, 162.159.140.160, 172.66.0.102, 172.66.0.158, 2606:4700:7::66, 2606:4700:7::9e, 2a06:98c1:58::66, 2a06:98c1:58::9e |
| Response IP | 172.66.0.102 |
| Found | Yes |
| Hash | 8b05ae0f7ebb579730216308ca25dc1bbab0a196ddba264ecd21337cf2948ead |
| SimHash | fd3d9500c438 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /calibre/ |
| Disallow | /chat/ |
| Disallow | /comment/edit/ |
| Disallow | /comment/reply/ |
| Disallow | /contact/ |
| Disallow | /dbbackup/ |
| Disallow | /devtools/ |
| Disallow | /doe/ |
| Disallow | /files/ |
| Disallow | /forums/everything-else/phrozen-crew/private-phrozen-crew/ |
| Disallow | /forums/private-contributing-editors/ |
| Disallow | /forums/private-moderation/ |
| Disallow | /forums/private-pandoras-box/ |
| Disallow | /forums/private-premium-member-area/ |
| Disallow | /forums/private-the-core/ |
| Disallow | /ignore_user/add/ |
| Disallow | /IM/ |
| Disallow | /imce/ |
| Disallow | /includes/ |
| Disallow | /logout/ |
| Disallow | /misc/ |
| Disallow | /modules/ |
| Disallow | /myspace/ |
| Disallow | /node/add/ |
| Disallow | /og/subscribe/ |
| Disallow | /privatemsg/ |
| Disallow | /profiles/ |
| Disallow | /reference/ |
| Disallow | /scripts/ |
| Disallow | /sites/ |
| Disallow | /sxm-gen/ |
| Disallow | /test/ |
| Disallow | /themes/ |
| Disallow | /user/login/ |
| Disallow | /user/password/ |
| Disallow | /user/register/ |
| Disallow | /userpoints/ |
| Disallow | /x/ |
| Disallow | /?q=admin%2F |
| Disallow | /?q=comment%2Freply%2F |
| Disallow | /?q=contact%2F |
| Disallow | /?q=logout%2F |
| Disallow | /?q=node%2Fadd%2F |
| Disallow | /?q=search%2F |
| Disallow | /?q=user%2Fpassword%2F |
| Disallow | /?q=user%2Fregister%2F |
| Disallow | /?q=user%2Flogin%2F |
| Disallow | /2de0f5212b76.html |
| Disallow | /?q=warning.html |
| Disallow | /CHANGELOG.txt |
| Disallow | /cron.php |
| Disallow | /image2.gif |
| Disallow | /INSTALL.mysql.txt |
| Disallow | /INSTALL.pgsql.txt |
| Disallow | /install.php |
| Disallow | /INSTALL.txt |
| Disallow | /LICENSE.txt |
| Disallow | /LiveSearchSiteAuth.xml |
| Disallow | /MAINTAINERS.txt |
| Disallow | /moderators-long.inc |
| Disallow | /php.ini |
| Disallow | /pinterest-1ed04.html |
| Disallow | /premie-list.htm |
| Disallow | /sites/default/settings.php |
| Disallow | /temp-blacklist.html |
| Disallow | /update.php |
| Disallow | /UPGRADE.txt |
| Disallow | /warning.html |
| Disallow | /xmlrpc.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Comments