gegent.com
robots.txt
Robots Exclusion Standard data for gegent.com
Resource Scan
Scan Details
| Site Domain | gegent.com |
| Base Domain | gegent.com |
| Scan Status | Ok |
| Last Scan | 2025-11-30T21:23:10+00:00 |
| Next Scan | 2025-12-07T21:23:10+00:00 |
Last Scan
| Scanned | 2025-11-30T21:23:10+00:00 |
| URL | https://gegent.com/robots.txt |
| Domain IPs | 104.21.11.150, 172.67.166.92, 2606:4700:3034::6815:b96, 2606:4700:3035::ac43:a65c |
| Response IP | 104.21.11.150 |
| Found | Yes |
| Hash | 3069fd2fac511f6d5dfe1ca23dfc2345bb46e4655201192aa5994f9e81522500 |
| SimHash | 648a4a70afa4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
*
| Rule | Path |
|---|---|
| Disallow | /*?p=* |
| Disallow | /*%26p%3D* |
| Disallow | /*?s=* |
| Disallow | /*%26s%3D* |
| Disallow | /*?ical=1 |
| Disallow | /*%26ical%3D1 |
| Disallow | /?author=* |
| Disallow | /*wp-comments* |
| Disallow | /*wp-trackback* |
| Disallow | /*wp-feed* |
| Disallow | /*replytocom%3D* |
| Disallow | /*?preview=* |
| Disallow | /*%26preview%3D* |
| Disallow | /*add-to-cart%3D* |
| Disallow | /*add_to_wishlist%3D* |
| Disallow | /*cart/* |
| Disallow | /*checkout/* |
| Disallow | /*my-account/* |
| Disallow | /*myaccount/* |
| Disallow | /*?ajaxCalendar=1* |
| Disallow | /*%26ajaxCalendar%3D1* |
| Disallow | /*?wpdmdl=* |
| Disallow | /*%26wpdmdl%3D* |
| Allow | /*/plugins/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Comments