hungerapps.com
robots.txt
Robots Exclusion Standard data for hungerapps.com
Resource Scan
Scan Details
| Site Domain | hungerapps.com |
| Base Domain | hungerapps.com |
| Scan Status | Ok |
| Last Scan | 2024-09-29T05:19:34+00:00 |
| Next Scan | 2024-10-06T05:19:34+00:00 |
Last Scan
| Scanned | 2024-09-29T05:19:34+00:00 |
| URL | https://hungerapps.com/robots.txt |
| Domain IPs | 108.167.172.188 |
| Response IP | 108.167.172.188 |
| Found | Yes |
| Hash | 25c94346008d7ef59775cb3bde953037b3f69b740880c6c7e67e37801b61ce8b |
| SimHash | 6135598276b1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /page/ |
| Disallow | /blog/page/* |
| Disallow | /amp/page/* |
| Disallow | /dgd_scrollbox/ |
| Disallow | /?s=* |
| Disallow | /go/ |
| Disallow | /recommended/ |
| Disallow | /comments/feed/ |
| Disallow | /trackback/ |
| Disallow | /index.php |
| Disallow | /xmlrpc.php |
| Disallow | /search? |
| Disallow | /?p=* |
| Disallow | *?replytocom |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
| Disallow | /tag/ |
| Disallow | /author/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hungerapps.com/sitemap_index.xml |
Warnings
- 1 invalid line.