gantnews.com
robots.txt
Robots Exclusion Standard data for gantnews.com
Resource Scan
Scan Details
| Site Domain | gantnews.com |
| Base Domain | gantnews.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-09T16:56:25+00:00 |
| Next Scan | 2024-07-08T16:56:25+00:00 |
Last Successful Scan
| Scanned | 2022-09-23T16:37:52+00:00 |
| URL | https://gantnews.com/robots.txt |
| Response IP | 169.55.122.106 |
| Found | Yes |
| Hash | 88f6530a174553657dddb7f85f602b1c239470f3c17c7d1188e01c8f8954c4fd |
| SimHash | c04d19100f93 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-admin/ |
| Disallow | /wp-content/uploads/wpo-plugins-tables-list.json |
| Disallow | /cowadmin/ |
| Disallow | /archive/ |
| Disallow | /templates/ |
| Disallow | /dmenu/ |
| Disallow | /tpllib/ |
| Disallow | /data/ |
| Disallow | /print.php |
| Disallow | /pdf.php |
| Disallow | /xml.php |
| Disallow | /txt.php |
| Disallow | /mailto.php |
| Disallow | /openads/ |
| Disallow | /openads_backup/ |
| Disallow | /blackhole/ |
| Disallow | /wp-content/cache/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gantnews.com/sitemap.xml |
| sitemap | https://gantnews.com/sitemap.rss |