menintalks.com
robots.txt
Robots Exclusion Standard data for menintalks.com
Resource Scan
Scan Details
| Site Domain | menintalks.com |
| Base Domain | menintalks.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-13T19:53:32+00:00 |
| Next Scan | 2025-10-11T19:53:32+00:00 |
Last Successful Scan
| Scanned | 2023-11-29T16:15:51+00:00 |
| URL | https://menintalks.com/robots.txt |
| Domain IPs | 104.21.71.4, 172.67.141.64, 2606:4700:3031::6815:4704, 2606:4700:3033::ac43:8d40 |
| Response IP | 104.21.71.4 |
| Found | Yes |
| Hash | 0655aab283d2382a62d6af736a0fdc052ca08501d8e872737629ef47fd9210bc |
| SimHash | 6300c204ef9a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-admin/admin-ajax.php |
| Disallow | /tag/ |
| Disallow | /cgi-bin/ |
| Disallow | /archives/ |
| Disallow | /refer/ |
| Disallow | /index.php |
| Disallow | /wp-content/plugins/ |
| Disallow | /%22?%22 |
| Disallow | /wp-admin/ |
| Disallow | /category/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://menintalks.com/post-sitemap.xml |
| sitemap | https://menintalks.com/page-sitemap.xml |
Warnings
- 3 invalid lines.