factthenerd.com
robots.txt
Robots Exclusion Standard data for factthenerd.com
Resource Scan
Scan Details
| Site Domain | factthenerd.com |
| Base Domain | factthenerd.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-14T08:52:34+00:00 |
| Next Scan | 2024-10-13T08:52:34+00:00 |
Last Successful Scan
| Scanned | 2024-05-24T08:50:44+00:00 |
| URL | https://factthenerd.com/robots.txt |
| Domain IPs | 13.33.30.104, 13.33.30.126, 13.33.30.76, 13.33.30.98 |
| Response IP | 13.33.30.104 |
| Found | Yes |
| Hash | 107b3ec5fcd133af341bd0f743affa219976e5155f34fc3a94bca4770b8dee3b |
| SimHash | 4858da60edb2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /site_join |
| Disallow | /site_join_agree |
| Disallow | /login |
| Disallow | /logout.cm |
| Disallow | /shop_cart |
| Disallow | /?mode* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://factthenerd.com/sitemap.xml |