toofab.com
robots.txt
Robots Exclusion Standard data for toofab.com
Resource Scan
Scan Details
| Site Domain | toofab.com |
| Base Domain | toofab.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T21:43:07+00:00 |
| Next Scan | 2024-10-02T21:43:07+00:00 |
Last Scan
| Scanned | 2024-09-25T21:43:07+00:00 |
| URL | https://toofab.com/robots.txt |
| Domain IPs | 13.35.18.108, 13.35.18.16, 13.35.18.56, 13.35.18.89, 2600:9000:21d1:1200:8:84ba:6f80:93a1, 2600:9000:21d1:2c00:8:84ba:6f80:93a1, 2600:9000:21d1:8600:8:84ba:6f80:93a1, 2600:9000:21d1:ae00:8:84ba:6f80:93a1, 2600:9000:21d1:b800:8:84ba:6f80:93a1, 2600:9000:21d1:ba00:8:84ba:6f80:93a1, 2600:9000:21d1:c400:8:84ba:6f80:93a1, 2600:9000:21d1:c600:8:84ba:6f80:93a1 |
| Response IP | 13.35.18.89 |
| Found | Yes |
| Hash | bed54113358e2ec45011783f091387bce17d9e48e740bcaa2d31fdc236ea8dae |
| SimHash | 61add600f6eb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_/ |
| Disallow | /search |
| Disallow | /xid |
Other Records
| Field | Value |
|---|---|
| sitemap | https://toofab.com/sitemaps/article/index.xml |
| sitemap | https://toofab.com/sitemaps/gallery/index.xml |
| sitemap | https://toofab.com/sitemaps/page/index.xml |
| sitemap | https://toofab.com/sitemaps/video/index.xml |
| sitemap | https://toofab.com/sitemaps/news.xml |