toofab.com
robots.txt
Robots Exclusion Standard data for toofab.com
Resource Scan
Scan Details
| Site Domain | toofab.com |
| Base Domain | toofab.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T22:05:07+00:00 |
| Next Scan | 2024-11-20T22:05:07+00:00 |
Last Scan
| Scanned | 2024-11-13T22:05:07+00:00 |
| URL | https://toofab.com/robots.txt |
| Domain IPs | 2600:9000:2721:2600:8:84ba:6f80:93a1, 2600:9000:2721:3200:8:84ba:6f80:93a1, 2600:9000:2721:5800:8:84ba:6f80:93a1, 2600:9000:2721:6200:8:84ba:6f80:93a1, 2600:9000:2721:6c00:8:84ba:6f80:93a1, 2600:9000:2721:8400:8:84ba:6f80:93a1, 2600:9000:2721:c00:8:84ba:6f80:93a1, 2600:9000:2721:c200:8:84ba:6f80:93a1, 3.165.102.125, 3.165.102.72, 3.165.102.78, 3.165.102.81 |
| Response IP | 3.165.102.78 |
| Found | Yes |
| Hash | bed54113358e2ec45011783f091387bce17d9e48e740bcaa2d31fdc236ea8dae |
| SimHash | 61add600f6eb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_/ |
| Disallow | /search |
| Disallow | /xid |
Other Records
| Field | Value |
|---|---|
| sitemap | https://toofab.com/sitemaps/article/index.xml |
| sitemap | https://toofab.com/sitemaps/gallery/index.xml |
| sitemap | https://toofab.com/sitemaps/page/index.xml |
| sitemap | https://toofab.com/sitemaps/video/index.xml |
| sitemap | https://toofab.com/sitemaps/news.xml |