tspweb.com
robots.txt
Robots Exclusion Standard data for tspweb.com
Resource Scan
Scan Details
| Site Domain | tspweb.com |
| Base Domain | tspweb.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T11:08:35+00:00 |
| Next Scan | 2024-11-16T11:08:35+00:00 |
Last Scan
| Scanned | 2024-11-09T11:08:35+00:00 |
| URL | https://tspweb.com/robots.txt |
| Redirect | https://www.tspweb.com/robots.txt |
| Redirect Domain | www.tspweb.com |
| Redirect Base | tspweb.com |
| Domain IPs | 104.21.84.166, 172.67.195.78 |
| Redirect IPs | 104.21.84.166, 172.67.195.78 |
| Response IP | 172.67.195.78 |
| Found | Yes |
| Hash | 832909339a0777127242d95a7e7f757c4d1991636fc204d4b5b479e892ed0726 |
| SimHash | 699c127657f2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /data-images/ |
| Disallow | /key/ |
| Disallow | /answer/ |
| Disallow | /0/ |
| Disallow | /1/ |
| Disallow | /archive/ |
| Disallow | /key/ |
| Disallow | /blog/ |
| Disallow | /log/ |
| Disallow | /post/ |
| Disallow | /p/ |
| Disallow | /article/ |
| Disallow | /archives/ |
| Disallow | /note/ |
| Disallow | /news/ |
| Disallow | /info/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tspweb.com/sitemap.xml |