pastvu.com
robots.txt
Robots Exclusion Standard data for pastvu.com
Resource Scan
Scan Details
| Site Domain | pastvu.com |
| Base Domain | pastvu.com |
| Scan Status | Ok |
| Last Scan | 2026-01-27T01:30:44+00:00 |
| Next Scan | 2026-02-26T01:30:44+00:00 |
Last Scan
| Scanned | 2026-01-27T01:30:44+00:00 |
| URL | https://pastvu.com/robots.txt |
| Domain IPs | 104.26.8.180, 104.26.9.180, 172.67.72.199, 2606:4700:20::681a:8b4, 2606:4700:20::681a:9b4, 2606:4700:20::ac43:48c7 |
| Response IP | 104.26.8.180 |
| Found | Yes |
| Hash | e7867626ecac571e91b0d8993901798f2bd01a903473559b07691a54a8bd4780 |
| SimHash | a8a3dc049331 |
Groups
yandex
No rules defined. All paths allowed.
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 1 | sets a 1 second time-out |
*
| Rule | Path |
|---|---|
| Disallow | /badbrowser |
| Disallow | /nojsbrowser |
| Disallow | /u/*/subscriptions |
| Disallow | /u/*/settings |
| Disallow | /admin |
| Disallow | /confirm |
| Disallow | /ps/feed |
| Disallow | /ps/coin |
| Disallow | /photoUpload |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pastvu.com/sitemap.xml |
Warnings
- `clean-param` is not a known field.
Comments