30seconds.com
robots.txt
Robots Exclusion Standard data for 30seconds.com
Resource Scan
Scan Details
| Site Domain | 30seconds.com |
| Base Domain | 30seconds.com |
| Scan Status | Ok |
| Last Scan | 2024-08-29T01:39:34+00:00 |
| Next Scan | 2024-09-28T01:39:34+00:00 |
Last Scan
| Scanned | 2024-08-29T01:39:34+00:00 |
| URL | https://30seconds.com/robots.txt |
| Domain IPs | 3.165.82.129, 3.165.82.16, 3.165.82.19, 3.165.82.24 |
| Response IP | 3.165.82.129 |
| Found | Yes |
| Hash | 3cfcc3f398370137f2a94b875eb295c4d8e87442aa255ea546097a8ed842e28b |
| SimHash | 5a48d9706d96 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*/comment |
| Disallow | /*/tip/None/ |
| Disallow | /*/likes |
| Disallow | /*/time/ |
| Disallow | /*/comments |
| Disallow | /*/comments/* |
| Disallow | /*/collections |
| Disallow | /*/followers |
| Disallow | /*/following |
| Disallow | /tip/*/click/ |
| Disallow | /accounts/* |
| Disallow | /search/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://30seconds.com/sitemap.xml |