thataicollection.com
robots.txt
Robots Exclusion Standard data for thataicollection.com
Resource Scan
Scan Details
| Site Domain | thataicollection.com |
| Base Domain | thataicollection.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T06:42:55+00:00 |
| Next Scan | 2024-10-01T06:42:55+00:00 |
Last Scan
| Scanned | 2024-09-24T06:42:55+00:00 |
| URL | https://thataicollection.com/robots.txt |
| Domain IPs | 2a09:8280:1::30:40db:0, 66.241.125.201 |
| Response IP | 66.241.125.201 |
| Found | Yes |
| Hash | 82aa96fbafd7aecad0d011586f89b382d0b9bab73cbf40bff14dc49cbae730b7 |
| SimHash | 8d080045e552 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /~partytown |
| Disallow | /review |
| Disallow | /paddle-verification.txt |
| Disallow | /blog/submit/ |
| Disallow | /blog/submit/* |
| Disallow | /redirect/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thataicollection.com/crawled-sitemap.xml |