thataicollection.com
robots.txt
Robots Exclusion Standard data for thataicollection.com
Resource Scan
Scan Details
Site Domain | thataicollection.com |
Base Domain | thataicollection.com |
Scan Status | Ok |
Last Scan | 2024-11-12T07:49:34+00:00 |
Next Scan | 2024-11-19T07:49:34+00:00 |
Last Scan
Scanned | 2024-11-12T07:49:34+00:00 |
URL | https://thataicollection.com/robots.txt |
Domain IPs | 2a09:8280:1::30:40db:0, 66.241.125.201 |
Response IP | 66.241.125.201 |
Found | Yes |
Hash | 82aa96fbafd7aecad0d011586f89b382d0b9bab73cbf40bff14dc49cbae730b7 |
SimHash | 8d080045e552 |
Groups
*
Rule | Path |
---|---|
Disallow | /~partytown |
Disallow | /review |
Disallow | /paddle-verification.txt |
Disallow | /blog/submit/ |
Disallow | /blog/submit/* |
Disallow | /redirect/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.thataicollection.com/crawled-sitemap.xml |