threadsmagazine.com
robots.txt
Robots Exclusion Standard data for threadsmagazine.com
Resource Scan
Scan Details
| Site Domain | threadsmagazine.com |
| Base Domain | threadsmagazine.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T07:06:17+00:00 |
| Next Scan | 2024-11-19T07:06:17+00:00 |
Last Scan
| Scanned | 2024-11-12T07:06:17+00:00 |
| URL | https://threadsmagazine.com/robots.txt |
| Domain IPs | 104.26.10.249, 104.26.11.249, 172.67.71.48, 2606:4700:20::681a:af9, 2606:4700:20::681a:bf9, 2606:4700:20::ac43:4730 |
| Response IP | 172.67.71.48 |
| Found | Yes |
| Hash | 70bfc32a3c40c019741e326eabb7d28e1c065c55503999470a4668f4f5d284e4 |
| SimHash | 8922dc88ca13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp/wp-admin/ |
| Allow | /wp/wp-admin/admin-ajax.php |
| Disallow | /?s= |
| Disallow | /*?s= |
| Disallow | /search/ |
| Disallow | /profile/ |
| Disallow | /digitalissue/* |
| Disallow | /user/login/* |
| Disallow | /user/login |
| Disallow | /*?p=* |
| Disallow | /*?*&p=* |
| Disallow | /WorkArea/* |
| Disallow | /feed/rss/* |
| Disallow | /feed/rss |
| Disallow | /feed/* |
| Disallow | /feed |
| Disallow | */feed/rss$ |
| Disallow | */feed$ |
| Disallow | /page/* |
| Disallow | /*?*_page=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.threadsmagazine.com/sitemap_index.xml |