threadsmagazine.com
robots.txt

Robots Exclusion Standard data for threadsmagazine.com

Resource Scan

Scan Details

Site Domain threadsmagazine.com
Base Domain threadsmagazine.com
Scan Status Ok
Last Scan2024-09-23T20:44:19+00:00
Next Scan 2024-09-30T20:44:19+00:00

Last Scan

Scanned2024-09-23T20:44:19+00:00
URL https://threadsmagazine.com/robots.txt
Domain IPs 104.26.10.249, 104.26.11.249, 172.67.71.48, 2606:4700:20::681a:af9, 2606:4700:20::681a:bf9, 2606:4700:20::ac43:4730
Response IP 104.26.10.249
Found Yes
Hash 70bfc32a3c40c019741e326eabb7d28e1c065c55503999470a4668f4f5d284e4
SimHash 8922dc88ca13

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php
Disallow /?s=
Disallow /*?s=
Disallow /search/
Disallow /profile/
Disallow /digitalissue/*
Disallow /user/login/*
Disallow /user/login
Disallow /*?p=*
Disallow /*?*&p=*
Disallow /WorkArea/*
Disallow /feed/rss/*
Disallow /feed/rss
Disallow /feed/*
Disallow /feed
Disallow */feed/rss$
Disallow */feed$
Disallow /page/*
Disallow /*?*_page=*

mediapartners-google

Rule Path
Disallow /?s=
Disallow /*?s=
Disallow /search/
Disallow /profile/

Other Records

Field Value
sitemap https://www.threadsmagazine.com/sitemap_index.xml