mtexpress.com
robots.txt
Robots Exclusion Standard data for mtexpress.com
Resource Scan
Scan Details
Site Domain | mtexpress.com |
Base Domain | mtexpress.com |
Scan Status | Ok |
Last Scan | 2024-09-23T21:43:13+00:00 |
Next Scan | 2024-09-30T21:43:13+00:00 |
Last Scan
Scanned | 2024-09-23T21:43:13+00:00 |
URL | https://mtexpress.com/robots.txt |
Domain IPs | 192.104.182.109, 192.104.182.209 |
Response IP | 192.104.182.209 |
Found | Yes |
Hash | e902638aeebb1e1b5e702074ae54cd8c48f6bc76b2b1b43fb4b7e1feb0953889 |
SimHash | 2a3e5a308331 |
Groups
*
Rule | Path |
---|---|
Disallow | /tncms/tracking/ |
Disallow | /_services/ |
Disallow | /tncms/dmp/ |
Disallow | /tncms/block/ |
Disallow | /tncms/openid2/ |
Disallow | /tncms/webservice/ |
Disallow | /tncms/search/ |
Disallow | /tncms/tax/ |
Disallow | /tncms/counter/ |
Disallow | /tncms/admin/ |
Disallow | /tncms/weather/ |
Disallow | /tncms/openweb/* |
Disallow | /tncms/track/ |
Disallow | /tncms/messaging/ |
Disallow | /tncms/gtm/ |
Disallow | /tncms/media/ |
Disallow | /tncms/csrf/ |
Disallow | /tncms/auth/ |
Disallow | /classifieds/*? |
Disallow | /classifieds/community/*? |
Disallow | /classifieds/housing/*? |
Disallow | /classifieds/job/*? |
Disallow | /classifieds/personals/*? |
Disallow | /classifieds/sale/*? |
Disallow | /classifieds/service/*? |
Disallow | /classifieds/vehicle/*? |
Disallow | /tncms/user/ |
Disallow | /users/admin/ |
Disallow | /users/*/? |
Disallow | /tncms/disqus/ |
Disallow | /content/tncms/assets/v3/form/ |
Disallow | /content/tncms/form/ |
Disallow | /marketplace/*action%3Dsrch |
Disallow | /tncms/calendar/ |
Disallow | /calendar/search/ |
Disallow | /calendar/christmas/search/ |
Disallow | /calendar/fourth_of_july/search/ |
Disallow | /calendar/meetings/search/ |
Disallow | /calendar/music/search/ |
Disallow | /calendar/public_meetings/search/ |
Disallow | /calendar/sports/search/ |
Disallow | /calendar/trailing_of_the_sheep/search/ |
Disallow | /calendar/wagon_days/search/ |
Disallow | /calendar/cancelled_events/search/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.mtexpress.com/sitemap.xml |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2014 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2015 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2016 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2017 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2018 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2019 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2020 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2021 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2022 |
sitemap | https://www.mtexpress.com/tncms/sitemap/editorial.xml?year=2023 |