thismatter.com
robots.txt
Robots Exclusion Standard data for thismatter.com
Resource Scan
Scan Details
| Site Domain | thismatter.com |
| Base Domain | thismatter.com |
| Scan Status | Ok |
| Last Scan | 2025-05-24T12:55:21+00:00 |
| Next Scan | 2025-05-31T12:55:21+00:00 |
Last Scan
| Scanned | 2025-05-24T12:55:21+00:00 |
| URL | https://thismatter.com/robots.txt |
| Domain IPs | 2607:f1c0:100f:f000::200, 74.208.236.174 |
| Response IP | 74.208.236.174 |
| Found | Yes |
| Hash | 843897ee8342f04fd9b59d0f73d318d4bd68c111b3e0b5e4bf0ecf5cbfda0f98 |
| SimHash | 0ddafac3d404 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /cssjs/all.*s |
| Allow | /sitemap.xml |
| Allow | /robots.txt |
| Disallow | /.git/ |
| Disallow | *%21 |
| Disallow | *~ |
| Disallow | *% |
| Disallow | *.. |
| Disallow | *%3D |
| Disallow | *-$ |
| Disallow | *_$ |
| Disallow | *.$ |
| Disallow | *%3B |
| Disallow | *a$ |
| Disallow | *c$ |
| Disallow | *d$ |
| Disallow | *df$ |
| Disallow | *e$ |
| Disallow | *k$ |
| Disallow | *l$ |
| Disallow | *n$ |
| Disallow | *o$ |
| Disallow | *p$ |
| Disallow | *0b |
| Disallow | *9c |
| Disallow | *.amp.amp. |
| Disallow | *.asp |
| Disallow | *.cab |
| Disallow | *.cgi |
| Disallow | *.crl |
| Disallow | *.dat |
| Disallow | *.htm- |
| Disallow | *.htm%5B |
| Disallow | *.htm%26 |
| Disallow | *.htm/ |
| Disallow | *.htm1 |
| Disallow | *.htm2 |
| Disallow | *.htm3 |
| Disallow | *.htmc |
| Disallow | *.htmw |
| Disallow | *.exe |
| Disallow | *.jsp |
| Disallow | *.pl |
| Disallow | *.swf |
| Disallow | *.php |
| Disallow | *-panda- |
| Disallow | *-wcs- |
| Disallow | */adimages/ |
| Disallow | */analysis/ |
| Disallow | */annuities/ |
| Disallow | /amp/ |
| Disallow | */api/ |
| Disallow | */app/ |
| Disallow | */apps/ |
| Disallow | */ar0 |
| Disallow | */archives/ |
| Disallow | */assets/ |
| Disallow | */atom/ |
| Disallow | *bulletin/ |
| Disallow | */business/ |
| Disallow | */feed/ |
| Disallow | */ch0 |
| Disallow | */dpp- |
| Disallow | */images/$ |
| Disallow | */index.htm |
| Disallow | */jobs/ |
| Disallow | */member/ |
| Disallow | *mobile/ |
| Disallow | */new.htm |
| Disallow | */op/ |
| Disallow | */personal/ |
| Disallow | */product/ |
| Disallow | */res/ |
| Disallow | */rss |
| Disallow | */save/ |
| Disallow | */search/ |
| Disallow | *hopping/ |
| Disallow | */sites/ |
| Disallow | */states/ |
| Disallow | */tutorial/ |
| Disallow | *-vti- |
| Disallow | *browserconfig |
| Disallow | /buy.htm |
| Disallow | */resources/ |
| Disallow | */irs/ |
| Disallow | *templates/ |
| Disallow | *install/ |
| Disallow | *custom/ |
| Disallow | */data/ |
| Disallow | *scripts/ |
| Disallow | */docs/ |
| Disallow | */view/ |
| Disallow | *-LAPTOP- |
| Disallow | /2015/ |
| Disallow | /bonds/ |
| Disallow | /credit/ |
| Disallow | /D |
| Disallow | /d |
| Disallow | /entertainment/ |
| Disallow | /jtm/ |
| Disallow | /stocks/ |
| Disallow | /money/bankruptcy/ |
| Disallow | /money/bonds/money/ |
| Disallow | /money/debt/ |
| Disallow | /money/funds/hedge-funds/ |
| Disallow | /money/investments/dpp/ |
| Disallow | /money/law/ |
| Disallow | /money/money/ |
| Disallow | /money/mutual-funds/types/ |
| Disallow | /money/tax-credits/ |
| Disallow | /money/terms/ |
| Disallow | /money/tax/investments/ |
| Disallow | /money/tax/law/ |
| Disallow | /money/tax/updates/ |
| Disallow | *product-category/ |
| Disallow | /web |
| Disallow | /zz |
| Disallow | /0 |
| Disallow | /1 |
| Disallow | /2 |
| Disallow | /3 |
| Disallow | /4 |
| Disallow | /5 |
| Disallow | /6 |
| Disallow | /7 |
| Disallow | /8 |
| Disallow | /9 |
| Disallow | /a/ |
| Disallow | /css/ |
| Disallow | *real-estate-links.htm |
Comments