twomen.com
robots.txt
Robots Exclusion Standard data for twomen.com
Resource Scan
Scan Details
Site Domain | twomen.com |
Base Domain | twomen.com |
Scan Status | Ok |
Last Scan | 2024-05-24T09:30:20+00:00 |
Next Scan | 2024-06-07T09:30:20+00:00 |
Last Scan
Scanned | 2024-05-24T09:30:20+00:00 |
URL | https://twomen.com/robots.txt |
Redirect | https://twomenandatruck.com/robots.txt |
Redirect Domain | twomenandatruck.com |
Redirect Base | twomenandatruck.com |
Domain IPs | 18.116.215.35, 2600:1f16:c65:6f01:f5b1:623b:c87b:b8cf, 2600:1f16:c65:6f02:1fbd:6f6e:5c07:6fc2, 3.134.218.240 |
Redirect IPs | 13.227.74.122, 13.227.74.19, 13.227.74.26, 13.227.74.33, 2600:9000:2202:5200:c:162:cd80:93a1, 2600:9000:2202:5800:c:162:cd80:93a1, 2600:9000:2202:7c00:c:162:cd80:93a1, 2600:9000:2202:8c00:c:162:cd80:93a1, 2600:9000:2202:c600:c:162:cd80:93a1, 2600:9000:2202:d000:c:162:cd80:93a1, 2600:9000:2202:da00:c:162:cd80:93a1, 2600:9000:2202:f200:c:162:cd80:93a1 |
Response IP | 108.157.52.18 |
Found | Yes |
Hash | 55ee201767d8f7211cb183d65a990539ad8640764668c55a7bc3e2ddbfaa806a |
SimHash | 3d96bd0bc760 |
Groups
*
Rule | Path |
---|---|
Allow | /core/*.css$ |
Allow | /core/*.css? |
Allow | /core/*.js$ |
Allow | /core/*.js? |
Allow | /core/*.gif |
Allow | /core/*.jpg |
Allow | /core/*.jpeg |
Allow | /core/*.png |
Allow | /core/*.svg |
Allow | /profiles/*.css$ |
Allow | /profiles/*.css? |
Allow | /profiles/*.js$ |
Allow | /profiles/*.js? |
Allow | /profiles/*.gif |
Allow | /profiles/*.jpg |
Allow | /profiles/*.jpeg |
Allow | /profiles/*.png |
Allow | /profiles/*.svg |
Disallow | /core/ |
Disallow | /profiles/ |
Disallow | /README.txt |
Disallow | /web.config |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips |
Disallow | /node/add/ |
Disallow | /search/ |
Disallow | /user/register |
Disallow | /user/password |
Disallow | /user/login |
Disallow | /user/logout |
Disallow | /media/oembed |
Disallow | /*/media/oembed |
Disallow | /index.php/admin/ |
Disallow | /index.php/comment/reply/ |
Disallow | /index.php/filter/tips |
Disallow | /index.php/node/add/ |
Disallow | /index.php/search/ |
Disallow | /index.php/user/password |
Disallow | /index.php/user/register |
Disallow | /index.php/user/login |
Disallow | /index.php/user/logout |
Disallow | /index.php/media/oembed |
Disallow | /index.php/*/media/oembed |
Disallow | /damage-report |
Comments