dimers.com
robots.txt
Robots Exclusion Standard data for dimers.com
Resource Scan
Scan Details
Site Domain | dimers.com |
Base Domain | dimers.com |
Scan Status | Ok |
Last Scan | 2024-09-21T16:58:29+00:00 |
Next Scan | 2024-09-28T16:58:29+00:00 |
Last Scan
Scanned | 2024-09-21T16:58:29+00:00 |
URL | https://dimers.com/robots.txt |
Redirect | https://www.dimers.com/robots.txt |
Redirect Domain | www.dimers.com |
Redirect Base | dimers.com |
Domain IPs | 52.206.23.113 |
Redirect IPs | 18.165.183.117, 18.165.183.27, 18.165.183.47, 18.165.183.58, 2600:9000:23d1:600:0:d4f2:7f00:93a1, 2600:9000:23d1:7000:0:d4f2:7f00:93a1, 2600:9000:23d1:9400:0:d4f2:7f00:93a1, 2600:9000:23d1::d4f2:7f00:93a1, 2600:9000:23d1:a400:0:d4f2:7f00:93a1, 2600:9000:23d1:d600:0:d4f2:7f00:93a1, 2600:9000:23d1:e000:0:d4f2:7f00:93a1, 2600:9000:23d1:e400:0:d4f2:7f00:93a1 |
Response IP | 18.165.122.73 |
Found | Yes |
Hash | a402b5b248ea95d8ebc18ac0f12bca8d6b6f3f27c146ad934ba31d58c0a8bb19 |
SimHash | 0c685735d373 |
Groups
*
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | /news/preview/ |
*
Rule | Path |
---|---|
Disallow | /go/ |
*
Rule | Path |
---|---|
Disallow | /pro/finalize |
Other Records
Field | Value |
---|---|
sitemap | https://www.dimers.com/page-builder.xml |
sitemap | https://www.dimers.com/best-odds.xml |
sitemap | https://www.dimers.com/bet-hub-by-sport.xml |
sitemap | https://www.dimers.com/news-by-sport.xml |
sitemap | https://www.dimers.com/sports-betting.xml |
sitemap | https://www.dimers.com/sitemap-bh.xml |
sitemap | https://www.dimers.com/news-sitemap.xml |
sitemap | https://www.dimers.com/sitemap-main.xml |
sitemap | https://www.dimers.com/best-books.xml |
sitemap | https://www.dimers.com/sitemap-index.xml |
sitemap | https://www.dimers.com/news-archived.xml |