dimers.com
robots.txt

Robots Exclusion Standard data for dimers.com

Resource Scan

Scan Details

Site Domain dimers.com
Base Domain dimers.com
Scan Status Ok
Last Scan2024-09-21T16:58:29+00:00
Next Scan 2024-09-28T16:58:29+00:00

Last Scan

Scanned2024-09-21T16:58:29+00:00
URL https://dimers.com/robots.txt
Redirect https://www.dimers.com/robots.txt
Redirect Domain www.dimers.com
Redirect Base dimers.com
Domain IPs 52.206.23.113
Redirect IPs 18.165.183.117, 18.165.183.27, 18.165.183.47, 18.165.183.58, 2600:9000:23d1:600:0:d4f2:7f00:93a1, 2600:9000:23d1:7000:0:d4f2:7f00:93a1, 2600:9000:23d1:9400:0:d4f2:7f00:93a1, 2600:9000:23d1::d4f2:7f00:93a1, 2600:9000:23d1:a400:0:d4f2:7f00:93a1, 2600:9000:23d1:d600:0:d4f2:7f00:93a1, 2600:9000:23d1:e000:0:d4f2:7f00:93a1, 2600:9000:23d1:e400:0:d4f2:7f00:93a1
Response IP 18.165.122.73
Found Yes
Hash a402b5b248ea95d8ebc18ac0f12bca8d6b6f3f27c146ad934ba31d58c0a8bb19
SimHash 0c685735d373

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /news/preview/

*

Rule Path
Disallow /go/

*

Rule Path
Disallow /pro/finalize

googlebot-news

Rule Path
Disallow /
Allow /news

Other Records

Field Value
sitemap https://www.dimers.com/page-builder.xml
sitemap https://www.dimers.com/best-odds.xml
sitemap https://www.dimers.com/bet-hub-by-sport.xml
sitemap https://www.dimers.com/news-by-sport.xml
sitemap https://www.dimers.com/sports-betting.xml
sitemap https://www.dimers.com/sitemap-bh.xml
sitemap https://www.dimers.com/news-sitemap.xml
sitemap https://www.dimers.com/sitemap-main.xml
sitemap https://www.dimers.com/best-books.xml
sitemap https://www.dimers.com/sitemap-index.xml
sitemap https://www.dimers.com/news-archived.xml