dimers.com
robots.txt

Robots Exclusion Standard data for dimers.com

Resource Scan

Scan Details

Site Domain dimers.com
Base Domain dimers.com
Scan Status Ok
Last Scan2024-06-15T16:53:23+00:00
Next Scan 2024-06-22T16:53:23+00:00

Last Scan

Scanned2024-06-15T16:53:23+00:00
URL https://dimers.com/robots.txt
Redirect https://www.dimers.com/robots.txt
Redirect Domain www.dimers.com
Redirect Base dimers.com
Domain IPs 52.206.23.113
Redirect IPs 18.154.132.108, 18.154.132.18, 18.154.132.20, 18.154.132.51, 2600:9000:24db:2800:0:d4f2:7f00:93a1, 2600:9000:24db:7600:0:d4f2:7f00:93a1, 2600:9000:24db:8e00:0:d4f2:7f00:93a1, 2600:9000:24db:9000:0:d4f2:7f00:93a1, 2600:9000:24db:9400:0:d4f2:7f00:93a1, 2600:9000:24db:9a00:0:d4f2:7f00:93a1, 2600:9000:24db:a800:0:d4f2:7f00:93a1, 2600:9000:24db:da00:0:d4f2:7f00:93a1
Response IP 18.165.171.58
Found Yes
Hash a402b5b248ea95d8ebc18ac0f12bca8d6b6f3f27c146ad934ba31d58c0a8bb19
SimHash 0c685735d373

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /news/preview/

*

Rule Path
Disallow /go/

*

Rule Path
Disallow /pro/finalize

googlebot-news

Rule Path
Disallow /
Allow /news

Other Records

Field Value
sitemap https://www.dimers.com/page-builder.xml
sitemap https://www.dimers.com/best-odds.xml
sitemap https://www.dimers.com/bet-hub-by-sport.xml
sitemap https://www.dimers.com/news-by-sport.xml
sitemap https://www.dimers.com/sports-betting.xml
sitemap https://www.dimers.com/sitemap-bh.xml
sitemap https://www.dimers.com/news-sitemap.xml
sitemap https://www.dimers.com/sitemap-main.xml
sitemap https://www.dimers.com/best-books.xml
sitemap https://www.dimers.com/sitemap-index.xml
sitemap https://www.dimers.com/news-archived.xml