dizkover.com
robots.txt

Robots Exclusion Standard data for dizkover.com

Resource Scan

Scan Details

Site Domain dizkover.com
Base Domain dizkover.com
Scan Status Ok
Last Scan2025-12-25T06:46:25+00:00
Next Scan 2026-01-01T06:46:25+00:00

Last Scan

Scanned2025-12-25T06:46:25+00:00
URL https://dizkover.com/robots.txt
Redirect https://www.dizkover.com/robots.txt
Redirect Domain www.dizkover.com
Redirect Base dizkover.com
Domain IPs 66.228.45.201
Redirect IPs 66.228.45.201
Response IP 66.228.45.201
Found Yes
Hash 26b398e82610f0f90e7624583f232c468420e14af34c4f2335b4d5e2df4a55fd
SimHash 6c4d4f49eb81

Groups

*

Rule Path
Disallow /protected/
Disallow /upload/
Disallow /cgi-bin/
Disallow /*?*
Disallow /*%3D*
Disallow */-*
Disallow /my/
Disallow /users/
Disallow /member/
Disallow /ajax/
Disallow /match/browse
Disallow /site/register
Disallow /site/unsubscribe*
Disallow /site/admin/
Disallow /site/activation
Disallow /site/lostpassword
Disallow /site/goto/
Disallow /Feed/
Disallow /feed/
Disallow /post/
Disallow */-trending?*
Disallow */-featured?*
Disallow */-popular?*
Disallow */-new?*
Disallow /stories/*/-new?*
Allow /upload/img/*
Allow /upload/vid/*
Allow *?page=*
Allow */-trending-*
Allow */-trending
Allow */-featured
Allow */-popular
Allow /stories/*/-new

Other Records

Field Value
sitemap https://www.dizkover.com/sitemap.xml

Comments

  • PROD
  • Disallow: /people/
  • Disallow: /stories/*/
  • Allow: */-new