zdidit.com
robots.txt

Robots Exclusion Standard data for zdidit.com

Resource Scan

Scan Details

Site Domain zdidit.com
Base Domain zdidit.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-02T16:59:24+00:00
Next Scan 2024-10-09T16:59:24+00:00

Last Successful Scan

Scanned2024-09-24T16:44:27+00:00
URL https://zdidit.com/robots.txt
Domain IPs 191.101.79.53, 2a02:4780:b:967:0:6c3:fb59:2
Response IP 191.101.79.53
Found Yes
Hash fc3fb45663349312e78bbd29498f062e0bc85fd3f79b0dc9903a97de72541e73
SimHash 61104b4e6291

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /refer/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /wp-content/plugins/

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

*

Rule Path
Allow /wp-content/cache/minify/000000/

Other Records

Field Value
sitemap http://www.zdidit.com/sitemap.xml
sitemap http://www.zdidit.com/sitemap-image.xml
sitemap http://www.zdidit.com/sitemap-video.xml