gadgetify.com
robots.txt

Robots Exclusion Standard data for gadgetify.com

Resource Scan

Scan Details

Site Domain gadgetify.com
Base Domain gadgetify.com
Scan Status Ok
Last Scan2025-10-15T23:58:15+00:00
Next Scan 2025-10-22T23:58:15+00:00

Last Scan

Scanned2025-10-15T23:58:15+00:00
URL https://gadgetify.com/robots.txt
Redirect https://www.gadgetify.com/robots.txt
Redirect Domain www.gadgetify.com
Redirect Base gadgetify.com
Domain IPs 108.160.155.184
Redirect IPs 108.160.155.184
Response IP 108.160.155.184
Found Yes
Hash 989f83d2c4b0e3ce040f0fdc386df502c9256123664d5f3ad2391f1cc3f47bf2
SimHash 6249c093e277

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /go/
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow /comments
Disallow */trackback
Disallow */comments
Disallow /*?*
Disallow /*?
Allow /wp-content/uploads

facebookexternalhit

Rule Path
Disallow
Allow /*

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

duggmirror

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

a6-indexer

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Comments

  • Google Image
  • Google AdSense
  • digg mirror