Log In Sign Up

maxedtech.com
robots.txt

Robots Exclusion Standard data for maxedtech.com

Resource Scan

Scan Details

Site Domain maxedtech.com
Base Domain maxedtech.com
Scan Status Ok
Last Scan2024-09-21T20:50:33+00:00
Next Scan 2024-09-28T20:50:33+00:00

Last Scan

Scanned2024-09-21T20:50:33+00:00
URL https://maxedtech.com/robots.txt
Domain IPs 104.21.26.18, 172.67.135.38, 2606:4700:3032::6815:1a12, 2606:4700:3035::ac43:8726
Response IP 172.67.135.38
Found Yes
Hash 7e63b02f0aa8551d2e38744104a6c272de4e053e13cbae7913e90a2f0619c853
SimHash 2f8cd562c2b4

Groups

bingbot
adidxbot
msnbot
msnbot-*
bingpreview
slurp
yahooseeker/m1a1-r2d2

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow *?replytocom
Disallow *?subscribe
Disallow */?
Disallow /?
Disallow /wp-content/plugins/
Allow /wp-content/uploads/*.jpg
Allow /wp-content/uploads/*.png
Allow /wp-content/uploads/*.gif
Allow /wp-content/uploads/*.bmp
Allow /wp-content/uploads/*.pdf
Allow /wp-content/uploads/*.txt
Allow /wp-content/uploads/*.html
Disallow /trackback/
Disallow */trackback/
Disallow /redirect-to-*
Disallow /*.php*
Disallow /*.7z*
Disallow /*.rar*
Disallow /*.exe*
Disallow /feed/
Disallow */feed/
Disallow */user-account/
Disallow */embed/
Disallow /contact.html
Allow /promo*.php

adsbot-google
mediapartners-google x-middleton/1
mediapartners-google x-middleton/2
mediapartners-google

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow *?replytocom
Disallow *?subscribe
Disallow */?
Disallow /?
Disallow /wp-content/plugins/
Allow /wp-content/uploads/*.jpg
Allow /wp-content/uploads/*.png
Allow /wp-content/uploads/*.gif
Allow /wp-content/uploads/*.bmp
Allow /wp-content/uploads/*.pdf
Allow /wp-content/uploads/*.txt
Allow /wp-content/uploads/*.html
Disallow /trackback/
Disallow */trackback/
Disallow /redirect-to-*
Disallow /*.php*
Disallow /*.7z*
Disallow /*.rar*
Disallow /*.exe*
Disallow /feed/
Disallow */feed/
Disallow */user-account/
Disallow */embed/
Disallow /contact.html
Allow /promo*.php

baiduspider

Rule Path
Allow /*/$
Allow /$
Disallow /*
Disallow /wp-admin/
Disallow /wp-includes/
Disallow *?replytocom
Disallow /wp-content/plugins/
Disallow */trackback/
Disallow */feed/
Disallow /redirect-to-*
Disallow /*.7z*
Disallow /*.rar*
Disallow /*.exe*
Disallow */user-account/
Disallow */embed/
Disallow /contact.html
Disallow /donations-list/
Disallow /download/

baiduspider-image

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow *?replytocom
Disallow *?subscribe
Disallow */?
Disallow /?
Disallow /wp-content/plugins/
Allow /wp-content/uploads/*.jpg
Allow /wp-content/uploads/*.png
Allow /wp-content/uploads/*.gif
Allow /wp-content/uploads/*.bmp
Allow /wp-content/uploads/*.pdf
Allow /wp-content/uploads/*.txt
Allow /wp-content/uploads/*.html
Disallow /trackback/
Disallow */trackback/
Disallow /redirect-to-*
Disallow /*.php*
Disallow /*.7z*
Disallow /*.rar*
Disallow /*.exe*
Disallow /feed/
Disallow */feed/
Disallow */user-account/
Disallow */embed/
Disallow /contact.html
Disallow /donations-list/
Allow /promo*.php
Back to top

Other Records

Field Value
sitemap http://maxedtech.com/sitemap.xml.gz
Back to top

Comments

  • Allow: /
  • Disallow: /?s=*
  • Disallow: /wp-content2/cache/
  • Disallow: /wp-content2/themes/
  • Disallow: /uxr-*
  • disallow all files ending with these extensions
  • Disallow: /*.php$
  • Disallow: /*?
  • Disallow: /donations-list/
  • Disallow: /download/
  • Allow: /
  • Disallow: /?s=*
  • Disallow: /wp-content2/cache/
  • Disallow: /wp-content2/themes/
  • Disallow: /uxr-*
  • disallow all files ending with these extensions
  • Disallow: /*.php$
  • Disallow: /*?
  • Disallow: /donations-list/
  • Disallow: /download/
  • Disallow: /
  • Disallow: /uxr-*
  • Allow: /
  • Disallow: /?s=*
  • Disallow: /wp-content2/cache/
  • Disallow: /wp-content2/themes/
  • Disallow: /uxr-*
  • disallow all files ending with these extensions
  • Disallow: /*.php$
  • Disallow: /*?
  • Disallow: /download/
  • http://www.bing.com/webmaster/help/which-crawlers-does-bing-use-8c184ec0 bingbot Adidxbot msnbot msnbot-* BingPreview
  • http://help.yahoo.com/l/uk/yahoo/mobile/onesearch/onesearchmb/search-69.html Slurp YahooSeek
Back to top