velo101.com
robots.txt

Robots Exclusion Standard data for velo101.com

Resource Scan

Scan Details

Site Domain velo101.com
Base Domain velo101.com
Scan Status Ok
Last Scan2024-06-10T20:07:41+00:00
Next Scan 2024-06-17T20:07:41+00:00

Last Scan

Scanned2024-06-10T20:07:41+00:00
URL https://velo101.com/robots.txt
Domain IPs 46.105.57.169
Response IP 46.105.57.169
Found Yes
Hash 54965cc4c964beea8dd94acb463d64fd45e5cc7a10950f6fbeae771f7c75e767
SimHash c1404d546273

Groups

*

Rule Path
Disallow /*?
Disallow /wp-login.php
Disallow */trackback
Disallow /*/feed
Disallow /*/comments
Disallow /cgi-bin
Disallow /*.inc$
Disallow /*.gz
Disallow /*.cgi
Allow /*css?*
Allow /*js?*

mediapartners-google*

Rule Path
Disallow
Allow /*

adsbot-google

Rule Path
Disallow
Allow /*

googlebot-image

Rule Path
Disallow
Allow /*

googlebot-mobile

Rule Path
Disallow
Allow /*

ia_archiver-web.archive.org

Rule Path
Disallow
Allow /*

duggmirror

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.velo101.com/sitemap_index.xml
sitemap https://www.velo101.com/news-sitemap.xml

Comments

  • Disallow: /*.php$
  • Allow: /forum/sitemap.php
  • Allow: /forum/sitemap.php*?
  • Google AdSense
  • digg mirror