Log In Sign Up

programoweb.com
robots.txt

Robots Exclusion Standard data for programoweb.com

Resource Scan

Scan Details

Site Domain programoweb.com
Base Domain programoweb.com
Scan Status Ok
Last Scan2025-08-22T00:56:36+00:00
Next Scan 2025-08-29T00:56:36+00:00

Last Scan

Scanned2025-08-22T00:56:36+00:00
URL https://programoweb.com/robots.txt
Domain IPs 216.246.46.21
Response IP 216.246.46.21
Found Yes
Hash e534f166a97724127662b7eebf4b1ba601b1b3acd72f1b496cb61112ba72ab7e
SimHash 919d988147f2

Groups

mediapartners-google

Rule Path
Disallow

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

*

Rule Path
Disallow /?s=*
Disallow /?ref=*
Disallow /comments/feed*
Disallow /feed/%24*
Disallow /*/feed/%24*
Disallow /*/feed/rss/%24*
Disallow /*/trackback/%24*
Disallow /*/*/feed/%24*
Disallow /*/*/feed/rss/%24*
Disallow /*/*/trackback/%24*
Disallow /*/*/*/feed/%24*
Disallow /*/*/*/feed/rss/%24*
Disallow /*/*/*/trackback/%24*
Disallow */page/*
Disallow /wp-admin/*
Disallow /wp-admin/options-general.php
Disallow /wp-app.php/service
Back to top

Other Records

Field Value
sitemap http://programoweb.com/sitemap.xml
Back to top

Comments

  • robots.txt for http://programoweb.com
  • Internet Archiver Wayback Machine
  • digg mirror
  • Disallow paginas wp-admin
  • Disallow: /wp-content/plugins/*
  • Disallow: /wp-content/themes/*
  • Disallow: /wp-includes/*
  • indicar sitemap
Back to top