Log In Sign Up

cursotaller.com
robots.txt

Robots Exclusion Standard data for cursotaller.com

Resource Scan

Scan Details

Site Domain cursotaller.com
Base Domain cursotaller.com
Scan Status Ok
Last Scan2025-08-31T03:33:35+00:00
Next Scan 2025-09-07T03:33:35+00:00

Last Scan

Scanned2025-08-31T03:33:35+00:00
URL https://cursotaller.com/robots.txt
Domain IPs 216.246.46.21
Response IP 216.246.46.21
Found Yes
Hash 2793748cadd12f5e6991b7969ff2f59b451f650fc1f2a84bd7db09d253f0ac67
SimHash 119d988957f2

Groups

mediapartners-google

Rule Path
Disallow

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

*

Rule Path
Disallow /?s=*
Disallow /?ref=*
Disallow /comments/feed*
Disallow /feed/%24*
Disallow /*/feed/%24*
Disallow /*/feed/rss/%24*
Disallow /*/trackback/%24*
Disallow /*/*/feed/%24*
Disallow /*/*/feed/rss/%24*
Disallow /*/*/trackback/%24*
Disallow /*/*/*/feed/%24*
Disallow /*/*/*/feed/rss/%24*
Disallow /*/*/*/trackback/%24*
Disallow /wp-app.php/service
Disallow */page/*
Disallow /wp-admin/*
Disallow /wp-admin/edit.php
Disallow /wp-admin/themes.php
Disallow /wp-admin/upload.php
Disallow /wp-admin/edit-comments.php
Back to top

Other Records

Field Value
sitemap http://cursotaller.com/sitemap.xml
Back to top

Comments

  • Robots.txt for http://cursotaller.com
  • Internet Archiver Wayback Machine
  • digg mirror
  • Disallow paginas wp-admin
  • Disallow: /wp-content/plugins/*
  • Disallow: /wp-content/themes/*
  • Disallow: /wp-includes/*
  • Sitemap
Back to top