Log In Sign Up

marketingagil.com
robots.txt

Robots Exclusion Standard data for marketingagil.com

Resource Scan

Scan Details

Site Domain marketingagil.com
Base Domain marketingagil.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-08T15:18:06+00:00
Next Scan 2026-02-06T15:18:06+00:00

Last Successful Scan

Scanned2025-06-17T16:54:59+00:00
URL https://marketingagil.com/robots.txt
Domain IPs 104.21.14.93, 172.67.158.140, 2606:4700:3030::ac43:9e8c, 2606:4700:3033::6815:e5d
Response IP 172.67.158.140
Found Yes
Hash 20ee3cf04b4ebc7e188e9e30b592fe49f609e863fc5576bccbf91548d5b4dfaf
SimHash 4115aad3a677

Groups

*

Rule Path
Disallow /stats/
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow /category/*/*
Disallow */trackback
Disallow /*?*
Disallow /*?
Allow /wp-content/uploads

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://marketingagil.com/sitemap.xml
Back to top

Comments

  • Disallow: /feed
  • Disallow: /comments
  • Disallow: */feed
  • Disallow: */comments
  • Google Image
  • Google AdSense
  • Internet Archiver Wayback Machine
  • digg mirror
Back to top