miramama.com.uy
robots.txt

Robots Exclusion Standard data for miramama.com.uy

Resource Scan

Scan Details

Site Domain miramama.com.uy
Base Domain miramama.com.uy
Scan Status Ok
Last Scan2024-09-18T19:50:00+00:00
Next Scan 2024-10-18T19:50:00+00:00

Last Scan

Scanned2024-09-18T19:50:00+00:00
URL https://miramama.com.uy/robots.txt
Domain IPs 108.160.155.173
Response IP 108.160.155.173
Found Yes
Hash 609831c21630a79e625c63060826105e0e0d67bb6c0b6c6448e686141e4209b0
SimHash 6a60d98342b5

Groups

*

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler

Rule Path
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /berlin/
Disallow /ftp/
Disallow /images/

Comments

  • disallow all
  • but allow only important bots
  • Directories