Log In Sign Up

uweed.ch
robots.txt

Robots Exclusion Standard data for uweed.ch

Resource Scan

Scan Details

Site Domain uweed.ch
Base Domain uweed.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-13T13:08:14+00:00
Next Scan 2026-05-14T13:08:14+00:00

Last Successful Scan

Scanned2025-04-20T09:44:15+00:00
URL https://uweed.ch/robots.txt
Domain IPs 172.66.40.118, 172.66.43.138
Response IP 172.66.43.138
Found Yes
Hash e5eb6c1f1fd1d8a6256b720e778a8339f00ffd7a73ddd0bb947727a824df5500
SimHash 24109b50e2f6

Groups

*

Rule Path
Disallow /trackback
Disallow /comments
Disallow */trackback
Disallow */comments
Disallow /cgi-bin*
Disallow /cdn-cgi/
Disallow *?s=
Disallow *%26s%3D
Disallow /*%26attr_*
Disallow /*?attr_*
Disallow /*?attribute_content
Disallow /*?remove_item
Allow /wp-content/uploads/
Allow /wp-*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf
Allow /wp-*.webp

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow */feed/$
Disallow *?s=
Disallow *%26s%3D
Disallow /*%26attr_*
Disallow /*?attr_*
Allow /wp-content/uploads/
Allow /wp-*.css

googlebot-image

Rule Path
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*
Back to top

Other Records

Field Value
sitemap https://uweed.ch/sitemap_index.xml
Back to top

Comments

  • Show to spiders our sitemap
  • ALL USER AGENTS EXCEPT IF THERE IS ANOTHER "User-agent" RULE AFTER
  • Disallow indexation of sensitive folders
  • Standard for wp
  • Disallow search :
  • Disallow filters, attributes, cart actions
  • Allow to index images and CSS
  • Allow images in plugins, cache
  • GOOGLEBOTS SPECIFIC
  • Googlebot
  • Disallow indexation of sensitive files
  • Disallow search :
  • Disallow filters
  • Allow to index images and CSS
  • Allow Google Image Bot
  • Allow Google AdSense
Back to top