podcloud.fr
robots.txt

Robots Exclusion Standard data for podcloud.fr

Resource Scan

Scan Details

Site Domain podcloud.fr
Base Domain podcloud.fr
Scan Status Ok
Last Scan2025-05-12T20:34:53+00:00
Next Scan 2025-06-11T20:34:53+00:00

Last Scan

Scanned2025-05-12T20:34:53+00:00
URL https://podcloud.fr/robots.txt
Domain IPs 104.26.12.112, 104.26.13.112, 172.67.68.172, 2606:4700:20::681a:c70, 2606:4700:20::681a:d70, 2606:4700:20::ac43:44ac
Response IP 104.26.13.112
Found Yes
Hash 080cdd99611baff113e7e7ab00b519fa32afcd1eef36e0733cc05d7cca524120
SimHash b6954d8d6454

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /