renote.net
robots.txt

Robots Exclusion Standard data for renote.net

Resource Scan

Scan Details

Site Domain renote.net
Base Domain renote.net
Scan Status Ok
Last Scan2024-10-30T11:16:21+00:00
Next Scan 2024-11-06T11:16:21+00:00

Last Scan

Scanned2024-10-30T11:16:21+00:00
URL https://renote.net/robots.txt
Domain IPs 133.242.188.82
Response IP 133.242.188.82
Found Yes
Hash ee07b4a8eb11d6bc62a86b4908aa716c93cec12d421ff0ef82cdb87f60714e06
SimHash 32c50d0d7450

Groups

*

Rule Path
Disallow /*/new$
Disallow /*/edit$
Disallow /users/*
Disallow /pages/search?*

Other Records

Field Value
sitemap https://renote.net/sitemap.xml.gz

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /