Log In Sign Up

mention.network
robots.txt

Robots Exclusion Standard data for mention.network

Resource Scan

Scan Details

Site Domain mention.network
Base Domain mention.network
Scan Status Ok
Last Scan2026-02-20T01:18:42+00:00
Next Scan 2026-03-22T01:18:42+00:00

Last Scan

Scanned2026-02-20T01:18:42+00:00
URL https://mention.network/robots.txt
Domain IPs 104.21.30.233, 172.67.173.249, 2606:4700:3032::6815:1ee9, 2606:4700:3036::ac43:adf9
Response IP 172.67.173.249
Found Yes
Hash f2d633fd2c9b18ae3283fe7519a57d6a14a3001727e3731c381ac341fcdb0b4b
SimHash 73465e73ff23

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /images/
Allow /logo/
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.webp
Allow /*.svg
Back to top

Other Records

Field Value
sitemap https://mention.network/sitemap.xml
Back to top

Comments

  • Sitemap
  • Crawl-delay for respectful crawling
  • Disallow admin or private areas (if any in the future)
  • Disallow: /admin/
  • Disallow: /private/
  • Allow all images
Back to top