Log In Sign Up

toolboard.net
robots.txt

Robots Exclusion Standard data for toolboard.net

Resource Scan

Scan Details

Site Domain toolboard.net
Base Domain toolboard.net
Scan Status Ok
Last Scan2025-12-12T16:08:47+00:00
Next Scan 2025-12-19T16:08:47+00:00

Last Scan

Scanned2025-12-12T16:08:47+00:00
URL https://toolboard.net/robots.txt
Redirect https://www.toolboard.net/robots.txt
Redirect Domain www.toolboard.net
Redirect Base toolboard.net
Domain IPs 108.156.144.115, 108.156.144.23, 108.156.144.27, 108.156.144.49
Redirect IPs 108.156.144.115, 108.156.144.23, 108.156.144.27, 108.156.144.49, 2600:9000:2755:1000:1a:3831:5140:93a1, 2600:9000:2755:1400:1a:3831:5140:93a1, 2600:9000:2755:3200:1a:3831:5140:93a1, 2600:9000:2755:4a00:1a:3831:5140:93a1, 2600:9000:2755:5a00:1a:3831:5140:93a1, 2600:9000:2755:9200:1a:3831:5140:93a1, 2600:9000:2755:9a00:1a:3831:5140:93a1, 2600:9000:2755:f600:1a:3831:5140:93a1
Response IP 108.156.144.49
Found Yes
Hash 184b3ac71f7dbf634d7f7327d176b97c00a0d8f13e987539cc48e81cc4186ac5
SimHash 66945753b4e4

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /_next/
Disallow /dashboard/
Disallow /uploads/
Disallow /temp/
Disallow /test-*/
Allow /about
Allow /contact
Allow /faq
Allow /sitemap
Allow /privacy
Allow /terms
Allow /cookies
Allow /accessibility
Allow /*-calculator
Allow /*-converter
Allow /tools/
Allow /guides/
Allow /compare/
Allow /mortgage-calculator
Allow /auto-loan-calculator
Allow /currency-calculator
Allow /refinance-calculator
Allow /mortgage-payoff-calculator
Allow /conversion-calculator
Allow /time-zone-calculator
Allow /word-to-pdf-converter
Allow /png-jpg-to-svg-converter
Allow /image-resizer
Allow /images/
Allow /logo.png
Allow /favicon.ico

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.toolboard.net/sitemap-index.xml
sitemap https://www.toolboard.net/sitemap-tools.xml
sitemap https://www.toolboard.net/sitemap.xml
sitemap https://www.toolboard.net/sitemap-images.xml
Back to top

Comments

  • Sitemaps - TOOLS FIRST FOR MAXIMUM SEO
  • Disallow admin and API routes
  • Allow important pages
  • Allow all calculator and converter pages (HIGH PRIORITY)
  • Allow specific tool patterns
  • Allow static assets
  • Crawl delay (be respectful to servers)
  • Special instructions for major search engines
Back to top