Log In Sign Up

apidock.com
robots.txt

Robots Exclusion Standard data for apidock.com

Resource Scan

Scan Details

Site Domain apidock.com
Base Domain apidock.com
Scan Status Ok
Last Scan2026-02-19T11:05:51+00:00
Next Scan 2026-03-21T11:05:51+00:00

Last Scan

Scanned2026-02-19T11:05:51+00:00
URL https://apidock.com/robots.txt
Domain IPs 104.26.6.118, 104.26.7.118, 172.67.69.79, 2606:4700:20::681a:676, 2606:4700:20::681a:776, 2606:4700:20::ac43:454f
Response IP 104.26.6.118
Found Yes
Hash 5d89c9acdedd658d3cf9acf2b6b7f88d2540109ed6147ddd62dfa5e7f9560d2b
SimHash a2944c8d6670

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bytespider

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top