startupranking.com
robots.txt

Robots Exclusion Standard data for startupranking.com

Resource Scan

Scan Details

Site Domain startupranking.com
Base Domain startupranking.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-04T02:44:49+00:00
Next Scan 2026-04-04T02:44:49+00:00

Last Successful Scan

Scanned2024-12-03T22:50:21+00:00
URL https://startupranking.com/robots.txt
Redirect https://www.startupranking.com/robots.txt
Redirect Domain www.startupranking.com
Redirect Base startupranking.com
Domain IPs 104.26.4.183, 104.26.5.183, 172.67.75.35, 2606:4700:20::681a:4b7, 2606:4700:20::681a:5b7, 2606:4700:20::ac43:4b23
Redirect IPs 104.26.4.183, 104.26.5.183, 172.67.75.35, 2606:4700:20::681a:4b7, 2606:4700:20::681a:5b7, 2606:4700:20::ac43:4b23
Response IP 104.26.4.183
Found Yes
Hash dd446a9d9a74bc9a2d4c3da1b12462de6db79af38346c05d042259588a80e26a
SimHash 6a455271967b

Groups

*

Rule Path
Disallow /advertising/create-ad/
Disallow /article/load-url/
Disallow /booster/create/
Disallow /booster/upgrade/
Disallow /booster/startup/create/
Disallow /booster/startup/edit/
Disallow /booster/startup-booster-sub/
Disallow /booster/*/startup-booster-subs
Disallow /email/create
Disallow /login/email/create
Disallow /email/communication-preferences/
Disallow /email/subscription/
Disallow /funding-round/edit/
Disallow /acquisition/edit/
Disallow /acquisition/*/news/new
Disallow /acquisition/news/delete/
Disallow /state/search/
Disallow /person/*/news/new
Disallow /person/news/delete/
Disallow /person/edit/
Disallow /person/search/
Disallow /startup/*/people/new
Disallow /startup/people/edit/
Disallow /startup/people/delete/
Disallow /sale/
Disallow /search
Disallow /product/*/new
Disallow /product/edit/
Disallow /startup/*/news/new
Disallow /startup/news/delete/
Disallow /startup/claim/
Disallow /startup/create
Disallow /startup/edit/
Disallow /startup/search-for-available-options
Disallow /startup/available-options/
Disallow /startup-revision/create/
Disallow /startup-revision/revise/
Disallow /startup/search/
Disallow /tag/search/
Disallow /followed-startups/
Disallow /favorite-startup/
Disallow /login
Disallow /advanced-login
Disallow /login/
Disallow /logout
Allow /

Comments

  • Allow crawling of all other pages