Log In Sign Up

storyblocks.com
robots.txt

Robots Exclusion Standard data for storyblocks.com

Resource Scan

Scan Details

Site Domain storyblocks.com
Base Domain storyblocks.com
Scan Status Ok
Last Scan2024-08-29T03:43:36+00:00
Next Scan 2024-09-28T03:43:36+00:00

Last Scan

Scanned2024-08-29T03:43:36+00:00
URL https://storyblocks.com/robots.txt
Redirect https://www.storyblocks.com/robots.txt
Redirect Domain www.storyblocks.com
Redirect Base storyblocks.com
Domain IPs 13.227.254.128, 13.227.254.28, 13.227.254.52, 13.227.254.91
Redirect IPs 52.21.78.245, 52.7.72.7, 54.172.1.161
Response IP 54.172.1.161
Found Yes
Hash efbbcc92dddd2aa20a512978fa4791f19de1fd8c2ba2e8804de760c452f03fed
SimHash bd3e04d90d97

Groups

*

Rule Path
Disallow */video/-360/search
Disallow */video/aerial/search
Disallow */video/animals/search
Disallow */video/business-and-professions/search
Disallow */video/business/search
Disallow */video/celebrations/search
Disallow */video/holidays-and-celebrations/search
Disallow */video/lifestyle/search
Disallow */video/medical/search
Disallow */video/nature/search
Disallow */video/people/search
Disallow */video/places-and-landmarks/search
Disallow */video/religion/search
Disallow */video/settings/search
Disallow */video/technology/search
Disallow */video/transportation/search
Disallow */video/travel/search
Disallow */video/360-files/search
Disallow */video/green-screen/search
Disallow */video/historical-and-archival/search
Disallow */video/slow-motion/search
Disallow */video/time-lapse/search
Disallow */motion-graphics/abstract/search
Disallow */motion-graphics/business/search
Disallow */motion-graphics/celebrations/search
Disallow */motion-graphics/colors/search
Disallow */motion-graphics/time/search
Disallow */motion-graphics/medical/search
Disallow */motion-graphics/moods/search
Disallow */motion-graphics/music/search
Disallow */motion-graphics/nature/search
Disallow */motion-graphics/news/search
Disallow */motion-graphics/religious/search
Disallow */motion-graphics/space/search
Disallow */motion-graphics/technology/search
Disallow */motion-graphics/holidays-and-celebrations/search
Disallow */motion-graphics/business-and-professions/search
Disallow */motion-graphics/effects-and-overlays/search
Disallow */motion-graphics/love/search
Disallow /api/*
Disallow */login?redirect*
Disallow /checkout
Disallow /cart
Disallow /download
Disallow */*?gcn=*
Disallow */join/*
Disallow *?sort=*
Disallow *frame_rates*
Disallow *?search-origin=search_bar*
Disallow *?search-origin=type-ahead*
Disallow /*?mrkt_page=*
Disallow *.COM*
Disallow /assets/common/images/media-page/redesigned-footage/footage-sizzle.webm
Disallow /assets/common/images/media-page/redesigned-footage/footage-sizzle.jpg
Disallow *x%2Bvideo*
Allow *tax%2Bvideo*
Disallow *x%20video*
Allow *enforced*
Disallow */mating*
Disallow *%2Bmating*
Disallow *pink%2Bworld*
Disallow *open%2B%2B%2Bdance*
Disallow *family%2Bstork*
Allow *tutorial*
Disallow *hot%2Bmovie*
Allow *stripped%2Bdown*
Allow *stripwood*
Allow *wooden%2Bstrip*
Allow *stripy*
Allow *stripped%2Bpaint*
Allow *filmstrip*
Allow *cut%2Binto%2Bstrips*
Allow *stripe*
Allow *air%2Bstrip*
Allow *film-strip*
Allow *film%2Bstrip*
Allow *bread%2Bstrip*
Disallow *deflower*
Allow *naughty%2Bor%2Bnice*
Disallow *gential*
Allow *six%2Bfeet*
Allow *6%2Bfeet*
Disallow *gyno*
Disallow */member/*
Disallow /unsupported-device$
Disallow /video/footage/sem$
Disallow /YesTheory$
Disallow /wisecrack.Get$
Disallow /VideoInfluencers$
Disallow /VanWives$
Disallow /ThisIs$
Disallow /TheWavMan$
Disallow /SteveTerreberry$
Disallow /SorelleAmore$
Disallow /SidneyDiongzon$
Disallow /Sharpe$
Disallow /PotatoJet$
Disallow /NemanjaSekulic$
Disallow /MattiH$
Disallow /LokCheung$
Disallow /LOK$
Disallow /IndyMogul$
Disallow /HowToUsePOVcameras_0317$
Disallow /FlytPath$
Disallow /DylanBecome$
Disallow /DopeMotionsIn$
Disallow /DanMace$
Disallow /DanielSchiffer$
Disallow /complimentary/YTExtFT$
Disallow /CinecomAudio$
Disallow /Cinecom$
Disallow /AmandaRachLee_0517$
Disallow /AllisonAnderson$
Disallow /AlliandWill$
Disallow /AlfoMedia$
Back to top

Other Records

Field Value
sitemap https://www.storyblocks.com/sitemaps/sitemap-index.xml
sitemap https://www.storyblocks.com/resources/sitemap_index.xml
Back to top

Comments

  • EK 2.10.2022
  • Disallow: */portfolio/*
  • EK - 1.18.2023
  • AK 7.27.22 removing header video from search results
  • EK 6.9.21
  • Disallow: *mother%2*
  • Disallow: *+bathroom*
  • Disallow: *bathroom+*
  • Disallow: *mom+*
  • Disallow: *+mom*
  • Disallow: *forced*
  • Disallow: *20bra*
  • Disallow: *+bra*
  • EK 6.3.21
  • Disallow: *child+model*
  • Disallow: *dirty*
  • Disallow: *tutor*
  • Disallow: *shame*
  • Disallow: *mother+*
  • EK 3.31.2021
  • Disallow: *hot+girl*
  • Disallow: *+girl*
  • Disallow: */search/girl*
  • Disallow: *+boy*
  • Disallow: */search/boy*
  • Disallow: *strip*
  • Disallow: *mature*
  • Disallow: *+pov*
  • Disallow: *naughty*
  • Disallow: *seduc*
  • Disallow: *muzzle*
  • Disallow: *feet*
  • Disallow: *hairy*
  • EK 2.17
  • EK AFF
  • NSFW
Back to top