7forallmankind.be
robots.txt

Robots Exclusion Standard data for 7forallmankind.be

Resource Scan

Scan Details

Site Domain 7forallmankind.be
Base Domain 7forallmankind.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-25T15:17:52+00:00
Next Scan 2026-01-23T15:17:52+00:00

Last Successful Scan

Scanned2025-06-04T23:18:59+00:00
URL https://7forallmankind.be/robots.txt
Redirect https://www.7forallmankind.be/robots.txt
Redirect Domain www.7forallmankind.be
Redirect Base 7forallmankind.be
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 151.101.1.124
Found Yes
Hash d676fd831b961c5ee8c45848c78fcc3b44fdf205d70467bce4540eaad3e30d5e
SimHash bc5e71dfc6bf

Groups

twitterbot

Rule Path
Allow /

ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper
ahrefsbot
awariobot
blexbot
charlotte
coccocbot
dataforseobot
dotbot
geedobot
mj12bot
paracrawl
petalbot
seznambot
siteauditbot
bytespider
barkrowler
serpstatbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow */CHANGELOG.md
Disallow */composer.json
Disallow */composer.lock
Disallow */CONTRIBUTING.md
Disallow */CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow */COPYING.txt
Disallow */Gruntfile.js
Disallow */ISSUE_TEMPLATE.md
Disallow */LICENSE.html
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */nginx.conf.sample
Disallow */package.json
Disallow */package.json.sample
Disallow */php.ini.sample
Disallow */RELEASE_NOTES.txt

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow */account/
Disallow */app/
Disallow */bin/
Disallow */cart/
Disallow */catalogsearch/
Disallow */checkout/
Disallow */control/
Disallow */customer/
Disallow */CVS/
Disallow */dev/
Disallow */giftcard/
Disallow */guest/
Disallow */index.php/
Disallow */newsletter/
Disallow */order/
Disallow */phpserver/
Disallow */report/
Disallow */sendfriend/
Disallow */setup/
Disallow */shell/
Disallow */storecredit/
Disallow */tag/
Disallow */update/
Disallow */var/
Disallow */vault/
Disallow */vendor/
Disallow */wishlist/

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*.CVS
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Svn$
Disallow /*.Tgz$
Disallow /*.Zip$

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*.php$
Disallow /*SID%3D

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*fit_code%3D
Disallow /*fit_group%3D
Disallow /*gender%3D
Disallow /*price%3D
Disallow /*product_list_dir%3D
Disallow /*product_list_limit%3D
Disallow /*product_list_mode%3D
Disallow /*product_list_order%3D
Disallow /*q%3D
Disallow /*size%3D
Disallow /*wash_group%3D
Disallow /*___store%3D
Disallow /*___from_store%3D
Disallow /*__website%3D
Disallow /*user_country%3D
Disallow /*platform%3D
Disallow /*waist%3D
Disallow /*product_taxonomy%3D
Disallow /*platform*%3D
Disallow /*wash_group*%3D
Disallow /*product_taxonomy*%3D
Disallow /*fit_code*%3D
Disallow /*fit_group*%3D
Disallow /*size*%3D
Disallow /*sevenfam_weight_fabric*%3D

Other Records

Field Value
sitemap https://www.7forallmankind.be/media/sitemaps/sitemap_be.xml
sitemap https://www.7forallmankind.be/media/sitemaps/sitemap_be_nl.xml
sitemap https://www.7forallmankind.be/media/sitemaps/sitemap_be_fr.xml
sitemap https://www.7forallmankind.be/media/sitemaps/sitemap_be_en.xml

Comments

  • Twitter Bot for OG tags
  • Bad Bots
  • Files
  • Directories
  • CVS SVN directory and dump files
  • Session ID
  • Parameters
  • Limit the crawling of multiple filter pages
  • Disallows for ticket #49452
  • Disallows for ticket #61779