7forallmankind.eu
robots.txt

Robots Exclusion Standard data for 7forallmankind.eu

Resource Scan

Scan Details

Site Domain 7forallmankind.eu
Base Domain 7forallmankind.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-09T20:12:05+00:00
Next Scan 2026-01-07T20:12:05+00:00

Last Successful Scan

Scanned2025-05-20T20:10:32+00:00
URL https://7forallmankind.eu/robots.txt
Redirect https://www.7forallmankind.eu/robots.txt
Redirect Domain www.7forallmankind.eu
Redirect Base 7forallmankind.eu
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 151.101.193.124
Found Yes
Hash 7162aa5aa71868efe8473d91ed01167160a43bf1c8dbb23472860155d2a6207b
SimHash bc5a71dbc6b7

Groups

twitterbot

Rule Path
Allow /

ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper
ahrefsbot
awariobot
blexbot
charlotte
coccocbot
dataforseobot
dotbot
geedobot
mj12bot
paracrawl
petalbot
seznambot
siteauditbot
bytespider
barkrowler
serpstatbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow */CHANGELOG.md
Disallow */composer.json
Disallow */composer.lock
Disallow */CONTRIBUTING.md
Disallow */CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow */COPYING.txt
Disallow */Gruntfile.js
Disallow */ISSUE_TEMPLATE.md
Disallow */LICENSE.html
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */nginx.conf.sample
Disallow */package.json
Disallow */package.json.sample
Disallow */php.ini.sample
Disallow */RELEASE_NOTES.txt

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow */account/
Disallow */app/
Disallow */bin/
Disallow */cart/
Disallow */catalogsearch/
Disallow */checkout/
Disallow */control/
Disallow */customer/
Disallow */CVS/
Disallow */dev/
Disallow */giftcard/
Disallow */guest/
Disallow */index.php/
Disallow */newsletter/
Disallow */order/
Disallow */phpserver/
Disallow */report/
Disallow */sendfriend/
Disallow */setup/
Disallow */shell/
Disallow */storecredit/
Disallow */tag/
Disallow */update/
Disallow */var/
Disallow */vault/
Disallow */vendor/
Disallow */wishlist/

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*.CVS
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Svn$
Disallow /*.Tgz$
Disallow /*.Zip$

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*.php$
Disallow /*SID%3D

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*fit_code%3D
Disallow /*fit_group%3D
Disallow /*gender%3D
Disallow /*price%3D
Disallow /*product_list_dir%3D
Disallow /*product_list_limit%3D
Disallow /*product_list_mode%3D
Disallow /*product_list_order%3D
Disallow /*q%3D
Disallow /*size%3D
Disallow /*wash_group%3D
Disallow /*___store%3D
Disallow /*___from_store%3D
Disallow /*__website%3D
Disallow /*user_country%3D
Disallow /*platform%3D
Disallow /*waist%3D
Disallow /*product_taxonomy%3D
Disallow /*platform*%3D
Disallow /*wash_group*%3D
Disallow /*product_taxonomy*%3D
Disallow /*fit_code*%3D
Disallow /*fit_group*%3D
Disallow /*size*%3D
Disallow /*sevenfam_weight_fabric*%3D

Other Records

Field Value
sitemap https://www.7forallmankind.eu/media/sitemaps/sitemap_eu_en.xml
sitemap https://www.7forallmankind.eu/media/sitemaps/sitemap_eu_gr.xml
sitemap https://www.7forallmankind.eu/media/sitemaps/sitemap_eu_sp.xml

Comments

  • Twitter Bot for OG tags
  • Bad Bots
  • Files
  • Directories
  • CVS SVN directory and dump files
  • Session ID
  • Parameters
  • Limit the crawling of multiple filter pages
  • Disallows for ticket #49452
  • Disallows for ticket #61779