Log In Sign Up

globalsourceksa.com
robots.txt

Robots Exclusion Standard data for globalsourceksa.com

Resource Scan

Scan Details

Site Domain globalsourceksa.com
Base Domain globalsourceksa.com
Scan Status Ok
Last Scan2025-12-12T03:39:24+00:00
Next Scan 2026-01-11T03:39:24+00:00

Last Scan

Scanned2025-12-12T03:39:24+00:00
URL https://globalsourceksa.com/robots.txt
Redirect https://www.globalsourceksa.com/robots.txt
Redirect Domain www.globalsourceksa.com
Redirect Base globalsourceksa.com
Domain IPs 104.21.5.138, 172.67.154.162, 2606:4700:3032::6815:58a, 2606:4700:3034::ac43:9aa2
Redirect IPs 104.21.5.138, 172.67.154.162, 2606:4700:3032::6815:58a, 2606:4700:3034::ac43:9aa2
Response IP 172.67.154.162
Found Yes
Hash 3fca69bcd786bb95d369113554527ff674251bdc88769f6a3e7dbdc61e756c20
SimHash 7e0cc94ba4f4

Groups

*

Rule Path
Disallow /wp-json/
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /author/
Disallow /*?author=*
Disallow /search/
Disallow /?s=
Disallow /*?replytocom=
Disallow /feed/
Disallow */feed/
Disallow /comments/feed/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /readme.html
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Disallow /*.pdf$
Disallow /*.eot$
Disallow /*.ttf$
Disallow /*.woff$
Disallow /*.woff2$
Disallow /*.zip$
Disallow /*.rar$
Disallow /*.exe$
Disallow /*.tmp$
Disallow /*.bak$
Disallow /*.log$
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/

oai-searchbot
chatgpt-user
chatgpt-user/2.0
gptbot
anthropic-ai
claudebot
claude-searchbot
claude-user
claude-web
perplexitybot
perplexity-user
googlebot
google-extended
google-cloudvertexbot
ai2bot
ccbot
diffbot
omgili
bingbot
amazonbot
applebot
applebot-extended
facebookbot
meta-externalagent
meta-externalfetcher
linkedinbot
bytespider
duckassistbot
cohere-ai
timpibot
proratainc
youbot
archive.org_bot
mistralai-user
petalbot

Rule Path
Allow /

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.globalsourceksa.com/sitemap_index.xml
Back to top

Comments

  • Robots.txt file for globalsourceksa.com
  • .__________________________.
  • | .___________________. | |
  • | | ................. | | |
  • | | ::[ Dear Robot ]: | | |
  • | | ::::[ Be Nice ]:: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | | ::::::::::::::::: | | |
  • | !___________________! | |
  • !_______________________!__!
  • / \
  • / [][][][][][][][][][][][][] \
  • / [][][][][][][][][][][][][][] \
  • ( [][][][][____________][][][][] )
  • \ ------------------------------ /
  • \______________________________/
  • General
  • -------
  • Block WP utility files
  • ----------------------
  • Allow access to specific files in wp-admin
  • ------------------------------------------
  • Allow media uploads to be crawled
  • ---------------------------------
  • Disallow specific file types
  • ----------------------------
  • Prevent crawling CF challenge URLs
  • ----------------------------------
  • Sitemap
  • -------
  • Allow Known Bots
  • -------------
  • Ban Useless Bots
  • ----------------
  • Crafted with Care by Hype Funda
  • -------------------------------
  • At Hype Funda, we take pride in designing and developing websites that
  • truly resonate with our clients' visions. Our latest project showcases
  • our expertise in website design, development, digital marketing, SEO,
  • SMM, PPC, and robust security measures. We are dedicated to creating
  • engaging and effective online experiences that connect businesses with
  • their audiences while ensuring their data is protected.
  • To learn more about our services and how we can help elevate your digital
  • presence, visit us at
  • https://www.hypefunda.com/
  • Partner with us to achieve your goals with confidence!
  • ------------------------------------------------------
  • /$$ /$$ /$$$$$$$$ /$$
  • | $$ | $$ | $$_____/ | $$
  • | $$ | $$ /$$ /$$ /$$$$$$ /$$$$$$ | $$ /$$ /$$ /$$$$$$$ /$$$$$$$ /$$$$$$
  • | $$$$$$$$| $$ | $$ /$$__ $$ /$$__ $$ | $$$$$| $$ | $$| $$__ $$ /$$__ $$ |____ $$
  • | $$__ $$| $$ | $$| $$ \ $$| $$$$$$$$ | $$__/| $$ | $$| $$ \ $$| $$ | $$ /$$$$$$$
  • | $$ | $$| $$ | $$| $$ | $$| $$_____/ | $$ | $$ | $$| $$ | $$| $$ | $$ /$$__ $$
  • | $$ | $$| $$$$$$$| $$$$$$$/| $$$$$$$ | $$ | $$$$$$/| $$ | $$| $$$$$$$| $$$$$$$
  • |__/ |__/ \____ $$| $$____/ \_______/ |__/ \______/ |__/ |__/ \_______/ \_______/
  • /$$ | $$| $$
  • | $$$$$$/| $$
  • \______/ |__/
Back to top