hebdo.ahram.org.eg
robots.txt

Robots Exclusion Standard data for hebdo.ahram.org.eg

Resource Scan

Scan Details

Site Domain hebdo.ahram.org.eg
Base Domain ahram.org.eg
Scan Status Ok
Last Scan2025-11-09T15:04:39+00:00
Next Scan 2025-12-09T15:04:39+00:00

Last Scan

Scanned2025-11-09T15:04:39+00:00
URL https://hebdo.ahram.org.eg/robots.txt
Redirect https://french.ahram.org.eg/robots.txt
Redirect Domain french.ahram.org.eg
Redirect Base ahram.org.eg
Domain IPs 104.20.44.169, 172.66.175.132, 2606:4700:10::6814:2ca9, 2606:4700:10::ac42:af84
Redirect IPs 104.20.44.169, 172.66.175.132, 2606:4700:10::6814:2ca9, 2606:4700:10::ac42:af84
Response IP 104.20.44.169
Found Yes
Hash d97f33a6a97e17679b82267c70901455444e4e02017593618f408a7d21205549
SimHash 71104501c5f7

Groups

facebookexternalhit

Rule Path
Allow /

facebot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

telegrambot

Rule Path
Allow /

slackbot

Rule Path
Allow /

slackbot-linkexpanding

Rule Path
Allow /

pinterest

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

skypeuripreview

Rule Path
Allow /

vkshare

Rule Path
Allow /

redditbot

Rule Path
Allow /

discordbot

Rule Path
Allow /

snapchat

Rule Path
Allow /

instagram

Rule Path
Allow /

viber

Rule Path
Allow /

line

Rule Path
Allow /

wechat

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

*

Rule Path
Disallow /bin/
Disallow /app_data/
Disallow /App_Data/
Disallow /admin/
Disallow /cpanel/
Disallow /Login.aspx
Disallow /search
Disallow /*?q=*
Allow /News/
Allow /

Other Records

Field Value
sitemap https://french.ahram.org.eg/ui/front/sitemap.xml

Comments

  • ================================
  • Sitemap
  • ================================
  • ========================================
  • Social Media Bots - يجب أن تكون أولاً
  • ========================================
  • Facebook
  • Twitter
  • LinkedIn
  • WhatsApp
  • Telegram
  • Slack
  • Pinterest
  • Skype
  • VK (VKontakte)
  • Reddit
  • Discord
  • Snapchat
  • Instagram
  • Viber
  • Line
  • WeChat
  • ========================================
  • Search Engines
  • ========================================
  • ========================================
  • Generic Rules
  • ========================================