segye.com
robots.txt

Robots Exclusion Standard data for segye.com

Resource Scan

Scan Details

Site Domain segye.com
Base Domain segye.com
Scan Status Ok
Last Scan2024-11-16T17:55:22+00:00
Next Scan 2024-11-23T17:55:22+00:00

Last Scan

Scanned2024-11-16T17:55:22+00:00
URL https://segye.com/robots.txt
Domain IPs 49.236.149.65
Response IP 49.236.149.65
Found Yes
Hash afde241677f28ddc8d8dd3e143c5b5252ecfd0599a62d46778ebc3d0e06b5e9a
SimHash 63565f1146f5

Groups

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

facebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

twitterbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

yeti

Rule Path
Allow /

daumoa

Rule Path
Allow /

popin_agent

Rule Path
Allow /

google search console

Rule Path
Allow /

googlebot/2.1

Rule Path
Allow /

googlebot-smartphone

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.segye.com/Sitemap_index.xml
sitemap https://www.segye.com//sitemap_img_index.xml