haberfedai.com
robots.txt

Robots Exclusion Standard data for haberfedai.com

Resource Scan

Scan Details

Site Domain haberfedai.com
Base Domain haberfedai.com
Scan Status Ok
Last Scan2024-10-01T02:20:27+00:00
Next Scan 2024-10-08T02:20:27+00:00

Last Scan

Scanned2024-10-01T02:20:27+00:00
URL https://haberfedai.com/robots.txt
Redirect https://www.haberfedai.com/robots.txt
Redirect Domain www.haberfedai.com
Redirect Base haberfedai.com
Domain IPs 91.151.95.70
Redirect IPs 91.151.95.70
Response IP 91.151.95.70
Found Yes
Hash cce0c81e67e8d4d1504f3fc51e80242f16518b036a6745b6091e7b944ca413c7
SimHash 0115ced4d5f1

Groups

googlebot-image

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

*

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /
Disallow /panel/

Other Records

Field Value
sitemap /Sitemap: https://www.haberfedai.com/sitemap.xml

Comments

  • Google Image
  • Google AdSense
  • Google Adsbot
  • Google News