bilgicik.com
robots.txt

Robots Exclusion Standard data for bilgicik.com

Resource Scan

Scan Details

Site Domain bilgicik.com
Base Domain bilgicik.com
Scan Status Ok
Last Scan2024-11-18T18:04:58+00:00
Next Scan 2024-11-25T18:04:58+00:00

Last Scan

Scanned2024-11-18T18:04:58+00:00
URL https://bilgicik.com/robots.txt
Domain IPs 104.21.43.151, 172.67.180.165, 2606:4700:3030::ac43:b4a5, 2606:4700:3031::6815:2b97
Response IP 104.21.43.151
Found Yes
Hash 57ab6d6929d62069abf2ce5adcb6fc1e869ec40f87c3a7244cb74ddeba3115e7
SimHash 0d448ef15612

Groups

*

Rule Path
Allow /
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap http://www.bilgicik.com/sitemap.xml

Comments

  • Disallow: /e
  • Disallow: /show-error-
  • Disallow: /*/feed
  • Disallow: /*/feed/