dovletqullugu.info
robots.txt

Robots Exclusion Standard data for dovletqullugu.info

Resource Scan

Scan Details

Site Domain dovletqullugu.info
Base Domain dovletqullugu.info
Scan Status Ok
Last Scan2025-10-16T01:12:32+00:00
Next Scan 2025-11-15T01:12:32+00:00

Last Scan

Scanned2025-10-16T01:12:32+00:00
URL https://dovletqullugu.info/robots.txt
Domain IPs 104.21.79.108, 172.67.145.24, 2606:4700:3032::6815:4f6c, 2606:4700:3037::ac43:9118
Response IP 104.21.79.108
Found Yes
Hash 7187dbcd8e88d56b86bdf0a335c50de0c0e02bc2910754b1913b2c3e7cf189b4
SimHash 570172d26525

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /accounts/
Disallow /api/
Disallow /ckeditor/
Disallow /users/
Disallow /manage/
Disallow /*/qatil/
Disallow /*/qaydalar/
Allow /
Allow /imtahan-modelleri/
Allow /xeberler/
Allow /about/
Allow /contact/
Allow /privacy-policy/
Allow /terms-of-use/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://dovletqullugu.info/sitemap-index.xml

Comments

  • Disallow admin and private areas
  • Allow important pages
  • Sitemap
  • Crawl-delay for respectful crawling