dailyamardesh.com
robots.txt

Robots Exclusion Standard data for dailyamardesh.com

Resource Scan

Scan Details

Site Domain dailyamardesh.com
Base Domain dailyamardesh.com
Scan Status Ok
Last Scan2025-12-26T10:54:53+00:00
Next Scan 2026-01-02T10:54:53+00:00

Last Scan

Scanned2025-12-26T10:54:53+00:00
URL https://dailyamardesh.com/robots.txt
Redirect https://www.dailyamardesh.com/robots.txt
Redirect Domain www.dailyamardesh.com
Redirect Base dailyamardesh.com
Domain IPs 104.26.4.225, 104.26.5.225, 172.67.71.74, 2606:4700:20::681a:4e1, 2606:4700:20::681a:5e1, 2606:4700:20::ac43:474a
Redirect IPs 104.26.4.225, 104.26.5.225, 172.67.71.74, 2606:4700:20::681a:4e1, 2606:4700:20::681a:5e1, 2606:4700:20::ac43:474a
Response IP 104.26.4.225
Found Yes
Hash 2934553b9b67e5ad3d6f09eef87058d05f95e1e7498a04736ad335d86750fa1d
SimHash 6d194b46f452

Groups

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /cdn-cgi/
Disallow /register
Disallow /login
Disallow /api/

Other Records

Field Value
sitemap https://dailyamardesh.com/sitemap.xml
sitemap https://dailyamardesh.com/sitemaps/news-sitemap.xml
sitemap https://dailyamardesh.com/sitemaps/topic-sitemap.xml