ir.sputniknews.com
robots.txt

Robots Exclusion Standard data for ir.sputniknews.com

Resource Scan

Scan Details

Site Domain ir.sputniknews.com
Base Domain sputniknews.com
Scan Status Ok
Last Scan2024-11-11T06:39:07+00:00
Next Scan 2024-11-18T06:39:07+00:00

Last Scan

Scanned2024-11-11T06:39:07+00:00
URL https://ir.sputniknews.com/robots.txt
Redirect https://spnfa.ir/robots.txt
Redirect Domain spnfa.ir
Redirect Base spnfa.ir
Domain IPs 194.190.139.37
Redirect IPs 194.190.139.37
Response IP 194.190.139.37
Found Yes
Hash 48565bf746ac7a070d0d5103f67185d921ff7d34bb5c8c33783246f7383b01d7
SimHash 3f48fc83c213

Groups

*

Rule Path
Disallow *-print.html$
Disallow /sys_*
Disallow /search/
Disallow /services/
Disallow /cms/
Disallow */calendar.html
Disallow /_editorial_preview_*

Other Records

Field Value
sitemap https://spnfa.ir/sitemap_article_index.xml
sitemap https://spnfa.ir/sitemap_list_index.xml
sitemap https://spnfa.ir/sitemap_archive.xml

Warnings

  • `clean-param` is not a known field.