francais.rt.com
robots.txt

Robots Exclusion Standard data for francais.rt.com

Resource Scan

Scan Details

Site Domain francais.rt.com
Base Domain rt.com
Scan Status Ok
Last Scan2024-04-22T18:02:14+00:00
Next Scan 2024-05-22T18:02:14+00:00

Last Scan

Scanned2024-04-22T18:02:14+00:00
URL https://francais.rt.com/robots.txt
Domain IPs 91.215.41.7
Response IP 91.215.41.7
Found Yes
Hash dcb028805cc7fa4e136ead82d26d043de8ec70c8c1cc308d6987142a9ebc2d7d
SimHash 6c35807595d9

Groups

googlebot

Rule Path
Disallow /recherche
Disallow /preview/
Disallow /fb
Disallow /c/
Disallow /nbc/
Disallow /nbc-stats/
Allow /static/fonts/icon/
Allow /static/css/
Allow /static/js/

bingbot

Rule Path
Disallow /recherche
Disallow /preview/
Disallow /fb
Disallow /c/
Disallow /nbc/
Disallow /nbc-stats/
Allow /static/fonts/icon/
Allow /static/css/
Allow /static/js/

*

Rule Path
Disallow /recherche
Disallow /preview/
Disallow /fb
Disallow /c/
Disallow /nbc/
Disallow /nbc-stats/
Allow /static/fonts/icon/
Allow /static/css/
Allow /static/js/

Other Records

Field Value
sitemap https://francais.rt.com/sitemap.xml
sitemap https://francais.rt.com/google_newsmap.xml