financialexpress.com
robots.txt

Robots Exclusion Standard data for financialexpress.com

Resource Scan

Scan Details

Site Domain financialexpress.com
Base Domain financialexpress.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-20T23:24:27+00:00
Next Scan 2025-01-18T23:24:27+00:00

Last Successful Scan

Scanned2023-03-30T22:16:48+00:00
URL https://financialexpress.com/robots.txt
Redirect https://www.financialexpress.com/robots.txt
Redirect Domain www.financialexpress.com
Redirect Base financialexpress.com
Domain IPs 104.69.37.122
Redirect IPs 23.39.4.128
Response IP 104.69.37.122
Found Yes
Hash 1593c8a0ea606884206861c3a3210da526cc1ec1f63e6b1c9909cc03fed86ab5
SimHash d50cc409e0db

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /adblocker
Disallow /fepicturegallery.php?imageNo=%2F
Disallow /moreHomeListing.php?pg%2F
Disallow /fe_full/
Disallow /?s=
Disallow /search/
Disallow /openinappbtn/*
Disallow /?newsid
Disallow /interstitial/
Disallow /archives/
Disallow /archives/*

Other Records

Field Value
sitemap https://www.financialexpress.com/sitemap.xml
sitemap https://www.financialexpress.com/news-sitemap.xml
sitemap https://www.financialexpress.com/hindi/news-sitemap.xml
sitemap https://www.financialexpress.com/hindi/sitemap.xml