malayalam.factcrescendo.com
robots.txt

Robots Exclusion Standard data for malayalam.factcrescendo.com

Resource Scan

Scan Details

Site Domain malayalam.factcrescendo.com
Base Domain factcrescendo.com
Scan Status Ok
Last Scan2024-10-28T21:34:17+00:00
Next Scan 2024-11-27T21:34:17+00:00

Last Scan

Scanned2024-10-28T21:34:17+00:00
URL https://malayalam.factcrescendo.com/robots.txt
Domain IPs 104.22.52.111, 104.22.53.111, 172.67.14.115, 2606:4700:10::6816:346f, 2606:4700:10::6816:356f, 2606:4700:10::ac43:e73
Response IP 104.22.53.111
Found Yes
Hash 4f27f5918c45bf926a01175d6adf1c3e373946d03d6ddb3330909866d424be35
SimHash 89108a47c743

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall

Other Records

Field Value
sitemap https://malayalam.factcrescendo.com/sitemap/sitemap-index.xml
sitemap https://malayalam.factcrescendo.com/news-sitemap-daily.xml
sitemap https://malayalam.factcrescendo.com/feeds.xml
sitemap https://malayalam.factcrescendo.com/sitemap-daily.xml

Comments

  • robots.txt for https://malayalam.factcrescendo.com