legaleraonline.com
robots.txt

Robots Exclusion Standard data for legaleraonline.com

Resource Scan

Scan Details

Site Domain legaleraonline.com
Base Domain legaleraonline.com
Scan Status Ok
Last Scan2024-10-04T01:21:18+00:00
Next Scan 2024-10-11T01:21:18+00:00

Last Scan

Scanned2024-10-04T01:21:18+00:00
URL https://legaleraonline.com/robots.txt
Redirect https://www.legaleraonline.com/robots.txt
Redirect Domain www.legaleraonline.com
Redirect Base legaleraonline.com
Domain IPs 101.53.155.122
Redirect IPs 101.53.155.122
Response IP 101.53.155.122
Found Yes
Hash e6ca1a827392b7433a0dc7dfd5e691e81044a1257a6668279cc7b0b6577e6af0
SimHash 8a0a1a0fffd7

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Allow /xhr/getNewsMixin*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://www.legaleraonline.com/sitemap/sitemap-index.xml
sitemap https://www.legaleraonline.com/news-sitemap-daily.xml
sitemap https://www.legaleraonline.com/feeds.xml

Comments

  • robots.txt for https://www.legaleraonline.com/