robinspost.com
robots.txt
Robots Exclusion Standard data for robinspost.com
Resource Scan
Scan Details
| Site Domain | robinspost.com |
| Base Domain | robinspost.com |
| Scan Status | Ok |
| Last Scan | 2024-09-08T10:44:34+00:00 |
| Next Scan | 2024-10-08T10:44:34+00:00 |
Last Scan
| Scanned | 2024-09-08T10:44:34+00:00 |
| URL | https://robinspost.com/robots.txt |
| Redirect | https://www.robinspost.com/robots.txt |
| Redirect Domain | www.robinspost.com |
| Redirect Base | robinspost.com |
| Domain IPs | 199.231.187.109 |
| Redirect IPs | 199.231.187.109 |
| Response IP | 199.231.187.109 |
| Found | Yes |
| Hash | eb511b0de63f12ab52bfab7b2ca4f152fff49e70a3425ef14c0f2042381607f1 |
| SimHash | 51465803ec78 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /chirpy/ |
| Disallow | /122CB/ |
| Disallow | /articles/ |
| Disallow | /assignments-drafts/ |
| Disallow | /audio/ |
| Disallow | /audio-tts/ |
| Disallow | /blog/ |
| Disallow | /cache/ |
| Disallow | /images/ |
| Disallow | /ioncube/ |
| Disallow | /market/ |
| Disallow | /mypost/ |
| Disallow | /nest/ |
| Disallow | /onlinestores/ |
| Disallow | /socialmarket/ |
| Disallow | /socialexchange/ |
| Disallow | /scripts/ |
| Disallow | /technology-news/ |
| Disallow | /users/ |
| Disallow | /view/ |
| Disallow | /news/administrator/ |
| Disallow | /news/bin/ |
| Disallow | /news/cache/ |
| Disallow | /news/component/search/ |
| Allow | /news/component/route66/ |
| Disallow | /news/components/ |
| Disallow | /news/cli/ |
| Disallow | /news/component/mailto/ |
| Disallow | /news/images/ |
| Allow | /news/images/logical-position-topics/ |
| Allow | /news/images/logical-position-topics-2/ |
| Disallow | /news/includes/ |
| Disallow | /news/installation/ |
| Disallow | /news/jupgrade/ |
| Disallow | /news/language/ |
| Disallow | /news/layouts/ |
| Disallow | /news/libraries/ |
| Disallow | /news/media/ |
| Disallow | /news/modules/ |
| Disallow | /news/plugins/ |
| Disallow | /news/templates/ |
| Disallow | /news/tmp/ |
| Disallow | /news/xmlrpc/ |
| Disallow | /shopping2/ |
| Disallow | /shopping/administrator/ |
| Disallow | /shopping/amazon-test/ |
| Disallow | /shopping/cache/ |
| Disallow | /shopping/bin/ |
| Disallow | /shopping/components/ |
| Disallow | /shopping/cli/ |
| Disallow | /shopping/component/mailto/ |
| Disallow | /shopping/images/ |
| Disallow | /shopping/includes/ |
| Disallow | /shopping/installation/ |
| Disallow | /shopping/jupgrade/ |
| Disallow | /shopping/language/ |
| Disallow | /shopping/layouts/ |
| Disallow | /shopping/libraries/ |
| Disallow | /shopping/media/ |
| Disallow | /shopping/modules/ |
| Disallow | /shopping/plugins/ |
| Disallow | /shopping/templates/ |
| Disallow | /shopping/tmp/ |
| Disallow | /shopping/xmlrpc/ |
| Disallow | /shopping/us/ |
| Disallow | /social/ |
| Disallow | /social/administrator/ |
| Disallow | /social/cache/ |
| Disallow | /social/bin/ |
| Disallow | /social/components/ |
| Disallow | /social/cli/ |
| Disallow | /social/component/mailto/ |
| Disallow | /social/images/ |
| Disallow | /social/includes/ |
| Disallow | /social/installation/ |
| Disallow | /social/jupgrade/ |
| Disallow | /social/language/ |
| Disallow | /social/layouts/ |
| Disallow | /social/libraries/ |
| Disallow | /social/media/ |
| Disallow | /social/modules/ |
| Disallow | /social/plugins/ |
| Disallow | /social/tags/ |
| Disallow | /social/templates/ |
| Disallow | /social/tmp/ |
| Disallow | /social/xmlrpc/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.robinspost.com/shopping/daily-specials.feed?type=rss |
| sitemap | https://www.robinspost.com/news/business-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/consumer-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/entertainment-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/health-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/politics-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/press-releases.feed?type=rss |
| sitemap | https://www.robinspost.com/news/science-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/sports-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/technology-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/travel-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/us-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/world-news.feed?type=rss |
| sitemap | https://www.robinspost.com/news/noticias.feed?type=rss |
| sitemap | https://www.robinspost.com/news-sitemap.xml |
| sitemap | https://www.robinspost.com/news/news.xml |
| sitemap | https://www.robinspost.com/news/news-sitemap.xml |
| sitemap | https://www.robinspost.com/shopping/shopping.xml |
| sitemap | https://www.robinspost.com/news/component/route66/sitemapindex/1.xml?format=xml |
| sitemap | https://www.robinspost.com/featured-posts-rss.php |
| sitemap | https://www.robinspost.com/featured-posts-2019-rss.php |
Comments