thefuturist.co
robots.txt

Robots Exclusion Standard data for thefuturist.co

Resource Scan

Scan Details

Site Domain thefuturist.co
Base Domain thefuturist.co
Scan Status Ok
Last Scan2024-11-11T04:58:11+00:00
Next Scan 2024-11-18T04:58:11+00:00

Last Scan

Scanned2024-11-11T04:58:11+00:00
URL https://thefuturist.co/robots.txt
Redirect https://www.thefuturist.co/robots.txt
Redirect Domain www.thefuturist.co
Redirect Base thefuturist.co
Redirect IPs 72.52.178.18
Response IP 72.52.178.18
Found Yes
Hash 06215191b178eaeee45ace1930b071ba2f8966b92304ba0c37a8be284b8f7de9
SimHash 7eb8682002a1

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /technological-unemployment/
Disallow /automation-part-1--retail/
Disallow /the-future-of-mobile-cell-phones/
Disallow /spucpt/popups-example/
Disallow /2015/06/28/hello-world/
Disallow /supersonic-maglev--london-to-new-york-in-an-hour/
Disallow /treepods--lighting-and-cleaning-up-city-streets/
Disallow /dropcap/
Disallow /message-box/
Disallow /video-games-of-the-future?replytocom=173%2F
Disallow /internships--graduate-slavery/
Disallow /91?replytocom=60%2F
Disallow /acoordion/
Disallow /category/technology/automation-technology/
Disallow /the-end-of-money/
Disallow /category/politics/
Disallow /page-style/
Disallow /video-games-of-the-future/
Disallow /renewable-energy--a-new-outlook/
Disallow /category/technology/
Disallow /portfolio-4-columns/
Disallow /technological-unemployment?replytocom=20%2F
Disallow /the-google-car/
Disallow /91?replytocom=9%2F
Disallow /author/admin/page/2/
Disallow /skyscraper-farms--feeding-the-world?replytocom=185%2F
Disallow /the-google-car?replytocom=43%2F
Disallow /skyscraper-farms--feeding-the-world?replytocom=184%2F
Disallow /shweeb--making-city-travel-green-and-fun/
Disallow /technological-unemployment?replytocom=4%2F
Disallow /category/politics/economy/
Disallow /the-future-of-mobile-cell-/
Disallow /wp-/

Other Records

Field Value
sitemap https://www.thefuturist.co/video-sitemap.xml
sitemap https://www.thefuturist.co/sitemap.xml
sitemap https://www.thefuturist.co/sitemap.rss
sitemap https://www.thefuturist.co/sitemap-2.xml
sitemap https://www.thefuturist.co/sitemap-2.html