fortune.com
robots.txt

Robots Exclusion Standard data for fortune.com

Resource Scan

Scan Details

Site Domain fortune.com
Base Domain fortune.com
Scan Status Ok
Last Scan2024-05-10T20:20:57+00:00
Next Scan 2024-05-17T20:20:57+00:00

Last Scan

Scanned2024-05-10T20:20:57+00:00
URL https://fortune.com/robots.txt
Domain IPs 13.226.120.107, 13.226.120.122, 13.226.120.72, 13.226.120.78
Response IP 18.155.68.9
Found Yes
Hash c206b595b3b2b1d33e27c3ad5a6506c5aedf13ecad8604486b111c6c99d1aff0
SimHash 7b15d941a0b2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search/*
Disallow /sponsored/
Disallow /feeds/
Disallow /feed/
Disallow */feed/
Allow */feed/*/articles.xml
Allow /feed/sitema*
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /press-this.php
Disallow /remote-login.php
Disallow /activate/
Disallow /cgi-bin/
Disallow /mshots/v1/
Disallow /next/
Disallow /public.api/*
Disallow /advanced-search/*

googlebot
linkedinbot

Rule Path
Disallow /search/*
Disallow /sponsored/
Disallow /feeds/
Disallow /feed/
Disallow */feed/
Allow */feed/*/articles.xml
Allow /feed/sitema*
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /press-this.php
Disallow /remote-login.php
Disallow /activate/
Disallow /cgi-bin/
Disallow /mshots/v1/
Disallow /next/
Disallow /public.api/*
Disallow /advanced-search/*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://fortune.com/feed/sitemap/
sitemap https://fortune.com/feed/googlenews/articles.xml
sitemap https://fortune.com/videos/sitemap.xml

Comments

  • Google SiteMaps