Log In Sign Up

runwaymagazines.com
robots.txt

Robots Exclusion Standard data for runwaymagazines.com

Resource Scan

Scan Details

Site Domain runwaymagazines.com
Base Domain runwaymagazines.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-19T03:53:29+00:00
Next Scan 2025-01-17T03:53:29+00:00

Last Successful Scan

Scanned2024-03-17T02:44:26+00:00
URL https://runwaymagazines.com/robots.txt
Domain IPs 104.26.2.225, 104.26.3.225, 172.67.72.43, 2606:4700:20::681a:2e1, 2606:4700:20::681a:3e1, 2606:4700:20::ac43:482b
Response IP 172.67.72.43
Found Yes
Hash c46166d7935eba88ee6be73bfde3217708aa8d739720c4c9c3185c540164a6ab
SimHash 3e459d10fc69

Groups

*

Rule Path
Allow /search
Allow /

googlebot-news

Rule Path
Allow /

*

Rule Path
Allow /ads/preferences/
Allow /dtt/k
Allow /gpt/
Allow /pagead/show_ads.js
Allow /pagead/js/adsbygoogle.js
Allow /pagead/*/show_ads_impl.js
Allow /static/glade.js
Allow /static/glade/
Allow /tag/js/

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

oncrawl

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://runwaymagazines.com/sitemap_index.xml
sitemap https://fr.runwaymagazines.com/sitemap_index.xml
sitemap https://zh-cn.runwaymagazines.com/sitemap_index.xml
sitemap https://ru.runwaymagazines.com/sitemap_index.xml
sitemap https://it.runwaymagazines.com/sitemap_index.xml
sitemap https://es.runwaymagazines.com/sitemap_index.xml
sitemap https://de.runwaymagazines.com/sitemap_index.xml
sitemap https://pt.runwaymagazines.com/sitemap_index.xml
sitemap https://runwaymagazines.com/sitemap-images.xml
sitemap https://runwaymagazines.com/web-story-sitemap.xml
sitemap https://runwaymagazines.com/author-sitemap.xml
sitemap https://runwaymagazines.com/podcast-sitemap.xml
sitemap https://runwaymagazines.com/yada_wiki-sitemap.xml
sitemap https://runwaymagazines.com/wiki_cats-sitemap.xml
sitemap https://runwaymagazines.com/wiki_tags-sitemap.xml
sitemap https://runwaymagazines.com/series-sitemap.xml
sitemap https://runwaymagazines.com/news-sitemap.xml
sitemap https://fr.runwaymagazines.com/news-sitemap.xml
sitemap https://zh-cn.runwaymagazines.com/news-sitemap.xml
sitemap https://ru.runwaymagazines.com/news-sitemap.xml
sitemap https://it.runwaymagazines.com/news-sitemap.xml
sitemap https://es.runwaymagazines.com/news-sitemap.xml
sitemap https://de.runwaymagazines.com/news-sitemap.xml
sitemap https://pt.runwaymagazines.com/news-sitemap.xml
sitemap https://runwaymagazines.com/web-story-sitemap.xml
sitemap https://runwaymagazines.com/podcast-sitemap.xml
sitemap https://runwaymagazines.com/yada_wiki-sitemap.xml
sitemap https://runwaymagazines.com/wiki_cats-sitemap.xml
sitemap https://runwaymagazines.com/wiki_tags-sitemap.xml
sitemap https://runwaymagazines.com/series-sitemap.xml
Back to top