msn.gamereactor.eu
robots.txt

Robots Exclusion Standard data for msn.gamereactor.eu

Resource Scan

Scan Details

Site Domain msn.gamereactor.eu
Base Domain gamereactor.eu
Scan Status Ok
Last Scan2024-06-19T03:23:22+00:00
Next Scan 2024-07-19T03:23:22+00:00

Last Scan

Scanned2024-06-19T03:23:22+00:00
URL https://msn.gamereactor.eu/robots.txt
Domain IPs 104.21.41.119, 172.67.164.192, 2606:4700:3034::6815:2977, 2606:4700:3036::ac43:a4c0
Response IP 104.21.41.119
Found Yes
Hash e117efb73a83af59dd3b6305418a7929e5b31f6258fd7979f4b817597072502a
SimHash e2091a82ff91

Groups

*

Rule Path
Disallow /admin/
Disallow /569313408/
Disallow /grtv2/admin2/
Disallow /grtv2/insert_grtv_stats.php
Disallow /lay/agreements/
Disallow /*banComment*
Disallow /webshop/
Disallow /vcards.php
Disallow /partnerstuff/screenshots_js.php*
Disallow /academy/
Disallow /betakey/
Disallow /contest/
Disallow /letters/
Disallow /poll/
Disallow /profile/
Disallow /images/
Disallow /join/
Disallow /lets-play/

screaming frog seo spider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

claudebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.gamereactor.eu/media/sitemaps/sitemap_eu_texts_2024_06.xml
sitemap https://www.gamereactor.eu/media/sitemaps/sitemap_eu_texts_2024_05.xml
sitemap https://www.gamereactor.eu/media/sitemaps/sitemap_eu_videos_2024_06.xml
sitemap https://www.gamereactor.eu/googlepingfeed.php