gamereactor.de
robots.txt

Robots Exclusion Standard data for gamereactor.de

Resource Scan

Scan Details

Site Domain gamereactor.de
Base Domain gamereactor.de
Scan Status Ok
Last Scan2024-06-14T06:39:16+00:00
Next Scan 2024-06-21T06:39:16+00:00

Last Scan

Scanned2024-06-14T06:39:16+00:00
URL https://gamereactor.de/robots.txt
Redirect https://www.gamereactor.de/robots.txt
Redirect Domain www.gamereactor.de
Redirect Base gamereactor.de
Domain IPs 104.21.26.158, 172.67.137.36, 2606:4700:3031::ac43:8924, 2606:4700:3036::6815:1a9e
Redirect IPs 104.21.26.158, 172.67.137.36, 2606:4700:3031::ac43:8924, 2606:4700:3036::6815:1a9e
Response IP 172.67.137.36
Found Yes
Hash c725e9b1bf7078da7aae5844b672ef618b537844e678b2248245a0820120910f
SimHash e10c1a92de99

Groups

*

Rule Path
Disallow /admin/
Disallow /569313408/
Disallow /grtv2/admin2/
Disallow /grtv2/insert_grtv_stats.php
Disallow /lay/agreements/
Disallow /*banComment*
Disallow /webshop/
Disallow /vcards.php
Disallow /partnerstuff/screenshots_js.php*
Disallow /academy/
Disallow /betakey/
Disallow /gewinnspiel/
Disallow /leserbriefe/
Disallow /umfrage/
Disallow /profil/
Disallow /bilder/
Disallow /registrieren/
Disallow /lets-play/

screaming frog seo spider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

claudebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.gamereactor.de/media/sitemaps/sitemap_de_texts_2024_06.xml
sitemap https://www.gamereactor.de/media/sitemaps/sitemap_de_texts_2024_05.xml
sitemap https://www.gamereactor.de/media/sitemaps/sitemap_de_videos_2024_06.xml
sitemap https://www.gamereactor.de/googlepingfeed.php