gamereactor.es
robots.txt

Robots Exclusion Standard data for gamereactor.es

Resource Scan

Scan Details

Site Domain gamereactor.es
Base Domain gamereactor.es
Scan Status Ok
Last Scan2024-11-11T22:01:19+00:00
Next Scan 2024-11-18T22:01:19+00:00

Last Scan

Scanned2024-11-11T22:01:19+00:00
URL https://gamereactor.es/robots.txt
Redirect https://www.gamereactor.es/robots.txt
Redirect Domain www.gamereactor.es
Redirect Base gamereactor.es
Domain IPs 104.21.18.39, 172.67.180.68, 2606:4700:3033::ac43:b444, 2606:4700:3036::6815:1227
Redirect IPs 104.21.18.39, 172.67.180.68, 2606:4700:3033::ac43:b444, 2606:4700:3036::6815:1227
Response IP 104.21.18.39
Found Yes
Hash 0b97865e5c0eaf52b77a3634815bf1842d82fdaabc868b5fc77cc9ccd1034476
SimHash f2065aeade91

Groups

*

Rule Path
Disallow /admin/
Disallow /569313408/
Disallow /grtv/embed/
Disallow /video/embed/
Disallow /grtv2/admin2/
Disallow /grtv2/insert_grtv_stats.php
Disallow /lay/agreements/
Disallow /*banComment*
Disallow /webshop/
Disallow /vcards.php
Disallow /partnerstuff/screenshots_js.php*
Disallow /academy/
Disallow /betakey/
Disallow /concursos/
Disallow /cartas/
Disallow /encuesta/
Disallow /perfil/
Disallow /imagenes/
Disallow /migaleria/
Disallow /registrate/
Disallow /buscar-partida-online/
Disallow /images/
Disallow /bye.php*
Disallow /media/vtt/
Disallow /ajaxstuff/fblogin.php

screaming frog seo spider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

claudebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.gamereactor.es/media/sitemaps/sitemap_es_texts_2024_11.xml
sitemap https://www.gamereactor.es/media/sitemaps/sitemap_es_texts_2024_10.xml
sitemap https://www.gamereactor.es/media/sitemaps/sitemap_es_videos_2024_11.xml
sitemap https://www.gamereactor.es/media/sitemaps/sitemap_es_shorts_2024_11.xml
sitemap https://www.gamereactor.es/googlepingfeed.php