gamereactor.se
robots.txt

Robots Exclusion Standard data for gamereactor.se

Resource Scan

Scan Details

Site Domain gamereactor.se
Base Domain gamereactor.se
Scan Status Ok
Last Scan2024-09-23T10:45:55+00:00
Next Scan 2024-09-30T10:45:55+00:00

Last Scan

Scanned2024-09-23T10:45:55+00:00
URL https://gamereactor.se/robots.txt
Redirect https://www.gamereactor.se/robots.txt
Redirect Domain www.gamereactor.se
Redirect Base gamereactor.se
Domain IPs 104.21.19.84, 172.67.185.173, 2606:4700:3036::6815:1354, 2606:4700:3037::ac43:b9ad
Redirect IPs 104.21.19.84, 172.67.185.173, 2606:4700:3036::6815:1354, 2606:4700:3037::ac43:b9ad
Response IP 172.67.185.173
Found Yes
Hash 1a34c594d0f74f10035fd2567983c335dd31a21ca87c64f861a8e3a323ed8fc4
SimHash e24c3882c699

Groups

*

Rule Path
Disallow /admin/
Disallow /569313408/
Disallow /grtv/embed/
Disallow /video/embed/
Disallow /grtv2/admin2/
Disallow /grtv2/insert_grtv_stats.php
Disallow /lay/agreements/
Disallow /*banComment*
Disallow /webshop/
Disallow /vcards.php
Disallow /partnerstuff/screenshots_js.php*
Disallow /academy/
Disallow /betakey/
Disallow /tavling/
Disallow /brev/
Disallow /omrostning/
Disallow /krypin/
Disallow /bild/
Disallow /minabilder/
Disallow /blimedlem/
Disallow /nu-ska-vi-spela/
Disallow /images/
Disallow /bye.php*
Disallow /media/vtt/
Disallow /ajaxstuff/fblogin.php

screaming frog seo spider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

claudebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.gamereactor.se/media/sitemaps/sitemap_se_texts_2024_09.xml
sitemap https://www.gamereactor.se/media/sitemaps/sitemap_se_texts_2024_08.xml
sitemap https://www.gamereactor.se/media/sitemaps/sitemap_se_videos_2024_09.xml
sitemap https://www.gamereactor.se/media/sitemaps/sitemap_se_shorts_2024_09.xml
sitemap https://www.gamereactor.se/googlepingfeed.php