gamereactor.it
robots.txt

Robots Exclusion Standard data for gamereactor.it

Resource Scan

Scan Details

Site Domain gamereactor.it
Base Domain gamereactor.it
Scan Status Ok
Last Scan2024-06-24T03:45:44+00:00
Next Scan 2024-07-01T03:45:44+00:00

Last Scan

Scanned2024-06-24T03:45:44+00:00
URL https://gamereactor.it/robots.txt
Redirect https://www.gamereactor.it/robots.txt
Redirect Domain www.gamereactor.it
Redirect Base gamereactor.it
Domain IPs 104.21.79.92, 172.67.143.13, 2606:4700:3037::6815:4f5c, 2606:4700:3037::ac43:8f0d
Redirect IPs 104.21.79.92, 172.67.143.13, 2606:4700:3037::6815:4f5c, 2606:4700:3037::ac43:8f0d
Response IP 104.21.79.92
Found Yes
Hash 38516276feab1d3fb3166fdbe8964fad703a2bffe25a49d742cce32ae1f1d911
SimHash ea0c9fd2de11

Groups

*

Rule Path
Disallow /admin/
Disallow /569313408/
Disallow /grtv2/admin2/
Disallow /grtv2/insert_grtv_stats.php
Disallow /lay/agreements/
Disallow /*banComment*
Disallow /webshop/
Disallow /vcards.php
Disallow /partnerstuff/screenshots_js.php*
Disallow /academy/
Disallow /betakey/
Disallow /contest/
Disallow /posta/
Disallow /sondaggi/
Disallow /profilo/
Disallow /immagini/
Disallow /iscriviti/
Disallow /giochiamo/

screaming frog seo spider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

claudebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.gamereactor.it/media/sitemaps/sitemap_it_texts_2024_06.xml
sitemap https://www.gamereactor.it/media/sitemaps/sitemap_it_texts_2024_05.xml
sitemap https://www.gamereactor.it/media/sitemaps/sitemap_it_videos_2024_06.xml
sitemap https://www.gamereactor.it/googlepingfeed.php