gamesbeat.net
robots.txt

Robots Exclusion Standard data for gamesbeat.net

Resource Scan

Scan Details

Site Domain gamesbeat.net
Base Domain gamesbeat.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-15T07:10:09+00:00
Next Scan 2025-01-13T07:10:09+00:00

Last Successful Scan

Scanned2023-09-21T07:20:26+00:00
URL https://www.gamesbeat.net/robots.txt
Domain IPs 192.0.66.2
Response IP 192.0.66.2
Found Yes
Hash 8e3a19de6c3e91f602f94fac08a667889a907a4a0c7493fce9a207484069e1cf
SimHash 6cdf90043477

Groups

*

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts
Disallow /users

googlebot

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

bingbot

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

msnbot

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

bingpreview

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

slurp

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

irlbot

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

motominerbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

df bot 1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; neevabot/1.0; +https://neeva.com/neevabot)

Rule Path
Disallow /

awariosmartbot/1.0 (+https://awario.com/bots.html; bots@awario.com)

Rule Path
Disallow /

mozilla/5.0 (compatible; seekport crawler; http://seekport.com/)

Rule Path
Disallow /

mozilla/5.0 (compatible; sphereup; http://www.sphereup.com/)

Rule Path
Disallow /

proximic

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://venturebeat.com/news-sitemap.xml
sitemap https://venturebeat.com/sitemap.xml

Comments

  • This file was generated on Thu, 21 Sep 2023 07:20:32 +0000
  • Sitemap archive
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK