gamesbeat.com
robots.txt

Robots Exclusion Standard data for gamesbeat.com

Resource Scan

Scan Details

Site Domain gamesbeat.com
Base Domain gamesbeat.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-11T19:17:48+00:00
Next Scan 2025-01-09T19:17:48+00:00

Last Successful Scan

Scanned2023-09-18T13:51:18+00:00
URL https://www.gamesbeat.com/robots.txt
Domain IPs 192.0.66.2
Response IP 192.0.66.2
Found Yes
Hash dbdf58fdbe4bb6811e3c35a671145fa7ea46d43102d2b25d4a1b003cb5e10858
SimHash 66d79084b437

Groups

*

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts
Disallow /users

googlebot

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

bingbot

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

msnbot

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

bingpreview

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

slurp

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

irlbot

Rule Path
Disallow /login
Disallow /logout
Disallow /sign-up
Disallow /account
Disallow /wp-admin
Disallow /wp-login.php
Disallow /activate
Disallow /search
Disallow /?s=*
Disallow /page/*/?s=*
Disallow /page/*/?s
Disallow /person
Disallow /company
Disallow /posts

motominerbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

df bot 1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; neevabot/1.0; +https://neeva.com/neevabot)

Rule Path
Disallow /

awariosmartbot/1.0 (+https://awario.com/bots.html; bots@awario.com)

Rule Path
Disallow /

mozilla/5.0 (compatible; seekport crawler; http://seekport.com/)

Rule Path
Disallow /

mozilla/5.0 (compatible; sphereup; http://www.sphereup.com/)

Rule Path
Disallow /

proximic

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://venturebeat.com/news-sitemap.xml
sitemap https://venturebeat.com/sitemap.xml

Comments

  • This file was generated on Mon, 18 Sep 2023 08:17:59 +0000
  • Sitemap archive
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK