Log In Sign Up

gotauka.com
robots.txt

Robots Exclusion Standard data for gotauka.com

Resource Scan

Scan Details

Site Domain gotauka.com
Base Domain gotauka.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-25T03:21:40+00:00
Next Scan 2025-01-23T03:21:40+00:00

Last Successful Scan

Scanned2024-03-07T02:06:42+00:00
URL https://gotauka.com/robots.txt
Domain IPs 104.21.54.74, 172.67.136.99, 2606:4700:3033::6815:364a, 2606:4700:3036::ac43:8863
Response IP 172.67.136.99
Found Yes
Hash 37591ca7213d775e29d43c32a93ff68454aba8e20870e551ea4a25aeab3481e1
SimHash c9303e6ac8fb

Groups

*

Rule Path
Disallow /wp-admin/

*

Rule Path
Disallow /redirect?*
Disallow /wp-content/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wpi/
Disallow /trackback/
Disallow /*/*/*/feed.xml
Disallow /login.php/
Disallow /frontend.php/
Disallow /api/1.0/migration
Disallow /server
Disallow /queue
Disallow /mobile.php/
Disallow /app.php/
Disallow /main.php/
Disallow /redirect
Disallow /approve
Disallow /duplicate
Disallow /1018282
Disallow /api/
Disallow /c/
Disallow /preview-main/*
Disallow /morepostcomments
Disallow /offtopic
Disallow /pda
Disallow /tracker
Disallow /.well-known/amphtml/apikey.pub
Disallow /usuario/*
Disallow /busqueda?
Disallow /search?q=
Disallow /frontend_dev.php/

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

slurp

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://mobailgamer.com/news-sitemap.xml
sitemap https://mobailgamer.com/sitemap_index.xml
sitemap https://mobailgamer.com/en/sitemap_index.xml
sitemap https://mobailgamer.com/ja/sitemap_index.xml
sitemap https://mobailgamer.com/zh-TW/sitemap_index.xml
sitemap https://mobailgamer.com/zh-CN//sitemap_index.xml
sitemap https://mobailgamer.com/tl/sitemap_index.xml
sitemap https://mobailgamer.com/sq/sitemap_index.xml
sitemap https://mobailgamer.com/ps/sitemap_index.xml
sitemap https://mobailgamer.com/ny/sitemap_index.xml
sitemap https://mobailgamer.com/no/sitemap_index.xml
sitemap https://mobailgamer.com/nl/sitemap_index.xml
sitemap https://mobailgamer.com/ne/sitemap_index.xml
sitemap https://mobailgamer.com/my/sitemap_index.xml
sitemap https://mobailgamer.com/mt/sitemap_index.xml
sitemap https://mobailgamer.com/ms/sitemap_index.xml
sitemap https://mobailgamer.com/mr/sitemap_index.xml
sitemap https://mobailgamer.com/mn/sitemap_index.xml
sitemap https://mobailgamer.com/ml/sitemap_index.xml
sitemap https://mobailgamer.com/mk/sitemap_index.xml
sitemap https://mobailgamer.com/mi/sitemap_index.xml
sitemap https://mobailgamer.com/mg/sitemap_index.xml
sitemap https://mobailgamer.com/lv/sitemap_index.xml
sitemap https://mobailgamer.com/lt/sitemap_index.xml
sitemap https://mobailgamer.com/lo/sitemap_index.xml
sitemap https://mobailgamer.com/lb/sitemap_index.xml
sitemap https://mobailgamer.com/la/sitemap_index.xml
sitemap https://mobailgamer.com/ky/sitemap_index.xml
sitemap https://mobailgamer.com/ku/sitemap_index.xml
sitemap https://mobailgamer.com/ko/sitemap_index.xml
sitemap https://mobailgamer.com/kn/sitemap_index.xml
sitemap https://mobailgamer.com/km/sitemap_index.xml
sitemap https://mobailgamer.com/kk/sitemap_index.xml
sitemap https://mobailgamer.com/ka/sitemap_index.xml
sitemap https://mobailgamer.com/jw/sitemap_index.xml
sitemap https://mobailgamer.com/iw/sitemap_index.xml
sitemap https://mobailgamer.com/it/sitemap_index.xml
sitemap https://mobailgamer.com/is/sitemap_index.xml
sitemap https://mobailgamer.com/ig/sitemap_index.xml
sitemap https://mobailgamer.com/id/sitemap_index.xml
sitemap https://mobailgamer.com/hy/sitemap_index.xml
sitemap https://mobailgamer.com/hu/sitemap_index.xml
sitemap https://mobailgamer.com/ht/sitemap_index.xml
sitemap https://mobailgamer.com/hr/sitemap_index.xml
sitemap https://mobailgamer.com/hmn/sitemap_index.xml
sitemap https://mobailgamer.com/hi/sitemap_index.xml
sitemap https://mobailgamer.com/haw/sitemap_index.xml
sitemap https://mobailgamer.com/ha/sitemap_index.xml
sitemap https://mobailgamer.com/gu/sitemap_index.xml
sitemap https://mobailgamer.com/gl/sitemap_index.xml
sitemap https://mobailgamer.com/ga/sitemap_index.xml
sitemap https://mobailgamer.com/fy/sitemap_index.xml
sitemap https://mobailgamer.com/fr/sitemap_index.xml
sitemap https://mobailgamer.com/fi/sitemap_index.xml
sitemap https://mobailgamer.com/fa/sitemap_index.xml
sitemap https://mobailgamer.com/eu/sitemap_index.xml
sitemap https://mobailgamer.com/et/sitemap_index.xml
sitemap https://mobailgamer.com/eo/sitemap_index.xml
sitemap https://mobailgamer.com/el/sitemap_index.xml
sitemap https://mobailgamer.com/de/sitemap_index.xml
sitemap https://mobailgamer.com/da/sitemap_index.xml
sitemap https://mobailgamer.com/cs/sitemap_index.xml
sitemap https://mobailgamer.com/co/sitemap_index.xml
sitemap https://mobailgamer.com/ceb/sitemap_index.xml
sitemap https://mobailgamer.com/ca/sitemap_index.xml
sitemap https://mobailgamer.com/bs/sitemap_index.xml
sitemap https://mobailgamer.com/bn/sitemap_index.xml
sitemap https://mobailgamer.com/bg/sitemap_index.xml
sitemap https://mobailgamer.com/be/sitemap_index.xml
sitemap https://mobailgamer.com/az/sitemap_index.xml
sitemap https://mobailgamer.com/ar/sitemap_index.xml
sitemap https://mobailgamer.com/am/sitemap_index.xml
sitemap https://mobailgamer.com/af/sitemap_index.xml
sitemap https://mobailgamer.com/ro/sitemap_index.xml
sitemap https://mobailgamer.com/pa/sitemap_index.xml
sitemap https://mobailgamer.com/pt/sitemap_index.xml
sitemap https://mobailgamer.com/pl/sitemap_index.xml
sitemap https://mobailgamer.com/ru/sitemap_index.xml
sitemap https://mobailgamer.com/sm/sitemap_index.xml
sitemap https://mobailgamer.com/gd/sitemap_index.xml
sitemap https://mobailgamer.com/sr/sitemap_index.xml
sitemap https://mobailgamer.com/st/sitemap_index.xml
sitemap https://mobailgamer.com/sn/sitemap_index.xml
sitemap https://mobailgamer.com/sd/sitemap_index.xml
sitemap https://mobailgamer.com/si/sitemap_index.xml
sitemap https://mobailgamer.com/sk/sitemap_index.xml
sitemap https://mobailgamer.com/sl/sitemap_index.xml
sitemap https://mobailgamer.com/so/sitemap_index.xml
sitemap https://mobailgamer.com/su/sitemap_index.xml
sitemap https://mobailgamer.com/sw/sitemap_index.xml
sitemap https://mobailgamer.com/sv/sitemap_index.xml
sitemap https://mobailgamer.com/tg/sitemap_index.xml
sitemap https://mobailgamer.com/ta/sitemap_index.xml
sitemap https://mobailgamer.com/te/sitemap_index.xml
sitemap https://mobailgamer.com/th/sitemap_index.xml
sitemap https://mobailgamer.com/tr/sitemap_index.xml
sitemap https://mobailgamer.com/uk/sitemap_index.xml
sitemap https://mobailgamer.com/ur/sitemap_index.xml
sitemap https://mobailgamer.com/uz/sitemap_index.xml
sitemap https://mobailgamer.com/vi/sitemap_index.xml
sitemap https://mobailgamer.com/cy/sitemap_index.xml
sitemap https://mobailgamer.com/xh/sitemap_index.xml
sitemap https://mobailgamer.com/yi/sitemap_index.xml
sitemap https://mobailgamer.com/yo/sitemap_index.xml
sitemap https://mobailgamer.com/zu/sitemap_index.xml
Back to top

Comments

  • WP
  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites. Please obey robots.txt.
  • Hits many times per second, not acceptable
  • http://www.nameprotect.com/botinfo.html
  • A capture bot, downloads gazillions of pages with no public benefit
  • http://www.webreaper.net/
Back to top