Log In Sign Up

fulljuegos.page
robots.txt

Robots Exclusion Standard data for fulljuegos.page

Resource Scan

Scan Details

Site Domain fulljuegos.page
Base Domain fulljuegos.page
Scan Status Ok
Last Scan2024-11-18T17:52:31+00:00
Next Scan 2024-11-25T17:52:31+00:00

Last Scan

Scanned2024-11-18T17:52:31+00:00
URL https://fulljuegos.page/robots.txt
Domain IPs 2001:8d8:100f:f000::200, 217.160.0.173
Response IP 217.160.0.173
Found Yes
Hash 390cb28a90f878838afe86d4298135b1eea702a8464560f911b39a0389b68221
SimHash aa9059f5cde8

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 20

slurp

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 20

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

googlebot

Rule Path
Allow /*.css$
Allow /*.js$

yahoo slurp

Rule Path
Disallow /

survey

Rule Path
Disallow /

crawl

Rule Path
Disallow /

applebot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yahoo slurp china

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

my nutch spider

Rule Path
Disallow /

a php script

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

empty user agent string

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

unknown robot identified by hit on robots.txt

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

nutch catchall

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

linkchecker

Rule Path
Disallow /

lightspeed

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

w3c_validator

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

validator.nu

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

wget

Rule Path
Disallow /

microsoft office protocol discovery

Rule Path
Disallow /

jigsaw

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

daum

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

duckduckbot-https

Rule Path
Disallow /

unknown robot identified by *bot

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

bit.ly

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

spider

Rule Path
Disallow /

firephp

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

konqueror

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

seek

Rule Path
Disallow /

apache-httpclient

Rule Path
Disallow /

baidu catchall

Rule Path
Disallow /

cubot

Rule Path
Disallow /

nautic expo using firefox1.5

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

ruby script

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

who.is.bot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

elinks

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

adidxbot microsoft ad quality control

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

discover

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

bl.uk_lddc_bot

Rule Path
Disallow /

urllib

Rule Path
Disallow /

velen

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yak-linkfluence

Rule Path
Disallow /

hit

Rule Path
Disallow /

bot*

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

elinks

Rule Path
Disallow /

proximic

Rule Path
Disallow /

serendeputy

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

fetcher

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

links

Rule Path
Disallow /

msie8 - rogue robot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

scanner

Rule Path
Disallow /

ng1

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

blog

Rule Path
Disallow /

xml sitemaps generator

Rule Path
Disallow /

yandex catchall

Rule Path
Disallow /

curl

Rule Path
Disallow /

obot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

link

Rule Path
Disallow /

java catchall

Rule Path
Disallow /

feed

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

perl

Rule Path
Disallow /

checker

Rule Path
Disallow /

validator

Rule Path
Disallow /

robot

Rule Path
Disallow /

google web preview

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://fulljuegos.page/sitemap.xml
sitemap https://fulljuegos.page/sitemap.rss
Back to top

Warnings

  • 6 invalid lines.
Back to top