fplleaderboards.com
robots.txt

Robots Exclusion Standard data for fplleaderboards.com

Resource Scan

Scan Details

Site Domain fplleaderboards.com
Base Domain fplleaderboards.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-29T14:12:45+00:00
Next Scan 2025-06-27T14:12:45+00:00

Last Successful Scan

Scanned2024-11-30T13:32:25+00:00
URL https://fplleaderboards.com/robots.txt
Domain IPs 104.21.34.196, 172.67.164.54, 2606:4700:3033::6815:22c4, 2606:4700:3033::ac43:a436
Response IP 172.67.164.54
Found Yes
Hash fef484af6261a85d1f9b588210eb6f381353000978711e0f20d22302444f9c15
SimHash fa1ed170af93

Groups

purebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

domaintools

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

dotnetdotcom

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

morfeus

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dinoping

Rule Path
Disallow /

panopta.com

Rule Path
Disallow /

linkchecker.sourceforge.net

Rule Path
Disallow /

linkcheck

Rule Path
Disallow /

searchmetrics

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /

yamanalab-robot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

aboundex

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

yunyun

Rule Path
Disallow /

masscan

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /match-details/
Disallow /match-details/*
Disallow /players/*/match-details/*
Disallow /vacban-checker/*
Disallow /players/*?page=
Disallow /players/*?ref=
Disallow /players/*?ref=mh

Other Records

Field Value
sitemap https://fplleaderboards.com/sitemap.xml

Warnings

  • 4 invalid lines.