worldfishingclub.com
robots.txt

Robots Exclusion Standard data for worldfishingclub.com

Resource Scan

Scan Details

Site Domain worldfishingclub.com
Base Domain worldfishingclub.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-23T19:32:54+00:00
Next Scan 2024-11-22T19:32:54+00:00

Last Successful Scan

Scanned2024-07-03T19:31:40+00:00
URL https://worldfishingclub.com/robots.txt
Domain IPs 176.58.96.134
Response IP 176.58.96.134
Found Yes
Hash 3865edddd18d335e46eee8ffd83511633163483e4781a5bdc6383c4f93a07c7d
SimHash 601d19d25e94

Groups

mediapartners-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

yandexmarket

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

yadirectfetcher

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dispatch

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

industryindexbot

Rule Path
Disallow /

grammarly

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /*wp-login
Disallow /*wp-register
Disallow /wp-admin/
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow /cart/
Disallow /korb/
Disallow /panier/
Disallow /cesta/
Disallow /cestino/
Disallow /carrinho/
Disallow /korzina/
Disallow /checkout/
Disallow /kasse/
Disallow /caisse/
Disallow /revisa/
Disallow /cassa/
Disallow /confira/
Disallow /oformit-zakaz/
Disallow /my-account/
Disallow /mein-konto/
Disallow /mon-compte/
Disallow /mi-cuenta/
Disallow /mio-account/
Disallow /minha-conta/
Disallow /moy-akkaunt/
Disallow /*add-to-cart%3D*
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.webp
Allow /wp-*.svg
Allow /wp-*.pdf
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Disallow /cgi-bin
Disallow /*wp-login
Disallow /*wp-register
Disallow /wp-admin/
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Disallow /cart/
Disallow /korb/
Disallow /panier/
Disallow /cesta/
Disallow /cestino/
Disallow /carrinho/
Disallow /korzina/
Disallow /checkout/
Disallow /kasse/
Disallow /caisse/
Disallow /revisa/
Disallow /cassa/
Disallow /confira/
Disallow /oformit-zakaz/
Disallow /my-account/
Disallow /mein-konto/
Disallow /mon-compte/
Disallow /mi-cuenta/
Disallow /mio-account/
Disallow /minha-conta/
Disallow /moy-akkaunt/
Disallow /*add-to-cart%3D*
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.webp
Allow /wp-*.svg
Allow /wp-*.pdf
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://worldfishingclub.com/sitemap_index.xml