psasquashtour.com
robots.txt

Robots Exclusion Standard data for psasquashtour.com

Resource Scan

Scan Details

Site Domain psasquashtour.com
Base Domain psasquashtour.com
Scan Status Ok
Last Scan2024-09-20T07:49:03+00:00
Next Scan 2024-09-27T07:49:03+00:00

Last Scan

Scanned2024-09-20T07:49:03+00:00
URL https://psasquashtour.com/robots.txt
Redirect https://www.psasquashtour.com/robots.txt
Redirect Domain www.psasquashtour.com
Redirect Base psasquashtour.com
Domain IPs 13.33.88.12, 13.33.88.128, 13.33.88.20, 13.33.88.41
Redirect IPs 13.33.88.12, 13.33.88.128, 13.33.88.20, 13.33.88.41
Response IP 13.33.88.128
Found Yes
Hash 98b0868ab5554f521f3098b5e5baaefef459c0bba4db98069386ce4b8e0aad32
SimHash 4a40414a3b38

Groups

adidxbot
ahrefsbot
aihitbot
alphaseobot
alphaseobot-sa
baiduspider
bingpreview
blexbot
careerbot
cliqzbot
dotbot
grapeshot
ichiro
icjobs
linkdexbot
magpie-crawler
megaindex
mj12bot
moget
naverbot
owlin
owlin bot
owlin bot v. 3.0
proximic
queryseekerspider
scrapy
scrapybot
semrush
semrushbot
sentibot
seokicks-robot
sogou
sogou spider
tkbot
trendkite-akashic-crawler
vagabondo
wbsearchbot
yandex
yandexbot
yeti
youdaobot

Rule Path
Disallow /

*

Rule Path
Allow /wp-includes/js/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /profile
Disallow /cgi-bin/
Disallow /wp-content/cache/
Disallow /trackback/
Disallow /comments/
Disallow /administrator/
Disallow */trackback/
Disallow */comments/
Disallow /license.txt
Disallow /*.php$
Disallow *?filter
Disallow /wp-content/themes/ionMag
Disallow /readme.html

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.psaworldtour.com/sitemap_index.xml

Comments

  • Horrible bandwidth eating robots