themes.stylelib.org
robots.txt
Robots Exclusion Standard data for themes.stylelib.org
Resource Scan
Scan Details
Site Domain | themes.stylelib.org |
Base Domain | stylelib.org |
Scan Status | Ok |
Last Scan | 2024-06-26T20:57:11+00:00 |
Next Scan | 2024-07-26T20:57:11+00:00 |
Last Scan
Scanned | 2024-06-26T20:57:11+00:00 |
URL | https://themes.stylelib.org/robots.txt |
Domain IPs | 5.187.2.41 |
Response IP | 5.187.2.41 |
Found | Yes |
Hash | 7e208b718b76c91744edbe5d3add802933a6ac1494796d1914c65516461b71ed |
SimHash | 891c4752ac38 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/themes/u-design/* |
Allow | /wp-includes/js/jquery/* |
Allow | /wp-content/cache/autoptimize/* |
Allow | /wp-content/fontello-icon-fonts/* |
Allow | *.css* |
Allow | *.js* |
Allow | /away/?id=* |
Disallow | /wp-admin |
Disallow | */trackback |
Disallow | */page/ |
Disallow | /html/ |
Disallow | /*.html |
Disallow | /php/ |
Disallow | /*?* |
Disallow | /uncategorized/ |
pinterestbot
geedoproductsearch
makemerrybot
ccbot
google-extented
gptbot
bytedance
bytespider
awariobot
amazonbot
baiduspider
ahrefsbot
python-requests
haosouspider
advbot
archive.org_bot
blexbot
bpimagewalker
cliqzbot
dotbot
ia_archiver
grapeshot
linkedinbot
linkwalker
lipperhey
meanpathbot
mj12bot
netseer
privacyawarebot
safednsbot
semrushbot
semrushbot-sa
sistrix
siteexplorer
smtbot
spbot
facebot
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://themes.stylelib.org/wp-sitemap.xml |
Warnings
- 1 invalid line.
Comments