fxbike.vn
robots.txt
Robots Exclusion Standard data for fxbike.vn
Resource Scan
Scan Details
Site Domain | fxbike.vn |
Base Domain | fxbike.vn |
Scan Status | Ok |
Last Scan | 5/2/2025, 2:11:50 PM |
Next Scan | 6/1/2025, 2:11:50 PM |
Last Scan
Scanned | 5/2/2025, 2:11:50 PM |
URL | https://fxbike.vn/robots.txt |
Domain IPs | 104.21.55.146, 172.67.149.36, 2606:4700:3033::6815:3792, 2606:4700:3034::ac43:9524 |
Response IP | 172.67.149.36 |
Found | Yes |
Hash | 09b02a4b07ab59e511458fb918f16f0cc507e83b662424000d1f706070ac869d |
SimHash | efc7dc62fca1 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-json/ |
Disallow | /wp-includes/ |
Disallow | /search/* |
Disallow | /*?s=* |
Disallow | /?s=* |
Disallow | /cdn-cgi/ |
Disallow | /wp-content/uploads/wc-logs/ |
Disallow | /wp-content/uploads/woocommerce_transient_files/ |
Disallow | /wp-content/uploads/woocommerce_uploads/ |
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
nutch
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://fxbike.vn/sitemap_index.xml |