api.cafearz.com
robots.txt

Robots Exclusion Standard data for api.cafearz.com

Resource Scan

Scan Details

Site Domain api.cafearz.com
Base Domain cafearz.com
Scan Status Ok
Last Scan2025-12-14T01:06:21+00:00
Next Scan 2026-01-13T01:06:21+00:00

Last Scan

Scanned2025-12-14T01:06:21+00:00
URL https://api.cafearz.com/robots.txt
Domain IPs 104.26.6.119, 104.26.7.119, 172.67.68.237, 2606:4700:20::681a:677, 2606:4700:20::681a:777, 2606:4700:20::ac43:44ed
Response IP 104.26.6.119
Found Yes
Hash 003bd1b3a4ef5e8afe5239db020604db48e2b559027cabfd21820687ff70ca4f
SimHash 20141540c6d1

Groups

*

Rule Path
Disallow /blog/wp-admin/
Allow /blog/wp-admin/admin-ajax.php
Disallow /feed/
Disallow /page/
Disallow /panel/
Disallow /admin/
Disallow /upload/
Disallow /storage/
Disallow /vendor/
Disallow /rating/
Disallow /cgi-bin/
Disallow /coin/calculateform/
Disallow /panel/*
Disallow /admin/*
Disallow /upload/*
Disallow /storage/*
Disallow /vendor/*
Disallow /cgi-bin/*
Disallow /rating/*
Disallow /coin/calculateform/*
Disallow /landing/currency/data

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cafearz.com/sitemap.xml
sitemap https://cafearz.com/blog/post-sitemap.xml
sitemap https://cafearz.com/pages-sitemap.xml
sitemap https://cafearz.com/crypto-sitemap.xml