recentic.com
robots.txt
Robots Exclusion Standard data for recentic.com
Resource Scan
Scan Details
| Site Domain | recentic.com |
| Base Domain | recentic.com |
| Scan Status | Ok |
| Last Scan | 2025-04-21T17:50:58+00:00 |
| Next Scan | 2025-04-22T17:50:58+00:00 |
Last Scan
| Scanned | 2025-04-21T17:50:58+00:00 |
| URL | https://recentic.com/robots.txt |
| Domain IPs | 104.21.14.171, 172.67.160.22, 2606:4700:3033::ac43:a016, 2606:4700:3034::6815:eab |
| Response IP | 104.21.14.171 |
| Found | Yes |
| Hash | 7038aabdbb8b2f619b6304617fe69898ea81aa88991d43bb20421103e84e3e51 |
| SimHash | 731cc3cbc1a0 |
Groups
baiduspider
baiduspider-video
baiduspider-image
mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/3.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/4.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/5.0; +http://www.baidu.com/search/spider.html)
baiduspider/2.0
baiduspider/3.0
baiduspider/4.0
baiduspider/5.0
| Rule | Path |
|---|---|
| Disallow | / |
anthropic-ai
claude-web
applebot-extended
bytespider
chatgpt-user
gptbot
cohere-ai
diffbot
facebookbot
googleother
google-extended
imagesiftbot
perplexitybot
omigilibot
omigili
omgili
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://recentic.com/sitemap.xml |
Comments