shopbigc.cafe24api.com
robots.txt

Robots Exclusion Standard data for shopbigc.cafe24api.com

Resource Scan

Scan Details

Site Domain shopbigc.cafe24api.com
Base Domain cafe24api.com
Scan Status Ok
Last Scan2025-09-30T14:10:29+00:00
Next Scan 2025-10-14T14:10:29+00:00

Last Scan

Scanned2025-09-30T14:10:29+00:00
URL https://shopbigc.cafe24api.com/robots.txt
Domain IPs 183.111.232.84, 183.111.241.11
Response IP 183.111.232.84
Found Yes
Hash ed19ea42111420db80668e90ec84279e41c15132c49b25640d492a1f05feac6d
SimHash 6000cc1482e7

Groups

*

Rule Path
Disallow /admin
Disallow /api
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

meta-externalagent

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /