penetro.cafe24api.com
robots.txt

Robots Exclusion Standard data for penetro.cafe24api.com

Resource Scan

Scan Details

Site Domain penetro.cafe24api.com
Base Domain cafe24api.com
Scan Status Ok
Last Scan2025-12-10T22:07:44+00:00
Next Scan 2025-12-24T22:07:44+00:00

Last Scan

Scanned2025-12-10T22:07:44+00:00
URL https://penetro.cafe24api.com/robots.txt
Domain IPs 183.111.139.226, 203.245.12.110, 203.245.12.114, 203.245.12.99
Response IP 203.245.12.114
Found Yes
Hash 037d42b0e68ed18bde06e30d0ad85f32eb19b5c39e6cf747a22b910f043fa9ba
SimHash c000c8220321

Groups

*

Rule Path
Disallow /admin
Disallow /api
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

No rules defined. All paths allowed.

yeti

Rule Path
Allow /

Warnings

  • 2 invalid lines.