gematos.id
robots.txt

Robots Exclusion Standard data for gematos.id

Resource Scan

Scan Details

Site Domain gematos.id
Base Domain gematos.id
Scan Status Ok
Last Scan5/22/2025, 10:05:33 PM
Next Scan 5/29/2025, 10:05:33 PM

Last Scan

Scanned5/22/2025, 10:05:33 PM
URL https://gematos.id/robots.txt
Domain IPs 104.21.40.30, 172.67.174.223, 2606:4700:3030::ac43:aedf, 2606:4700:3036::6815:281e
Response IP 172.67.174.223
Found Yes
Hash 619e4f5b9d94222b6f80147383c23e7ced515f25d275e8c4bf5e8b69b2d60130
SimHash 6f0adc81e6c3

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Comments

  • hestiacp autogenerated robots.txt