cloudserver.science
robots.txt

Robots Exclusion Standard data for cloudserver.science

Resource Scan

Scan Details

Site Domain cloudserver.science
Base Domain cloudserver.science
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-01T13:11:12+00:00
Next Scan 2025-11-30T13:11:12+00:00

Last Successful Scan

Scanned2023-01-19T02:42:44+00:00
URL https://cloudserver.science/robots.txt
Domain IPs 104.21.35.78, 172.67.215.225
Response IP 104.21.35.78
Found Yes
Hash 6c69c2b6ae077eff79871c749680df2639f2c5e752bf9fbd5aac0f3a7f9ba6d8
SimHash 7c1cc852f611

Groups

seznambot
mj12bot
yandex
ahrefsbot
blexbot
spbot
cliqzbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 14

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://cloudserver.science/sitemap.xml

Warnings

  • `request-rate` is not a known field.