sitp.ci
robots.txt

Robots Exclusion Standard data for sitp.ci

Resource Scan

Scan Details

Site Domain sitp.ci
Base Domain sitp.ci
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-05T03:45:08+00:00
Next Scan 2024-10-05T03:45:08+00:00

Last Successful Scan

Scanned2024-07-15T03:44:04+00:00
URL https://sitp.ci/robots.txt
Domain IPs 2a02:4780:38:6d31:dd5d:268c:abd9:9ca, 91.108.100.112
Response IP 91.108.100.217
Found Yes
Hash d12fd9553c2aa84e5d099c7b994252b314d11287700182b7e4125d6961c49e9a
SimHash e57b9862afdb

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://sitp.ci/sitmap.xml

Comments

  • robots.txt generated by smallseotools.com

Warnings

  • 22 invalid lines.
  • `<lastmod>2022-07-26t18` is not a known field.
  • `<loc>https` is not a known field.
  • `http` is not a known field.
  • `xmlns` is not a known field.
  • `xmlns="http` is not a known field.
  • `xsi` is not a known field.