catve.tv
robots.txt

Robots Exclusion Standard data for catve.tv

Resource Scan

Scan Details

Site Domain catve.tv
Base Domain catve.tv
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-03-25T18:39:59+00:00
Next Scan 2024-06-23T18:39:59+00:00

Last Successful Scan

Scanned2023-11-27T18:36:51+00:00
URL http://catve.tv/robots.txt
Domain IPs 208.70.188.21
Response IP 208.70.188.21
Found Yes
Hash 8dc8bc0bfc8c72f9eab87c58f34221cdf769d017c9fc4f2b411a77e51922fb14
SimHash a810195587f1

Groups

*

Rule Path
Allow /
Disallow /php/

grapeshot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://catve.com/sitemap.xml

Comments

  • Disallow: /js/
  • Disallow: /*.js$
  • Disallow: /*.css$