clipdown.app
robots.txt

Robots Exclusion Standard data for clipdown.app

Resource Scan

Scan Details

Site Domain clipdown.app
Base Domain clipdown.app
Scan Status Ok
Last Scan2024-09-19T04:20:56+00:00
Next Scan 2024-09-26T04:20:56+00:00

Last Scan

Scanned2024-09-19T04:20:56+00:00
URL https://clipdown.app/robots.txt
Domain IPs 104.26.10.169, 104.26.11.169, 172.67.74.206, 2606:4700:20::681a:aa9, 2606:4700:20::681a:ba9, 2606:4700:20::ac43:4ace
Response IP 104.26.11.169
Found Yes
Hash 21699cdb7cadd2cac1db6c5e2d7c4dc18dc8f5b7c7d9ac832b277ddd519f0045
SimHash 69305818ed12

Groups

*

Rule Path
Disallow */1000*
Disallow /api/

Other Records

Field Value
sitemap https://clipdown.app/sitemap.xml