csget.me
robots.txt

Robots Exclusion Standard data for csget.me

Resource Scan

Scan Details

Site Domain csget.me
Base Domain csget.me
Scan Status Ok
Last Scan2025-11-01T01:38:47+00:00
Next Scan 2025-12-01T01:38:47+00:00

Last Scan

Scanned2025-11-01T01:38:47+00:00
URL https://csget.me/robots.txt
Domain IPs 104.21.56.242, 172.67.138.114, 2606:4700:3032::ac43:8a72, 2606:4700:3035::6815:38f2
Response IP 104.21.56.242
Found Yes
Hash 7f2eaab4a0be6396c6c9c7d965d9a85edb9bfa40dd0666f30884d3f657d46a71
SimHash 28099c00cf93

Groups

*

Rule Path
Disallow /*?*
Disallow /download/

Other Records

Field Value
sitemap https://csget.me/sitemap.xml