rasterweb.net
robots.txt

Robots Exclusion Standard data for rasterweb.net

Resource Scan

Scan Details

Site Domain rasterweb.net
Base Domain rasterweb.net
Scan Status Ok
Last Scan2025-10-11T09:58:53+00:00
Next Scan 2025-10-18T09:58:53+00:00

Last Scan

Scanned2025-10-11T09:58:53+00:00
URL https://rasterweb.net/robots.txt
Domain IPs 69.55.228.16
Response IP 69.55.228.16
Found Yes
Hash 61c20d4ab5e9efc9c985d661794d4bd6b99267d9a5157fdbeb58d7e518373c0c
SimHash 52095860d170

Groups

*

Rule Path
Disallow /cgi
Disallow /raster/cgi
Disallow /raster/admin
Disallow /raster/reports
Disallow /raster/rsshh
Disallow /raster/albums/
Disallow /raster/planet

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • robots.txt