dropzone.com
robots.txt

Robots Exclusion Standard data for dropzone.com

Resource Scan

Scan Details

Site Domain dropzone.com
Base Domain dropzone.com
Scan Status Ok
Last Scan2024-11-08T01:15:26+00:00
Next Scan 2024-11-15T01:15:26+00:00

Last Scan

Scanned2024-11-08T01:15:26+00:00
URL https://dropzone.com/robots.txt
Domain IPs 104.26.2.175, 104.26.3.175, 172.67.68.189, 2606:4700:20::681a:2af, 2606:4700:20::681a:3af, 2606:4700:20::ac43:44bd
Response IP 104.26.2.175
Found Yes
Hash 7c35c4bb26d18d9546a39a4b9fed2e871df8fe48e786ac320984c6da09e2c935
SimHash 3d4049525914

Groups

swiftbot

Rule Path
Disallow /cgi-bin/forum/*
Disallow /cgi-bin/community/*

*

Rule Path
Disallow /admin/
Disallow /album/
Disallow /data/
Disallow /files/
Disallow /graphics/
Disallow /temp/
Disallow /classifieds_stage/
Disallow /*?*username=*
Disallow /*?*guest=*
Disallow /cgi-bin/forum/gforum.cgi?forum=23%3B*
Disallow /basearchive/*

Comments

  • Don't let Swiftbot index the pages under /archives/