laxarxa.com
robots.txt
Robots Exclusion Standard data for laxarxa.com
Resource Scan
Scan Details
Site Domain | laxarxa.com |
Base Domain | laxarxa.com |
Scan Status | Ok |
Last Scan | 2024-10-03T05:46:06+00:00 |
Next Scan | 2024-11-02T05:46:06+00:00 |
Last Scan
Scanned | 2024-10-03T05:46:06+00:00 |
URL | https://laxarxa.com/robots.txt |
Redirect | https://www.laxarxa.cat/robots.txt |
Redirect Domain | www.laxarxa.cat |
Redirect Base | laxarxa.cat |
Domain IPs | 185.23.118.242 |
Redirect IPs | 185.23.118.242 |
Response IP | 185.23.118.242 |
Found | Yes |
Hash | e8e8f0d2725e90b620cc6feccebf02604fd5a420e72511bff325003384b4dcba |
SimHash | 4286dd62445b |
Groups
slurp
Rule | Path |
---|---|
Disallow | /*.jpg |
Disallow | /*.JPG |
Disallow | /*.png |
Disallow | |
Disallow | |
Disallow | /*.mp3 |
Disallow | /*.MOV |
Disallow | /*.mov |
Disallow | /*.AVI |
Disallow | /*.avi |
Disallow | /disclaimer.html |
Disallow | /security.html |
Disallow | /poweredby.html |
Disallow | /about_smythies.html |
Disallow | /unused_link.html |
Disallow | /old_pages.html |
Disallow | /index_0* |
Disallow | /*index_0*$ |
Disallow | /digital_camera/ |
Disallow | /lab/ |
Disallow | /xmas_* |
Disallow | /~doug/archives/ |
Disallow | /~doug/linux/ubuntu-docs/help.ubuntu.com/ |
Disallow | /bot_trap.html |
googlebot
Rule | Path |
---|---|
Disallow | /*.jpg$ |
Disallow | /*.JPG$ |
Disallow | /*.png$ |
Disallow | /*.PDF$ |
Disallow | /*.pdf$ |
Disallow | /*.mp3$ |
Disallow | /*.MOV$ |
Disallow | /*.mov$ |
Disallow | /*.AVI$ |
Disallow | /*.avi$ |
Disallow | /index_0*$ |
Disallow | /*index_0*$ |
Disallow | /xmas_* |
Disallow | /~doug/archives/ |
Disallow | /~doug/linux/ubuntu-docs/help.ubuntu.com/ |
Disallow | /~doug/2010.01.23/ |
Disallow | /~doug/2007.11.20/ |
Disallow | /~doug/2004.06.26/ |
Disallow | /digital_camera/ |
Disallow | /old_pages.html |
Disallow | /unused_link.html |
Disallow | /disclaimer.html |
Disallow | /security.html |
Disallow | /about_smythies.html |
Disallow | /poweredby.html |
Disallow | /DSCN*.htm |
Disallow | /bot_trap.html |
msnbot
Rule | Path |
---|---|
Disallow | /*.jpg$ |
Disallow | /*.JPG$ |
Disallow | /*.png$ |
Disallow | /*.PDF$ |
Disallow | /*.pdf$ |
Disallow | /*.mp3$ |
Disallow | /*.MOV$ |
Disallow | /*.mov$ |
Disallow | /*.AVI$ |
Disallow | /*.avi$ |
Disallow | /disclaimer.html |
Disallow | /security.html |
Disallow | /poweredby.html |
Disallow | /about_smythies.html |
Disallow | /unused_link.html |
Disallow | /old_pages.html |
Disallow | /index_0* |
Disallow | /*index_0*$ |
Disallow | /digital_camera/ |
Disallow | /lab/ |
Disallow | /xmas_* |
Disallow | /~doug/archives/ |
Disallow | /~doug/linux/ubuntu-docs/help.ubuntu.com/ |
Disallow | /bot_trap.html |
qwantify
Rule | Path |
---|---|
Disallow | /*.jpg |
Disallow | /*.JPG |
Disallow | /*.png |
Disallow | |
Disallow | |
Disallow | /*.mp3 |
Disallow | /*.MOV |
Disallow | /*.mov |
Disallow | /*.AVI |
Disallow | /*.avi |
Disallow | /disclaimer.html |
Disallow | /security.html |
Disallow | /poweredby.html |
Disallow | /about_smythies.html |
Disallow | /unused_link.html |
Disallow | /old_pages.html |
Disallow | /index_0* |
Disallow | /*index_0*$ |
Disallow | /digital_camera/ |
Disallow | /lab/ |
Disallow | /xmas_* |
Disallow | /~doug/archives/ |
Disallow | /~doug/linux/ubuntu-docs/help.ubuntu.com/ |
Disallow | /bot_trap.html |
Other Records
Field | Value |
---|---|
crawl-delay | 3600 |
*
Rule | Path |
---|---|
Disallow | /*.jpg |
Disallow | /*.JPG |
Disallow | /*.png |
Disallow | |
Disallow | |
Disallow | /*.mp3 |
Disallow | /*.MOV |
Disallow | /*.mov |
Disallow | /*.AVI |
Disallow | /*.avi |
Disallow | /disclaimer.html |
Disallow | /security.html |
Disallow | /poweredby.html |
Disallow | /about_smythies.html |
Disallow | /unused_link.html |
Disallow | /old_pages.html |
Disallow | /index_0* |
Disallow | /*index_0*$ |
Disallow | /digital_camera/ |
Disallow | /lab/ |
Disallow | /xmas_* |
Disallow | /~doug/archives/ |
Disallow | /~doug/linux/ubuntu-docs/help.ubuntu.com/ |
Disallow | /bot_trap.html |
Disallow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 1800 |
Comments