ole.tange.dk

kenneth.geisshirt.dk

Kneth's Korner: Map/Reduce and GNU Parallel

http://kenneth.geisshirt.dk/2012/10/mapreduce-and-gnu-parallel.html

Chemist by education - geek by nature. Map/Reduce and GNU Parallel. Map/Reduce and GNU Parallel. This week I attended a meeting organized by DKUUG. The topic was GNU Parallel. And the speaker was Ole Tange. The developer behind GNU Parallel. To be honest, I have not used GNU Parallel before. Of course, I have heard about it as Ole always talks about the program when I meet him. His introduction to the program was great - enjoy it when DKUUG releases the video. Lately, I have been studying Apache Hadoop.

vibeke.schou.dk

Links

http://vibeke.schou.dk/links

Links to some of my friends and other good people :).

cateee.blogspot.com

Cateee: shell: parallel execution with timeouts

http://cateee.blogspot.com/2006/10/shell-parallel-execution-with-timeouts.html

Saturday, October 28, 2006. Shell: parallel execution with timeouts. From time in time I was looking how to run a command with a timeout (in a shell script). I never put big efford to find the solution, because I always found a easyer (and probably better) workaround. But few days ago, in a discussion in the austing group (POSIX standardization), I found the solution, in an elegant manner, and it permit also to run commands in parallel. In bash and kornshell):. Sleep 60; kill $pid ) &. I found the answer...

unix.worldiswelcome.com

What is The Difference Between exec and xargs | World is Welcome To The World of Unix!!!

http://unix.worldiswelcome.com/what-is-the-difference-between-exec-and-xargs

World is Welcome To The World of Unix! The Power of Unix! You are here : Home. Raquo; What is The Difference Between exec and xargs. What is The Difference Between exec and xargs. What is The Difference Between Hard and Soft Link. Important Uses of The prtconf Command. Why SUID Programs Are Dangerous. Working With Network Interfaces. How To Create Volume Group. How To List Volume Groups and Their Characteristics. What is The Difference Between exec and xargs. June 18th, 2010. What Does find Command Do?

xinxiwang.wordpress.com

Using multi-thread/multi-process with xargs in a multicore computer | Xinxi's Blog

https://xinxiwang.wordpress.com/2013/02/03/using-multi-threadmulti-process-with-xargs-in-a-multicore-computer

Life is all about belief. Nothing is more practical than a good theory wp.me/p1mmVM-6W. WTF how could you let Hank die W wp.me/p1mmVM-6V. An interesting paper about determinism realism and locality wp.me/p1mmVM-6T. Pickle dump model open sys argv 1 ‘wb’ wp.me/p1mmVM-6Q. An efficient estimator is the one that achieves wp.me/p1mmVM-6P. On Thread-safe map for C. Mauricesmulders on Thread-safe map for C. Maurice Smulders on Thread-safe map for C. Maurice Smulders on Thread-safe map for C. February 3, 2013.

p-static.blogspot.com

P. Static has got Opinions: Using "make" as a download manager (or: how to parallelize EVERYTHING)

http://p-static.blogspot.com/2011/01/using-make-as-download-manager-or-how.html

P Static has got Opinions. And sometimes he writes them down. Sunday, January 9, 2011. Using "make" as a download manager (or: how to parallelize EVERYTHING). I find myself in the somewhat tedious position of having to download about a hundred large files from S3. I need to only download certain files, so I can't even use S3's APIs and pull down the entire bucket. What a pain! If I could download with wget, but parallelize it, so that several files were downloading at once. Wget -nv -c $@. But how does i...

sigvenezuela.blogspot.com

Sistemas de Información Geográficos en Venezuela: ¡Software Libre, en Hardware Libre! ¿Alguien da más?

http://sigvenezuela.blogspot.com/2009/03/software-libre-en-hardware-libre.html

Sábado, 21 de marzo de 2009. 161;Software Libre, en Hardware Libre! 191;Alguien da más? Es un proyecto de Código Abierto. Para crear el primer sistema operativo libre para teléfonos móviles a nivel mundial. Detrás de este proyecto hay una comunidad a la cual se puede unir cualquier persona para diseñar su teléfono móvil ideal. De la empresa FIC ( First International Computer. Ha sido el primer Smartphone Libre. En el que funcionó OpenMoko. Como muchos sabran gvSIG tiene una versión ‘. Tiene como objeto a...

kenneth.geisshirt.dk

Kneth's Korner: October 2012

http://kenneth.geisshirt.dk/2012_10_01_archive.html

Chemist by education - geek by nature. Map/Reduce and GNU Parallel. Map/Reduce and GNU Parallel. This week I attended a meeting organized by DKUUG. The topic was GNU Parallel. And the speaker was Ole Tange. The developer behind GNU Parallel. To be honest, I have not used GNU Parallel before. Of course, I have heard about it as Ole always talks about the program when I meet him. His introduction to the program was great - enjoy it when DKUUG releases the video. Lately, I have been studying Apache Hadoop.

blog.aclarke.eu

Moving / Copying lots of s3 files quickly using gnu parallel | Andrew Clarke's Blog

http://blog.aclarke.eu/moving-copying-lots-of-s3-files-quickly-using-gnu-parallel

Andrew Clarke's Blog. Moving / Copying lots of s3 files quickly using gnu parallel. I recently had to copy a large volume of files from one s3 folder to another using s3cmd but found that the process was very slow as it is single threaded. I looked into how to do this in a more parallel manner and discovered GNU Parallel. Which was the answer to my dreams. To use it I simply create a list of files that need to be moved and pass them to parallel with the correct copy command :. Bin/bash function dosomethi...