[CS241] Re: CS241 Digest, Vol 3, Issue 4

[Eric Lim]

I think the best way, at least to get it automated through every EM  
iteration, would be writing a shell scripts like the following.

...
While [$counter less than some amount]
   echo "./Parser args1 args2 ..." > sample.batch.$counter
   hogmigrate sample.$counter -n $counter-sample
   sty $counter-sample rungrid_rungrid &
   increment $counter
EndWhile

wait

do something else here
...

You can always generate multiple "./Parser" in the batch scripts so  
that you don't have to open many sty sessions.

The & makes sty quits automatically when it's finished so that the  
wait function can keep track of its pid. Instead of letting sty keep  
track of the status (which i found it rather complicated to integrate  
with bash), you can either read the results directly from the  
directory that sty created or use wait. It just works more naturally  
with bash.

Hope this helps.


Eric



On Dec 7, 2006, at 5:37 PM, Leo Meyerovich wrote:

> Howdy y'all,
>
> I talked to another group today about hogwash and it looked like they
> were a bit stumped as well. I crawled through the hogwash source and
> found how to run commands through it. Let's say you want to get the
> status of something, twice.
>
> $>hogmigrate leo.batch
> $>sty hog-leo.batch status_status
>
> That should be enough to get iteration:
>
> batch1: run a bunch of different threads + a testing loop that checks
> for done status, and when done, clears the batch and starts the next
> one
>
> batch2: in one thread, compress the results, and when done, call  
> batch  1
>
> It will probably be hairier than that, but hope that helps!
>
> - Leo
>
> On 11/14/06, cs241-request at list.cs.brown.edu
> <cs241-request at list.cs.brown.edu> wrote:
>> Send CS241 mailing list submissions to
>>         cs241 at list.cs.brown.edu
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>>         http://list.cs.brown.edu/mailman/listinfo/cs241
>> or, via email, send a message with subject or body 'help' to
>>         cs241-request at list.cs.brown.edu
>>
>> You can reach the person managing the list at
>>         cs241-owner at list.cs.brown.edu
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of CS241 digest..."
>>
>>
>> Today's Topics:
>>
>>    1. Bootstrapping without the boot (Matt Lease)
>>
>>
>> --------------------------------------------------------------------- 
>> -
>>
>> Message: 1
>> Date: Mon, 13 Nov 2006 14:00:46 -0500
>> From: Matt Lease <mlease at cs.brown.edu>
>> Subject: [CS241] Bootstrapping without the boot
>> To: cs241 at list.cs.brown.edu
>> Message-ID: <4558C0DE.6030209 at cs.brown.edu>
>> Content-Type: text/plain; charset=ISO-8859-1
>>
>> I apologize for not getting this out sooner after last class, but  
>> here
>> is the link to the paper we mentioned at the end:
>>
>> http://www.clsp.jhu.edu/~damianos/strapping.pdf
>>
>>
>> ------------------------------
>>
>> _______________________________________________
>> CS241 mailing list
>> CS241 at list.cs.brown.edu
>> http://list.cs.brown.edu/mailman/listinfo/cs241
>>
>>
>> End of CS241 Digest, Vol 3, Issue 4
>> ***********************************
>>
> _______________________________________________
> CS241 mailing list
> CS241 at list.cs.brown.edu
> http://list.cs.brown.edu/mailman/listinfo/cs241