[Pgi-wg] EPR issue and approach using WS-Enumeration

[Andrew Grimshaw]

This problem turned up early in RNS. We looked into WS-Enum and made a
different choice (along with RNS). I am attaching a document that describes
why we chose to go with a statefull iterator rather than enumeration,as well
as all of the related documents.
A

> -----Original Message-----
> From: pgi-wg-bounces at ogf.org [mailto:pgi-wg-bounces at ogf.org] On Behalf Of
> Morris Riedel
> Sent: Wednesday, April 08, 2009 11:32 AM
> To: pgi-wg at ogf.org
> Subject: [Pgi-wg] EPR issue and approach using WS-Enumeration
> 
> Hi PGI team,
> 
>   is there any experience by the members of using WS-Enumeration for
> tackling with the emerging 'EPR pile' in the endpoint?
> (WS-Enumeration is like separate google hits pages)
> 
> I took a similar approach with Usage Records in OGF RUS a while ago since
> this problem is nearly the same as ours -  having scalability problems.
> 
> 
> I think this is a problem where each middleware has a limit currently,
> looking especially on emerging many task computing jobs (running rather
> short - but many (potentially different) of them).
> 
> (1)
> Submitting 100.000 jobs and two fail. Both have to have a JSDL for
> resubmit
> - but this means you have typically 100.000 instances/EPRs tracked in the
> container...
> 
> (2)
> Submitting 100.000 jobs and two fail using bulk submission or something
> like
> that with only one JSDL - you have difficulties to get the job description
> of these two.
> 
> 
> Maybe there is already someone having experience with WS-Enumeration in
> this
> context here in the PGI space?
> 
> Thanks,
> Morris
> 
> 
> 
> ------------------------------------------------------------
> Morris Riedel
> SW - Engineer
> Distributed Systems and Grid Computing Division
> Jülich Supercomputing Centre (JSC)
> Forschungszentrum Juelich
> Wilhelm-Johnen-Str. 1
> D - 52425 Juelich
> Germany
> 
> Email: m.riedel at fz-juelich.de
> Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel
> Phone: +49 2461 61 - 3651
> Fax: +49 2461 61 - 6656
> 
> Skype: MorrisRiedel
> 
> "We work to better ourselves, and the rest of humanity"
> 
> Sitz der Gesellschaft: Jülich
> Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498
> Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe
> Vorstand: Prof. Dr. Achim Bachem (Vorsitzender),
> Dr. Ulrich Krafft (stellv. Vorsitzender)
> 

-------------- next part --------------
A non-text attachment was scrubbed...
Name: RNS-1.1-rendering-v1.pdf
Type: application/pdf
Size: 103488 bytes
Desc: not available
Url : http://www.ogf.org/pipermail/pgi-wg/attachments/20090408/7fe7ead9/attachment-0004.pdf 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: RNS-1.1-spec-v1.pdf
Type: application/pdf
Size: 145262 bytes
Desc: not available
Url : http://www.ogf.org/pipermail/pgi-wg/attachments/20090408/7fe7ead9/attachment-0005.pdf 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: WS-Enumeration-and-OGSA.pdf
Type: application/pdf
Size: 76351 bytes
Desc: not available
Url : http://www.ogf.org/pipermail/pgi-wg/attachments/20090408/7fe7ead9/attachment-0006.pdf 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ws-iterator-1.0-v1.pdf
Type: application/pdf
Size: 106185 bytes
Desc: not available
Url : http://www.ogf.org/pipermail/pgi-wg/attachments/20090408/7fe7ead9/attachment-0007.pdf