[DFDL-WG] Fw: dfdl github - mil-std-2045 schema updated

Tue Dec 2 05:16:24 EST 2014

Forwarding to WG. Agenda item on today's call.

Regards

Steve Hanson
Architect, IBM DFDL
Co-Chair, OGF DFDL Working Group
IBM SWG, Hursley, UK
smh at uk.ibm.com
tel:+44-1962-815848
----- Forwarded by Steve Hanson/UK/IBM on 02/12/2014 10:11 -----

From:   Steve Hanson/UK/IBM
To:     Mike Beckerle <mbeckerle.dfdl at gmail.com>
Cc:     Alex Wood1/UK/IBM at IBMGB
Date:   28/11/2014 16:45
Subject:        Re: [DFDL-WG] dfdl github - mil-std-2045 schema updated

Mike

Some more.  The hiddenGroupRefs revealed another bug in IBM DFDL (not 
surprising as we don't support them yet but have a lot of code in the 
editor to display hidden groups nonetheless). Fixing that caused some more 
validation to take place which revealed some more errors. I've added them 
below.

I also notice that your XPath comparisons are using '=' rather than 'eq', 
that is, a general comparison rather than a value comparison. My reading 
of section 23.4 of the DFDL spec is that DFDL expressions do not support 
general comparisons. 

Regards

Steve Hanson
Architect, IBM DFDL
Co-Chair, OGF DFDL Working Group
IBM SWG, Hursley, UK
smh at uk.ibm.com
tel:+44-1962-815848

From:   Steve Hanson/UK/IBM
To:     Mike Beckerle <mbeckerle.dfdl at gmail.com>
Date:   28/11/2014 15:26
Subject:        Re: [DFDL-WG] dfdl github - mil-std-2045 schema updated

Mike

Taken a quick look at these, the following properties need adding to 
defineFormat "thesePropertiesShouldNotMatter" to stop errors:

        truncateSpecifiedLengthString="no" 
        textPadKind="none" 
        binaryNumberCheckPolicy="lax" 
        fillByte="%#r00;" 
        textBidi="no" 
        floating="no"
        choiceLengthKind="implicit"
        useNilForDefault="no"

Seeing several of this error: It is because you are using lengthUnits 
'bits' with xs:nonNegativeInteger (your common type tBigIntField). I don't 
believe the spec allows this.
CTDV1532E : DFDL property 'lengthUnits' can only be 'bits' if the 
representation is binary and the type is boolean, byte, unsignedByte, 
short, unsignedShort, int, unsignedInt, long or unsignedLong. Element: 
#xmlns(p="urn:milstd2045DFDL")xscd(/type::p:future_use_group_type/model::sequence/schemaElement::future_use_group_data). 

There are several things not yet supported by IBM DFDL, which we will get 
to eventually, but fyi they are:

        hiddenGroupRef
        encodingErrorPolicy 'replace'
        bitOrder
        encoding 'US-ASCII-7-bit-packed'

Plus a bug in IBM DFDL was revealed where if a1.xsd in tns 'a' includes 
a2.xsd in tns 'a' to pull in defineFormat name='xxx' then dfdl:format 
ref="tns:xxx" is not resolving. It works if a2.xsd does not have a tns 
(chameleon include), and it works if a2.xsd is tns 'b' (import). 

Regards

Steve Hanson
Architect, IBM DFDL
Co-Chair, OGF DFDL Working Group
IBM SWG, Hursley, UK
smh at uk.ibm.com
tel:+44-1962-815848

From:   Mike Beckerle <mbeckerle.dfdl at gmail.com>
To:     "dfdl-wg at ogf.org" <dfdl-wg at ogf.org>
Date:   19/11/2014 23:48
Subject:        [DFDL-WG] dfdl github - mil-std-2045 schema updated
Sent by:        dfdl-wg-bounces at ogf.org

I finally got around to enhancing the mil-std-2045 schema using the ideas 
that came out of review of the original work.

It is vastly improved in terms of complexity of the schema, and other 
schemas that have to generate this sort of thing are greatly simplified by 
the techniques illustrated here which avoid the need to generate any 
top-level group definitions.

I did have to put in the workaround of using "WSP*" in a terminator 
instead of "ES" because Daffodil doesn't support ES in terminators yet 
(there's a bug). 

I also left out the defaults, which are needed for unparsing, due to a bug 
in Daffodil. 

https://github.com/DFDLSchemas/mil-std-2045

Mike Beckerle | OGF DFDL Workgroup Co-Chair | Tresys Technology | 
www.tresys.com
Please note: Contributions to the DFDL Workgroup's email discussions are 
subject to the OGF Intellectual Property Policy
--
  dfdl-wg mailing list
  dfdl-wg at ogf.org
  https://www.ogf.org/mailman/listinfo/dfdl-wg

Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.ogf.org/pipermail/dfdl-wg/attachments/20141202/26ba2e9f/attachment.html>