View Issue Details Jump to Notes ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0015348Xdmf(No Category)public2015-01-14 08:532015-01-14 12:33
Reporterdjparfitt 
Assigned To 
PrioritylowSeverityfeatureReproducibilityN/A
StatusnewResolutionopen 
PlatformOSOS Version
Summary0015348: Allow a binary offset to be specified when reading binary files
DescriptionBeing able to use just the XML part of XDMF to describe data that is in a raw binary file (ParaView is able to use this feature) is a very useful alternative to having to have the heavy data in HDF, especially for codes that currently haven't moved (or won't, legacy for example) over to something like HDF5 and still produce their data dumps in raw binary. However, if I've understood XDMF as it stands, the limitiation is that one large dump file would have to broken down into many, many small binaries to represent each variable on the grid at each time point. This is a lot of post processing I/O. If however the 'binary' type specifier also allowed a byte offset into a raw file (almost analagous as what the path specifier after the : does for the H5) then a single raw file could be used with the offset specifying how many bytes to 'skip' to reach the actual data the XML is referencing. This would also allow a simple post-processing tool to be written to create the XML part of XDMF for any binary file. This then means there is no short term urgency to alter the main hydrocode to produce XDMF and also old/existing archived binaries could also be post-processed.

Given the availability of simple C functions like FSEEK using such an offset I would imagine is fairly trivial.

I realise that XDMF readers themselves would probably need to be updated to recognise such an addition though before it would actually work and its not just a matter of adding something to XDMF.
Steps To ReproduceN/A
TagsNo tags attached.
Attached Files

 Relationships

  Notes
(0037690)
djparfitt (reporter)
2015-01-14 11:30

I've looked at the XDMF2 (VTK/ThirdParty/xdmf2/vtkxdmf2/libsrc/XdmfValuesBinary.h) and XDMF3 (VTK/ThirdParty/xdmf3/vtkxdmf3/core/XdmfBinaryController.hpp) code on GitHub and have noticed that the classes seems to include a "Seek" parameter which can come from the XML attributes as the Endianism etc does. So I guess this is the functionality I am after. Sorry for raising this issue if this functionality is what I was after ... it just wasn't mentioned anywhere in the documentation.

Please feel free to close this issue.
(0037691)
djparfitt (reporter)
2015-01-14 12:33

Addendum ... I have also now found it referenced in the documentation .... wood for trees and all that :)

 Issue History
Date Modified Username Field Change
2015-01-14 08:53 djparfitt New Issue
2015-01-14 11:30 djparfitt Note Added: 0037690
2015-01-14 12:33 djparfitt Note Added: 0037691


Copyright © 2000 - 2018 MantisBT Team