View Issue Details [ Jump to Notes ] | [ Print ] | ||||||||||||
ID | Project | Category | View Status | Date Submitted | Last Update | ||||||||
0015348 | Xdmf | (No Category) | public | 2015-01-14 08:53 | 2015-01-14 12:33 | ||||||||
Reporter | djparfitt | ||||||||||||
Assigned To | |||||||||||||
Priority | low | Severity | feature | Reproducibility | N/A | ||||||||
Status | new | Resolution | open | ||||||||||
Platform | OS | OS Version | |||||||||||
Summary | 0015348: Allow a binary offset to be specified when reading binary files | ||||||||||||
Description | Being able to use just the XML part of XDMF to describe data that is in a raw binary file (ParaView is able to use this feature) is a very useful alternative to having to have the heavy data in HDF, especially for codes that currently haven't moved (or won't, legacy for example) over to something like HDF5 and still produce their data dumps in raw binary. However, if I've understood XDMF as it stands, the limitiation is that one large dump file would have to broken down into many, many small binaries to represent each variable on the grid at each time point. This is a lot of post processing I/O. If however the 'binary' type specifier also allowed a byte offset into a raw file (almost analagous as what the path specifier after the : does for the H5) then a single raw file could be used with the offset specifying how many bytes to 'skip' to reach the actual data the XML is referencing. This would also allow a simple post-processing tool to be written to create the XML part of XDMF for any binary file. This then means there is no short term urgency to alter the main hydrocode to produce XDMF and also old/existing archived binaries could also be post-processed. Given the availability of simple C functions like FSEEK using such an offset I would imagine is fairly trivial. I realise that XDMF readers themselves would probably need to be updated to recognise such an addition though before it would actually work and its not just a matter of adding something to XDMF. | ||||||||||||
Steps To Reproduce | N/A | ||||||||||||
Tags | No tags attached. | ||||||||||||
Attached Files | |||||||||||||
Relationships | |
Relationships |
Notes | |
(0037690) djparfitt (reporter) 2015-01-14 11:30 |
I've looked at the XDMF2 (VTK/ThirdParty/xdmf2/vtkxdmf2/libsrc/XdmfValuesBinary.h) and XDMF3 (VTK/ThirdParty/xdmf3/vtkxdmf3/core/XdmfBinaryController.hpp) code on GitHub and have noticed that the classes seems to include a "Seek" parameter which can come from the XML attributes as the Endianism etc does. So I guess this is the functionality I am after. Sorry for raising this issue if this functionality is what I was after ... it just wasn't mentioned anywhere in the documentation. Please feel free to close this issue. |
(0037691) djparfitt (reporter) 2015-01-14 12:33 |
Addendum ... I have also now found it referenced in the documentation .... wood for trees and all that :) |
Notes |
Issue History | |||
Date Modified | Username | Field | Change |
2015-01-14 08:53 | djparfitt | New Issue | |
2015-01-14 11:30 | djparfitt | Note Added: 0037690 | |
2015-01-14 12:33 | djparfitt | Note Added: 0037691 |
Issue History |
Copyright © 2000 - 2018 MantisBT Team |