openjpeg/src/lib/openjp2/tcd.h, branch cancelFork of openjpeg library for JPEG2000 encoding and decodinghttps://git.carlh.net/cgit/openjpeg/atom?h=cancel2025-01-24T12:26:40Zwip2025-01-24T12:26:40ZCarl Hetheringtoncth@carlh.net2025-01-24T12:26:40Zurn:sha1:e53debb0a1b49af365cd9b67b7161d343c872ecdCleanup code related to quality layer allocation, and add a few safety checks2022-08-11T16:12:07ZEven Rouaulteven.rouault@spatialys.com2022-08-11T16:06:21Zurn:sha1:c06632c6f6d0a3e106374fe462869b131366c2d0Significant speed-up rate allocation by rate/distoratio ratio2022-08-11T16:06:50ZEven Rouaulteven.rouault@spatialys.com2022-08-11T14:46:55Zurn:sha1:3d9bcd37534ce1166e1f0a7764faf69bea4d89b1
- Avoid doing 128 iterations all the time, and stop when the threshold
doesn't vary much
- Avoid calling costly opj_t2_encode_packets() repeatdly when bisecting the
layer ratio if the truncation points haven't changed since the last
iteration.
When used with the GDAL gdal_translate application to convert a 11977 x
8745 raster with data type UInt16 and 8 channels, the conversion time
to JPEG2000 with 20 quality layers using disto/rate allocation (
-co "IC=C8" -co "JPEG2000_DRIVER=JP2OPENJPEG" -co "PROFILE=NPJE_NUMERICALLY_LOSSLESS"
creation options of the GDAL NITF driver) goes from 5m56 wall clock
(8m20s total, 12 vCPUs) down to 1m16 wall clock (3m45 total).
Added support for high throughput (HTJ2K) decoding.2021-09-25T10:26:59ZAous Namanaous72@yahoo.com2021-09-02T08:51:38Zurn:sha1:1e6c925eb5f6b68097a9592ca4df4f24eb8b9e56
There are a few limitations:
- mixed mode (HT and regular code blocks) is not supported.
- ROI in HT blocks is not supported.
- Placeholder passes are not supported.
- MultiHT sets are not support, only a singleHT set.
- there are known issues with some compliance testing files related to
the parsing of packet header.
Add support for generation of PLT markers in encoder2020-04-21T13:55:44ZEven Rouaulteven.rouault@spatialys.com2020-04-21T13:55:44Zurn:sha1:4edb8c83374f52cd6a8f2c7c875e8ffacccb5fa5
* -PLT switch added to opj_compress
* Add a opj_encoder_set_extra_options() function that
accepts a PLT=YES option, and could be expanded later
for other uses.
-------
Testing with a Sentinel2 10m band, T36JTT_20160914T074612_B02.jp2,
coming from S2A_MSIL1C_20160914T074612_N0204_R135_T36JTT_20160914T081456.SAFE
Decompress it to TIFF:
```
opj_uncompress -i T36JTT_20160914T074612_B02.jp2 -o T36JTT_20160914T074612_B02.tif
```
Recompress it with similar parameters as original:
```
opj_compress -n 5 -c [256,256],[256,256],[256,256],[256,256],[256,256] -t 1024,1024 -PLT -i T36JTT_20160914T074612_B02.tif -o T36JTT_20160914T074612_B02_PLT.jp2
```
Dump codestream detail with GDAL dump_jp2.py utility (https://github.com/OSGeo/gdal/blob/master/gdal/swig/python/samples/dump_jp2.py)
```
python dump_jp2.py T36JTT_20160914T074612_B02.jp2 > /tmp/dump_sentinel2_ori.txt
python dump_jp2.py T36JTT_20160914T074612_B02_PLT.jp2 > /tmp/dump_sentinel2_openjpeg_plt.txt
```
The diff between both show very similar structure, and identical number of packets in PLT markers
Now testing with Kakadu (KDU803_Demo_Apps_for_Linux-x86-64_200210)
Full file decompression:
```
kdu_expand -i T36JTT_20160914T074612_B02_PLT.jp2 -o tmp.tif
Consumed 121 tile-part(s) from a total of 121 tile(s).
Consumed 80,318,806 codestream bytes (excluding any file format) = 5.329697
bits/pel.
Processed using the multi-threaded environment, with
8 parallel threads of execution
```
Partial decompresson (presumably using PLT markers):
```
kdu_expand -i T36JTT_20160914T074612_B02.jp2 -o tmp.pgm -region "{0.5,0.5},{0.01,0.01}"
kdu_expand -i T36JTT_20160914T074612_B02_PLT.jp2 -o tmp2.pgm -region "{0.5,0.5},{0.01,0.01}"
diff tmp.pgm tmp2.pgm && echo "same !"
```
-------
Funded by ESA for S2-MPC project
Rename mis-named function opj_tcd_get_encoded_tile_size() to opj_tcd_get_encoder_input_buffer_size()2020-04-16T18:33:22ZEven Rouaulteven.rouault@spatialys.com2020-04-16T18:33:22Zurn:sha1:221a801a97a3ea968a311f7905c18a1eb7f034c4Add capability to decode only a subset of all components of an image.2017-09-19T15:06:19ZEven Rouaulteven.rouault@spatialys.com2017-09-19T14:52:07Zurn:sha1:7e2b6bebff12eab8bdc17fc9af017e8c11652f4f
This adds a opj_set_decoded_components(opj_codec_t *p_codec,
OPJ_UINT32 numcomps, const OPJ_UINT32* comps_indices) function,
and equivalent "opj_decompress -c compno[,compno]*" option.
When specified, neither the MCT transform nor JP2 channel transformations
will be applied.
Tests added for various combinations of whole image vs tiled-based decoding,
full or reduced resolution, use of decode area or not.
Various changes to allow tile buffers of more than 4giga pixels2017-09-01T14:30:44ZEven Rouaulteven.rouault@spatialys.com2017-09-01T14:30:44Zurn:sha1:98b93103613c90753fb6c57696f9403f8ea0b1d6
Untested though, since that means a tile buffer of at least 16 GB. So
there might be places where uint32 overflow on multiplication still occur...
TCD: allow tile buffer to be greater than 4GB on 64 bit hosts (but number of pixels must remain under 4 billion)2017-09-01T14:30:41ZEven Rouaulteven.rouault@spatialys.com2017-09-01T14:30:41Zurn:sha1:008a12d4fce0a7b1eabc51e04ed339be759646e2Sub-tile decoding: only allocate tile component buffer of the needed dimension2017-09-01T14:30:29ZEven Rouaulteven.rouault@spatialys.com2017-09-01T14:30:29Zurn:sha1:f9e9942330f476b66ac4a35d0ae521200878f343
Instead of being the full tile size.
* Use a sparse array mechanism to store code-blocks and intermediate stages of
IDWT.
* IDWT, DC level shift and MCT stages are done just on that smaller array.
* Improve copy of tile component array to final image, by saving an intermediate
buffer.
* For full-tile decoding at reduced resolution, only allocate the tile buffer to
the reduced size, instead of the full-resolution size.