Posted by philjord on Nov 24, 2023; 11:58pm
URL: https://forum.jogamp.org/Shader-Uniform-Sampler2D-Update-in-TextureUnitState-not-applied-tp4043151p4043159.html

basti, you are so fast I didn't even have the test code working, well done.

I've been digging into this and it looks, on the surface of it, like the original Java3D code doesn't cater for this use. Effectively we just want the TextureRetained to know it's ImageComponent2D has been made "dirty" and for it to call updateTexture2DSubImage on the pipeline when the Shape3D is called to draw.

Here is the only work around I've found so far, as I really haven't been able to find the best/most correct way to do the above properly.

Each Texture2D has it's dirty flags set on construction, but they are marked clean after it has been rendered the first time, so creating a new Textur2D on each render pass will ensure the new raster image data is shown on screen on each draw call.


So this code
getTexture2DFromPool();
tex.setImage(0, drawRaster.getImage());

becomes

//getTexture2DFromPool();
tex = new Texture2D(Texture.BASE_LEVEL, Texture.RGBA, width, height);
tex.setImage(0, drawRaster.getImage());

and your rotating sphere keeps rotating properly.

Of course your texture garage collection of the poorest quality.



I'll keep digging for a real solution, but below are my notes on what needs to be done and why the current code stops it from being done.


The solution is to have TextureRetained.reloadTextureImage called each render pass, if the ImageComponent2D inside it has been updated.

reloadTextureImage is called optionally in TextureRetained.updateNative
if the
boolean reloadTexture = false;
is made true by
if ((resourceCreationMask & cv.canvasBit) == 0)


Now how to get the resourceCreationMask set to match the canvasBit becomes very very complex.


Normally, that is in retained mode it's as trivial as the Texture2D.setImage method calls setImage on the TextureRetained, which fires a texture update message on the queue which eventually via the renderer and a heap of code gets RenderBin.updateCanvasResource(Canvas3D[] canvases) to set the mask.

Immediate mode can't use this path as live/unlive states aren't used by immediate mode on scene side of the scene graph (they are not valid in fact).

I need to find a way to get the mask set, or at least defaulted back to the initial value, so that the texture is reloaded. I think this is somehow related to the Canvas3D and it's lists of used textures, possibly that can be cleared or reset somehow, so it assumes the textures is sees again need loading onto the pipeline.

If you don't like reconstructing the Texture2D constantly, simply creating your own version of TextureRetained  and editing updateNative(Canvas3D cv) with an always true reload might be nicer, but its not a long term solution.