how to use segment for objects?
how to use segment objects? Do not find reference codes?
Hello 👋 the model outputs segmentation tokens, and then there's a separate neural network to decode it to a segmentation mask. In this demo you can see I put the code in parts and one part consists of utils to do it, and there's a separate segmentation parsing function to parse inference output. Does it sound good?
Hi @paul91 ,
Sorry for late response, Using segment objects in a model like Paligemma-3B-PT-896 likely involves preparing your input in chunks (segments) and ensuring the model processes each chunk appropriately, either with segment embeddings or chunk-wise processing. If you’re working with a transformer-based model, make sure to structure your input with segment IDs if needed, and handle chunking and padding to fit the model's input size limitations. Kindly try and let me know if you have any concerns.
Thank you.