(Dreams, vectors and meaning) |
m (Dreams, vectors and semantics) |
||
| Line 1: | Line 1: | ||
This sentence: "As we retrieve information stored in vectors, we therefore navigate semantic spaces". Reminds me to the experiment described in [https://www.sciencedirect.com/science/article/pii/S0893608023006470 this paper]. It is about reproducing mental images. The scientists are able to decode both: images observed by the human eye and images imagined from brain activity. Previous techniques consisted on brain scaners and computer vision | This sentence: "As we retrieve information stored in vectors, we therefore navigate semantic spaces". Reminds me to the experiment described in [https://www.sciencedirect.com/science/article/pii/S0893608023006470 this paper]. It is about reproducing mental images. The scientists are able to decode both: images observed by the human eye and images imagined from brain activity. Previous techniques consisted on brain scaners and computer vision. This method proposes to semantise the visual information and then use a text2image GAN for transforming the semantic meaning (words) as prompts for the model (CLIP) that will generate the image. | ||
As I see it, these scientists transform mental images into standardised sentences which meaning cannot describe the sensations or aesthetics of a dream, which is surely the most important thing. | As I see it, these scientists transform mental images into standardised sentences which meaning cannot describe the sensations or aesthetics of a dream, which is surely the most important thing. | ||
Do you think that the construction of meaning through the local similarity of vectors could help in this case? Don't you think that by transforming unconsious or computational information into semantics we are limiting communication to the textual and rational part? | Do you think that the construction of meaning through the local similarity of vectors could help in this case? Don't you think that by transforming unconsious or computational information into semantics we are limiting communication to the textual and rational part? | ||
Revision as of 16:57, 17 January 2024
This sentence: "As we retrieve information stored in vectors, we therefore navigate semantic spaces". Reminds me to the experiment described in this paper. It is about reproducing mental images. The scientists are able to decode both: images observed by the human eye and images imagined from brain activity. Previous techniques consisted on brain scaners and computer vision. This method proposes to semantise the visual information and then use a text2image GAN for transforming the semantic meaning (words) as prompts for the model (CLIP) that will generate the image.
As I see it, these scientists transform mental images into standardised sentences which meaning cannot describe the sensations or aesthetics of a dream, which is surely the most important thing.
Do you think that the construction of meaning through the local similarity of vectors could help in this case? Don't you think that by transforming unconsious or computational information into semantics we are limiting communication to the textual and rational part?