This dataset contains approximately 9 000 images of text on different surfaces with only the word annotations. This is because the model first learns a generalized way of accomplishing the task on this new dataset with many examples during training. I said that they released a dataset for this model and that it was able to do that with only one word.
Instead, they use a self-supervised training process where the style and the segmentation of the texts aren't given to the model during training. Meaning that you need to know what is every pixel in the picture, whether it is the text or not, which is very costly and complicated to have. Typical text-transfer models are trained in a supervised manner with one specific style and use images with text segmentation. Indeed, it understands not only the typography and calligraphy of the text but also the scene in which it appears whether it's on a curvy poster or different backgrounds. Its ability to generalize from a single word example and copy its style is what makes this new artificial intelligence model so impressive. As you can see, it also works with handwriting using a single word as well. super easily, making the immersion even more personalized and convincing for everyone based on the chosen language without having to manually photoshop each frame or completely remake scenes. And it’s only the first paper about such a model trained on a new dataset they released for this task, and it is already quite impressive! This could be amazing for video games or movies as you will be able to translate the text appearing on buildings, posters, signs, etc. This is amazing for photo-realistic language translation in augmented reality. Praveen Krishnan et al., (2021), TextStyleBrush It can copy the style of a text from any picture using a single word as an example! Just like this. What is even cooler is that their translation tool actually uses similar technology as deep fakes to change the words in an image following the same style as the original words! Real-time Translation from French to English.
Instead, you can simply use this new model by Facebook AI to translate every text in the image in your own language! This is not even the main application of this technology, but even this is cool.
In 2021 you don't even need to open google translate anymore and try to write what you see one by one to translate it. Well, in 2020, you would take out your phone and google translate what you see. I think this won't be too hard to imagine as most of us already faced this situation whether you see menu items or directions and you can't understand what's written. You want to try out a local restaurant, but their menu is in the language you don't speak. Imagine you are on vacation in another country where you do not speak the language. 7 min read Watch the video and support me on YouTube!.
0 kommentar(er)
