The following Q&A was created in response to questions asked at our latest webinar: How Artificial Intelligence brings value to your existing archives. Questions are answered by Jaap van Blaaderen, WoodWing and Elvis Digital Asset Management (DAM) Integrations Architect. For more info on Elvis DAM, please contact firstname.lastname@example.org.
Q1: How do I ensure that the generated tags comply to the company tagging guidelines?
A1: There are two options here. The first option is to create a taxonomy for the metadata field(s) where tags are stored, this way the only tags that exist in the taxonomy will be stored. Note that this could lead to valuable tags lost when they don’t exist in your taxonomy. The second option is to create a custom tag model at your AI provider and train that model with your own terminology. You might also think about just adopting the tagging as provided by your AI provider as this will be very consistent.
Q2: Can I have tags in other languages than English? For example German, Chinese or Vietnamese?
A2: Yes, you can. We support two ways of multi-language tags. Either directly from the AI vendor, or in a two step process where we first gather the tags in English and then use Google Translate to translate to any desired language. Generating tags in the correct language directly from the vendor is preferred as it’s language agnostic and thus results in higher quality tags (no translation errors). The Google Translate option can be a valuable alternative when the desired language is not supported by the AI vendor. A complete list of languages can be found on the Google website. In a multi-language environment, you can use a custom metadata field per language to store the tags.
Q3: Can the generated images and tags (metadata) be exported to other systems, for example a CMS or webshop?
A3: Yes, this is possible. Elvis has a rich set of API’s that allows integrators to push information into- or pull information out of Elvis. Retrieving file information from Elvis can be done using a search operation, for more info check this article.
Q4: In the webinar demo, a picture of Alec Baldwin impersonating Donald Trump is not recognized as Alec Baldwin, why not?
A4: In our experience AI celebrity recognition is quite picky, this means that if it is able to detect a celebrity in a photo, it will be a correct match. This also means that it might not detect celebrities that humans are probably be able to recognize. In this case the expected result was achieved as we don't see any pictures of Baldwin as Trump.
Q5: Does it work with Elvis 5?
A5: Yes, it works with Elvis 5.26 and higher.
Q6: Does it work with the Elvis desktop client?
A6: Partly. Auto-tagging when importing new images using the desktop client works. Tagging existing archives is only supported in the Elvis web client.
Q7: Is it possible to teach an AI engine, company specific content?
A7: Yes, some AI vendors support this. You can typically train the AI engine by providing a set of images and then describe what’s in them. This way the AI engine is trained and it can start recognizing images with similar content. For example Clarifai supports this with custom models.
Q8: Are manually added tags overwritten by tags created from AI engines?
A8: No, the AI generated tags are stored in a separate metadata field “Tags from AI”, so both can be used.
Q9: What AI vendors do you support and can we combine results from different vendors?
A9: We currently support Clarifai, AWS Rekognition and Google Vision, the number of supported vendors might change or increase in the future. You need an account for at least one or (optionally) multiple vendors. Tags are combined into one field when you have multiple vendors.
Q10: How is this integrated in Elvis and how do I install it?
A10: The integration is shipped as a separate web-application for Elvis on-premise, this app forms the bridge between Elvis and the cloud based AI vendors. When an image needs to be recognized, we send the Elvis image preview to the AI vendor. The AI vendor provide tags back to Elvis. For detailed information on installation and usage, please check this Help Center article.
Q11: What about video support?
A11: We currently don’t support video recognition. We might add it in a future version if there’s a lot of interest in this.
Q12: What happens when an Enterprise managed image returns to Elvis on archive? Will it be tagged twice?
A12: Yes, it will. We might optimize this in the future. Also note that using shadow objects in Enterprise will solve the issue as the image is no longer copied between Elvis and Enterprise.
Q13: What about image Optical Character Recognition (OCR) support?
A13: Currently not supported, but some vendors do have support for this. We might add it in a future version if there’s a lot of interest in this.
Q14: Is this integration supported for Swivle (formerly known as Elvis Cloud) as well?
A14: Not at this moment. It is quite likely that Swivle will support AI in the future as well.
Q15: Where can I quickly try this with my own images?
A15: There are two options here. If you want to quickly check a few images, you can try the AI vendor websites: Google Vision, AWS Rekognition and Clarifai. If you want to test the full integrated experience in Elvis, you can install the integration next to your Elvis demo environment, for more info see Q10.
Q16: Are black&white photos supported?
A16: Yes, they are. The AI engines tag them just as well. You can always try it with your own images, see Q15.
Q17: Can I control the quality and the amount of generated tags?
A17: Yes, you can. All AI vendors provide accuracy scoring on the results they provide, our testing showed that results with a minimum score of 80-85% are generally good. The integration also regulates the total amount of tags stored.
Q18: Can I use this to search for similar image or to search by image?
A18: Similar image search will be supported soon, searching by image is currently in experimental phase and might be added later as a feature to the integration.
Q19: How are the images treated by the AI vendor?
A19: This can be different between vendors, please check the terms & conditions of your preferred AI vendor.
Q20: You talked about a special offer for new customers, is the integration also for existing Elvis customers?
A20: Yes, the AI integration is available for both new and existing Elvis customers. For existing customers, the integration will be offered for free. For asset tagging the regular pricing of the selected AI vendor will apply.