Add canvas annotations for more precise AI feedback
Let users draw circles, arrows, and text over the canvas to guide updates instead of relying only on selection.
[Idea] Annotations as feedback
This just came up from a user call I just had 🙂
It's an idea we've talked about in the past and have seen some form of it in some AI tools, which is...
To provide "drawing" tools (i.e. circle, arrows, text) to annotate over the canvas.
And use that as feedback for Ploy to make updates
(vs. the selection tool)
What do y'all think? Helpful? Meh?
(Below is a really quick mockup I did using Cleanshot as an example)
5 replies
I like it, but I'm not sure how much I'd use it vs just targeting the text with words or the select tool when on the MacBook, but I don't use the iPad much… so with an Apple Pencil this would be cool, in fact, I'd use the iPad more probably!
I have issues where there are pinned sections, so the select tool finds it hard to pick the element if the z-index is in the way (another invisible layer over the top for example)
This could be a great solution for that if it knows what I'm circling.
I have issues where there are pinned sections, so the select tool finds it hard to pick the element if the z-index is in the way
Ah yea, that makes sense.
Without annotations, we need to provide a more precise way to select elements.
---
And for clarification from my side, it would be more like these (screenshot below, from Cleanshot) vs. freeform drawing.
I mean if you can make it so it accurately know’s what's being pointed at so it edits the right thing then that would be very cool.
I have fed screenshot after screenshot to the chat and already do this, so yeah… personally I'd use it. I even feed ploy google ads screenshots to get it to tell me of everything is correct 😆
Being able to highlight it and then say “do more things to this” would definitely be a win for me.
Clean shot is my most used app by far.
clean shot is amazing 😄