If you use those tape that can hold super well, like epoxy, VHB, or whatever.
When you remove, there's a high chance that the plaster, or coats of wall peeling off and cause ugly marks.
Then clean adhesive off with alcohol may also rub away the paint.
Even if you manage to remove without damaging the wall, the paint may look different because that covered part is not exposed to oxidation or UV as much, most likely will create a patch and you will need to repaint.
So I will definitely recommend to just drill.
When you no longer need that hole, you just cover back with putty and file off.
Only problem is must paint back.
But you can also reuse the hole for other purpose or cover it with other fixtures.
