it really depends on the situation for me. If the waiter/waitress asks politely and if I am to change from big table to small table for a group of more people, I would do it. This is why sometimes I rather wait for longer instead of joining others in a big table.
moving is normal la...in a Chinese place...in HK many parties share the same table tim la...nothing special, but the waiter/waitress should ask politely