I have also experienced this many times, so I really understand your frustration. On another server you can't open chests with a sword, but I don't think it’s the best solution either. You have to change your inventory every time when you want to open a chest and I regularly ended up in a steak fight. Now I just try to avoid chests when I start an attack