If they haven't done any damage to your island, just remove them and forget about it. If they come back later on, that's a different story.
If they've already done damage to your island, you can try reporting them. Although, I'm pretty sure you can't get someone banned for trolling on your...