illegal footings vs hanging basket

[MsH]

I'm really struggling with my neighbour; he put footings for his building on my land when i expressly told him not to, he back filled with concrete making a decent amount of garden unusable and has put guttering, a down pipe which goes into my drain and his roof line over the boundary line. I wrote to him telling him i was going to take legal action and now he's said i have to remove a hanging basket, a sky dish and trellis from the wall (extension of his building). Is he right asking me to remove things from his wall following what he's done?