If, when trying to delete certain files or folders, the icon just flashes, disconnect and then reconnect to your server and try again.

If this doesn't work, you may want to contact your Web hosting provider to check the ownership/permissions of the files/folders you are trying to delete.