LMS is typical Asian stuff so with that comes good & not-so-good.
Are you saying the keyway profile is incomplete or the issue is the burr left over from drilling & tapping hole protruding into the keyway? If its just the hole, I'd try is an undersized HSS square bit sharpened edged on the end like a chisel, then just try & plane off that burr. That way every edge is 'safe'. If you go in there with a file chances are greater of removing side material. Another option is put tape on both sides of the file so only the bottom cuts. If the keyway is incomplete, that's a bigger headache. I'd have to think.
De-chamfering the aluminum edges shouldn't be too dramatic. Sometimes files can bite & give undesirable results as a function of the cutting teeth angle & how the file can approach it. (Kind of the mill file issue vs. regular file). But the finest tooth file you have will work best. Pre-paint it with a dark Sharpy & you can see exactly how it progresses. If its just a bit of sharp edge, wrap some 600 on a piece of scrap square section & knock it down, aluminum is pretty soft. I made myself a whole batch of disposable sanding sticks like this, various grits wet-o-dry with spray adhesive on MDF. I'll take some pics if your'e interested. Dead easy & work nice on aluminum