If you don't mind a small investment in tools, one of the Japenese files or rasps would make that job easier. They really know their stuff when it comes to hand tools. One of the half-round ones would be perfect for those bevels.

ProTooling website

I only have a Shinto Saw Rasp, but it's a brilliant tool. Hope to add more to my toolbox in the future though.