I did have to force it but I wonder if there might be a slightly different shape to the torx socket. Above picture is mine and there is clearly marks from those brackets.
EDIT: now that I'm thinking about it more, I did angle in to get the socket in the bit and then levered it over until perpendicular to the bolt. This pushed the brackets over enough. It did take some force but nothing that concerned me. Once the bolt was out far enough the pulley did contact those brackets and added just a bit of tension while wratcheting.