To change Reactions buttons size navigate to Reactions > Graphic Settings, this page shows a real time preview of the buttons appearance, so you may play with all values and see changes before saving.

Insert a numeric value, in pixel, in the field labeled Select size for reaction buttons and click the Save Changes button on the bottom.