What profile option do I use for defining decimal precision for supply chain transactions?

You use the INV_QUANTITY_DECIMAL_PRECISION profile option.

This option lets you to set the number of numerals to retain after the decimal when converting between units of measure. For example if you set the profile option to 4, the number 234.345636 would be rounded to 234.3456.