Not radioactive.  Transformers used to have PCBs in the oil to prevent the oil from burning (self sustaining fire).  Pretty sure that was banned a long time ago, but there could be many old transformers still in service with PCBs in the oil.  The purpose of the oil is to cool the transformer windings to prevent hot spots and insulation failure.  The oil also provides a higher power rating and a little higher temporary power.