There are quite a few issues here. Firstly, is the noise inside, outside, or both, of the bandwidth of interest, I am assuming that the noise is not from your driving source, or from badly chosen resistor values and the configuration of your op-amp. What is your grounding like, if not done with attention to detail, this could make any of the following suggestions meaningless.
Is the DC supply linear or switch node. I assume switch mode. Switch mode supplies present numerous problems with respect to noise reduction, grounding, layout, type of converter, output filtering etc.
You really need to put a schematic or block diagram into the mix so we can see what you are trying to achieve. If the op amp has low open loop bandwidth, its power supply rejection will be low at higher frequencies. Power supply rejection can be different on the positive and negative rails if it has dual supplies. The other thing is to tackle the noise from the source. You may get away with an LC filter, these are available in SMD or through hole parts. It may require a linear regulator on the noisy output, you need to choose one with a high power supply rejection ratio and low noise at the frequency of interest. Anyway, post a schematic, it may help, with a few details about what you are wanting out of the system,
cheers,
Richard