A basic rule for op-amps (this assumes a perfect amplifier with infinite gain) is that the inverting and non inverting pins are at the same voltage with negative feedback applied. This implies that the output will always drive the feedback network to ensure that the two inputs are at the same voltage. Intuitively, this must be the case, since any difference in the voltage between the two pins is amplified infinitely.
Additionally, the two inputs have infinite input resistance, that is, they draw no current.
The gain with feedback and the input signal have to be low enough that the output is not saturated at one or other of the power supply rails (a characteristic of a real world op-amp) with an applied signal.
The gain equals (Rf/Ri+1), ignoring the less than infinite open loop gain, or ~22, so the output should be 22mV with 1mV input.
With 1mV on the non-inverting input, there should be 1mV on the inverting input.
In order to have 1mV on the inverting terminal, the output voltage has to be 22mV, since the resistors Rf and Ri act as a voltage divider.
Remember, you have put feedback around the amplifier, it is not operating open loop, without the resistor feedback, if you applied a 1mV signal, the output would go to 10V. Obviously feedback throws away gain, but you gain other benefits from negative feedback, which is the whole point of it.
Trying to explain this without the benefits of diagrams and lots of equations is not easy, however, there is a vast amount of info on the web on this topic, including you tube class room style demos, so have a look there for a better explanation,
cheers,
Richard