Interfaces between insulating oxides have revealed exotic electronic and magnetic properties. It is now shown that a complex magnetic structure can emerge in an oxide superlattice, and that specific interfaces can unexpectedly exhibit exchange bias. The observations reveal the induction of antiferromagnetism in a material that is usually paramagnetic.