Most physical and biological systems are disordered, even though the majority of theoretical models treat disorder as a weak perturbation. One particularly simple system is a ferromagnet approaching its Curie temperature, TC, where all of the spins associated with partially filled atomic shells acquire parallel orientation. With the addition of disorder by way of chemical substitution, the Curie point is suppressed, but no qualitatively new phenomena appear in bulk measurements as long as the disorder is truly random on the atomic scale and not so large as to eliminate ferromagnetism entirely1. Here we report the discovery that a simply measured magnetic response is singular above the Curie temperature of a model, disordered magnet, and that the associated singularity grows to an anomalous divergence at TC. The origin of the singular response is the random internal field induced by an external magnetic field transverse to the favoured direction for magnetization2, 3, 4. The fact that ferromagnets can be studied easily and with high precision using bulk susceptibility and a large variety of imaging tools will not only advance fundamental studies of the random field problem, but also suggests a mechanism for tuning the strength of domain wall pinning, the key to applications.