The Legacy of Prasanta Chandra Mahalanobis: Revolutionizing Data Collection
A Pioneer in Statistical Methods
In the wake of the 1947 Partition, Delhi experienced severe communal riots, leading to a significant influx of displaced individuals seeking refuge at the Red Fort. The newly formed Indian government faced the daunting task of providing food for these refugees, yet the exact number of individuals remained unknown. Contractors were inflating their bills, and while officials suspected fraudulent activities, they lacked a reliable method to verify the figures amidst ongoing violence. In a bid for assistance, a call was made to the Indian Statistical Institute in Calcutta. Instead of counting the refugees directly, the statisticians analyzed water consumption patterns, calculated per capita usage, and estimated the population based on these figures. This innovative approach was spearheaded by Prasanta Chandra Mahalanobis, whose groundbreaking methods would transform global data collection practices.
Born on June 29, 1893, in Calcutta to a distinguished Bengali Brahmin family, Mahalanobis graduated with honors in physics from Presidency College in 1912. His academic journey included studying under notable figures like Jagadish Chandra Bose and Prafulla Chandra Ray. He later pursued further studies in physics and mathematics at Cambridge, where a delayed return to India led him to discover statistics through reading Biometrika, a journal from Oxford University Press. This sparked his interest in applying mathematical techniques to solve real-world issues beyond the scope of physics.
Upon returning to India, Mahalanobis took a professorship at Presidency College, where he began applying statistical methods across various fields, including anthropology, meteorology, and flood management. In 1931, he established the Indian Statistical Institute in a modest room at the college, starting with a budget of just 238 rupees. This institution was later recognized as one of national importance by Parliament in 1959.
Mahalanobis's most significant contribution was the development of large-scale sample survey methodologies. Prior to his innovations, governments relied heavily on complete censuses or administrative records for demographic insights. He proved that well-structured random sampling could yield accurate national data at a fraction of the cost. Between 1937 and 1944, he conducted groundbreaking surveys on consumer spending, agricultural yields, and public sentiment. His introduction of pilot surveys and a method for estimating crop yields through random sampling replaced guesswork with precision. Renowned American statistician Harold Hotelling noted that no other random sampling technique could match the accuracy of Mahalanobis's methods.
In 1950, Mahalanobis initiated the National Sample Survey, a continuous household survey that has been gathering socioeconomic data across India annually ever since. He also established the Central Statistical Organisation and chaired the United Nations Sub-Commission on Sampling from 1947 to 1951, later leading the UN Statistical Commission. His methodologies gained global recognition, being adopted by the World Bank and various governments. As Nobel laureate Angus Deaton remarked in 2005, "Where Mahalanobis and India led, the rest of the world has followed, so that today, most countries have a recent household income or expenditure survey."
In recognition of his contributions, Mahalanobis was awarded the Padma Vibhushan in 1968. His birthday, June 29, is celebrated as National Statistics Day in India. He passed away on June 28, 1972, just a day shy of his seventy-ninth birthday, while still serving as the director of the ISI.
If you've ever encountered government policies supported by survey data, poverty estimates derived from household sampling, or crop yield figures that didn't require exhaustive counting, you have benefited from the pioneering work of Prasanta Chandra Mahalanobis. He viewed statistics not merely as a mathematical discipline but as a vital tool for comprehending reality, a perspective that has gained global acceptance.