About . . . . . . Classes . . . . . . Books . . . . . . Vita . . . . . . . Links. . . . . . Blog

by Peter Moskos

February 17, 2010

Juking the Stats

A recent report of retired New York City police officers warns that the NYPD is playing fast and loose with the numbers. Knowing when and where crimes occur is essential to good policing and Compstat, a system of crime-data analysis created in 1994, played a large role in bringing down crime in New York City. But ever since, numbers have ruled the NYPD’s roost. If crime numbers are not down, precinct commanding officers need numbers to show they’re doing something—something quantifiable.

In the police world, two statistical categories are important: Part I felony crimes reported to the FBI's Uniform Crime Statistics and internal measures of “productivity,” namely arrests, citations, and summonses. There are ways to play with both. But perhaps surprisingly, the police department’s emphasis on the latter, the so-called productivity stats, is a much greater cause for concern.

Sergeants, lieutenants, captains and inspectors feel intense pressure to produce ever better stats. To some extent this can be good. Police are paid to work. But the pressure to produce more with less is as overwhelming as it is unrealistic. Mind you, the orders never come from above to just make numbers up, but when commanding officers talk about “productivity,” the rank-and-file hear “quotas.”

“I’d love it if I always had enough good C’s [criminal citations], but I need numbers,” one officer told me, “And if I don’t have enough stats and Compstat is coming up, I don’t care if they’re bullshit. I’ll take whatever the f— I can get!” In a world where “better stats” and “more stats” are synonymous, the tail is wagging the dog. And police are nothing if not creative in finding ways to please their bosses.

Officers know what they see on the streets. Any desk sergeant who reclassifies or “corrects” a report sends a terrible and destructive message. And these pressures have grown substantially in the past decade.

When a $2,000 stolen laptop model can be found on EBay for less than $1,000, a felony larceny might be reclassified as a misdemeanor and all but disappear from the stats. Or say a tourist reports a robbery but the police, knowing she’s on the next flight back to Germany, record her loss as lost property.

Of course statistical errors can run both ways. There's a lot more false reporting of crime than the public realize, and police are certainly not fools. That German tourist may have simply wanted a police report to scam insurance money. Real life is not easily quantifiable, and trying to determine which bubble on a report best reflects reality leaves lots of room for honest interpretation.

For statistical errors, data are supposed to be small and random. But for crime data, we’ll generally settle for errors as long as they’re consistent. Given that the distinction between felony and misdemeanor is basically arbitrary anyway, it doesn’t really matter if ten percent of felonies are reclassified as misdemeanors as long as it’s done every year. After all, far more than ten percent of crimes are never even reported.

The problem with fudging crime numbers for political gain is that you can’t stop. You have to do it every year just to stay even. Eventually you’ll get promoted and transferred, if you’re lucky, leaving your more honest and na├»ve replacement to deal with surprisingly bad crime numbers.

Certainly some stats, like murders and car thefts, are more reliable than others. The former are hard to fudge and the latter are generally reported for insurance reasons. And by these measures, the drop in violent crime is impressively clear. Murders alone are down 70 percent from their 1994 peak and 11 percent in the last year alone. This is real. These numbers matter.

But too many measure of police “production” do little but produce internal stats and pad officers’ overtime pay. Take low-level marijuana possession arrests. In 1994 there were 3,141 of these in New York City. In 2008 they had exploded to 40,383! This 1,285 percent increase was not the result of a epidemic of marijuana possession but a simple change in police tactics.

To say these arrests caused the crime drop is absurd, akin to claiming that a parking-ticket blitz prevents traffic deaths. These arrests—at great taxpayer expense and motivated only by internal police pressure to produce “stats”—simply pad officers’ overtime pay while sending tens of thousands of mostly poor minority men through the criminal-justice system.

Messy as they may be, it’s hard to image a police world were numbers didn’t matter. What’s important is that these numbers aren’t produced for their own sake. Statistics need to stay focused on crime and not internal, malleable, and ultimately destructive measures of “productivity.” The hard-working men and women of the NYPD deserve as much.

4 comments:

The Legionnaire said...

The Russian president has recently called on the police there to increase their clearance rates, which are massively manipulated and completely unreliable. Putting too much emphasis on statistical indicators can create pressure to juke stats, and it undermines good police work; in a law enforcement culture that has historically had no accountability, this emphasis only reinforces corrupt practices.

http://walterdurantyreport.blogspot.com/2010/02/medvedev-promises-police-reform-but.html

Any thoughts about this problem of applying Compstat-style systems to police forces in undemocratic or previously undemocratic societies?

PCM said...

Seems doomed to failure. I think you sum it up well.

To clean up a department like that, I think you need 1) to pay officers a good living wage, and 2) only after #1, have some internal system to get rid of corrupt officers without too much hassle.

But unless officers are paid well, there's no chance police won't be corrupt and any attempt at reform is futile.

How much does a Russian police officer make? And how much do you need to live a middle-class life? For comparison, what's the income of a teacher and a plumber?

The Legionnaire said...

Teachers and plumbers are probably not great indicators of middle class wages - the former are underpaid (if they're paid at all), and the latter are not the entrepreneurial tradesmen that we know in the West who live well of of $150 plunging jobs.

The average Moscow policeman makes $400-450 a month, which is substantially lower than the national average wage of $650, and much lower than the average salary in Moscow, which is much richer than the rest of the country. In the provinces, policemen's wages are much, much lower, and like many public sector employees, they are subjected to frequent wage arrears.

In addition to the economic necessity of bribe-taking and other corrupt activities, the police have a deep-seated culture of entitlement - many officers feel that they deserve the bribes they take, that it's a part of their job (this situation is not unique to Russia).

In short, police officers hardly fit into the narrow middle class in Russia, at least not if they live off of their wages.

PCM said...

I ask about teachers' pay because they generally mark the low end of a decent middle-class wage.

Plumbers, even if they're not rich, make enough to live on (or they're wouldn't be plumbers).

If a cop in Moscow is making less than the national average wage (and perhaps not enough to live on), of course he's corrupt. If it's not enough to live on, he should be corrupt! That's better than seeing your kids go hungry.

Unless police wages go up to something approaching the average wage, there's no chance at defeating police corruption. Any other belief is simply naive.

Would the middle class be willing to pay for a better police force? The poor have no money and rich love poor police. All the better to buy.