Tech

California Spent Nearly $1.8 Million on Controversial Facial Recognition Software

In responding to our records request California Department of Justice (CADOJ) has provided documents detailing its acquisition of an expansive and highly advanced facial recognition system. We also received two booklets that explain how the system works and its vast array of specifications.

CADOJ first asked the NEC Corporation of America for a quote in June of 2013. The Japanese technology company sent over 100 pages in response, detailing exactly what its program, called NeoFace, is capable of, and how it can meet the needs of CADOJ. In April of 2015 CADOJ made its first payment to NEC, for $650,000.

Videos by VICE

Later in the year, delivery, test, and installation fees boosted this figure by another $288,850 for a total of over $850,000. The process of getting the program up and running apparently took quite some time—in 2016, CADOJ paid the company another $650,000 fee and then $200,000 more for a deployment fee. It appears that the system became fully operational on April 26, 2016.

For those keeping track, CADOJ has so far spent $1,788,850. It appears that there is a $650,000 support fee that will be billed yearly to California DOJ. In other words, taxpayers are going to be paying over half a million dollars annually for this. Judging from the potency of the technology, CADOJ will get its money’s worth one way or another.

NEC told CADOJ in its quote that NeoFace could be used for multiple kinds of cases including access control, identification, mobility, and most worrying, surveillance. The company makes a habit in the quotes of noting that NeoFace was ranked No. 1 by the National Institute of Standards and Technology in a test of biometrics and facial recognition systems. NeoFace identifies photos in .4 seconds, two times faster than the next leading competitor, the French tech company Sagem. It also boasts the fewest amount of identification errors per 1,000 searches, with only three.

The NIST studies pose some problems when drilling down. NIST not only conducted a general per 1,000 test, but also tested multiracial data sets, and this time per 100. Here, all companies suffered. While NeoFace still outdid the competition by three times the accuracy, it still could only manage four per 100 searches. Per 1,000, this is 40, so it is quite a bit higher than that much sexier figure of three per 1,000. 

The problem only gets worse when one factors in face angles in images. Because mugshots or other standard ID photos are often the images that are stored in the massive database of photos called the image warehouse, it is important to adjust for the wide array of face angles that might be captured by surveillance video or other photo or video devices. In this test NeoFace managed 12 per 100, or 120 per 1,000.

Another trick used by NeoFace is what NEC calls the Perturbation Space Method. This converts 2D images to 3D to account for lighting and face angles, creating a higher chance that the “faceprint” will be positively matched with an image in the digital photo warehouse. It also can use Adaptive Regional Blend Matching to adjust for blinking, glasses, beards, and facial expressions that can lead to identification errors.

It isn’t just the actual image identification that CADOJ was paying for—NeoFace links with Integra-ID, NEC’s data repository system. Using meta-search engines that search query third-party search engines, Integra-ID can link NeoFace with criminal justice partners (i.e. local, state, and potentially federal law enforcement) and other public safety agencies.

This obviously increases the reach of the system by a great degree. Within the system, users can perform demographic searches for originating agency, date of arrest, date of birth, gender, race,  height, weight, eye-color, hair color, and arrest charge code. Users can also search for identifiers like booking ID, security IDs, local IDs and event numbers.

Integra-ID has advanced integration and segregation capabilities. Not only can it import and export photo databases to other agencies, it can create photo lineups, categories of images, and even segregate the data geographically, which is where the surveillance aspect starts to come in, particularly when Integra-ID can also add people to “watch/track” lists. All of this can be done in real time as photos are imported to the image warehouse. As soon as an image is uploaded one can begin the identification process and begin to categorize and segregate the image. NEC likens the product to a filing cabinet, with different drawers and folders to instantly begin working with. 

Read more: British Cops Will Scan Every Fan’s Face at the Champions League Final

However, this analogy fails where filing cabinets don’t automatically generate reports about the data being collected, putting it in any format or for any goal that a user would like. Filing cabinets also don’t have customizable graphical user interfaces, if we’re nitpicking.

Some of the technical requirements CADOJ asked NEC to incorporate indicate the company has plans to use the system more or less constantly. Integra-ID can do one-and-a-half million daily NeoFace transactions. Furthermore, the system can withstand more than 500 concurrent users alone for CADOJ. NEC made sure encryption on all data sharing was included as well, and that the system came with resistance to denial-of-service attacks. There is also intensive system auditing of user history.

The agreement included 24-hour, seven-days-a-week support and stipulated NEC support personnel could be at CADOJ headquarters in less than four hours in the event of a system-wide shut down.

We know that CADOJ purchased a powerful new facial recognition system, capable of pretty much everything a law enforcement agency could ever dream of. What we don’t know yet is how California is using this tech, how effective it actually is, and whether the efficacy justifies an almost two million dollar price tag. That the program becomes far more error prone when exposed to multiracial data sets is also extremely troubling. We simply need more information, and a more transparent dialogue with police to see if this sort of surveillance system really is necessary for keeping people safe.

Read the full manual embedded below, or on the request page.

This story was originally published on MuckRock and is reproduced here with permission.