How San Diego's City Records Ended Up Drowning in Duplicate Images — and What It's Costing Taxpayers

San Diego's city government is sitting on hundreds of thousands of duplicate digital images scattered across at least a dozen municipal databases — a problem years in the making that has quietly inflated storage costs, slowed public records requests, and complicated efforts to modernize the city's infrastructure planning systems.

The issue matters now because the City of San Diego is midway through a broader digital transformation push tied to its Smart City SD initiative, which targets tighter data management across departments ranging from the Development Services Department on Kearny Villa Road to the City Clerk's Office downtown on West Broadway. Duplicate images — scanned permits, engineering drawings, property photos, and zoning maps — clog those systems and make accurate retrieval unreliable.

A Problem Built Over Decades

The duplication problem did not appear overnight. It traces back to the mid-2000s, when individual city departments began digitizing paper records independently, without a unified protocol. The Development Services Department scanned building permits one way. The City Treasurer's Office scanned financial records another way. The San Diego Public Library system, which manages its own document archives across 36 branch locations, used a third vendor and a third file-naming convention.

By the time the city attempted to consolidate records under a shared enterprise content management platform around 2015, the damage was largely done. Files migrated in bulk brought their duplicates with them. The 2018 rollout of an updated permitting portal — meant to streamline applications for contractors working on projects from Barrio Logan to Carmel Valley — added another layer of redundancy when legacy records were imported alongside new ones without deduplication screening.

Staff at the Development Services Department have historically processed thousands of permit applications annually, and each application can generate multiple image attachments: site plans, elevations, structural drawings, inspection photographs. When those attachments get saved at intake, again at review, and again at close-out, the same file can exist three or four times inside the same case folder.

The Real Cost of Redundant Files

Cloud storage is not free. San Diego's Information Technology Department, based in the Civic Center Plaza complex, moved a significant portion of city data to cloud infrastructure between 2020 and 2023 as part of a cost-efficiency drive. But cloud contracts typically price storage by the gigabyte or terabyte, meaning every duplicate image is a recurring line item. City budget documents for fiscal year 2025-26 show the IT department's total operating budget at roughly $97 million, with external hosting and software licensing representing a growing share of that figure.

Independent government technology analysts — not affiliated with San Diego — have documented that duplicate file ratios in municipal systems frequently run between 20 and 40 percent of total stored data. If San Diego's archives reflect even the lower end of that range, the city may be paying to store tens of millions of redundant files.

The problem also directly affects residents. When a homeowner in North Park files a public records request for the permit history on their 1940s bungalow, city staff must manually sort through multiple versions of the same scanned document to confirm which is authoritative. That takes time. The City Clerk's office is legally required to respond to California Public Records Act requests within 10 days, and duplicate-heavy archives make that deadline harder to meet consistently.

Efforts to address the backlog are now formalized. The city's Digital Equity and Services division has begun coordinating with department heads on a deduplication pilot that targets the Development Services archive first, given its volume and public-facing importance. The pilot is expected to run through the end of calendar year 2026.

For residents and contractors who interact regularly with city systems — submitting plans for additions in Hillcrest, pulling encroachment permits in Mission Hills, or tracking inspection timelines in Chula Vista — the practical advice is straightforward: keep your own copies of submitted documents and confirmation receipts. Until the city completes its cleanup, relying solely on retrieved city files carries a small but real risk of pulling an outdated or incomplete version of a record.