San Diego Is Quietly Leading the U.S. on Duplicate Image Replacement — but Other Cities Are Moving Faster

San Diego's city IT division has been working since early 2025 to systematically identify and replace duplicate images embedded across its public-facing digital platforms — from Development Services Department permit portals on First Avenue to the park-locator maps managed through the Parks and Recreation office in Balboa Park. The effort, part of a broader digital asset management overhaul, has cleared more than 14,000 redundant image files from the city's content management systems, according to internal progress reports reviewed by The Daily San Diego.

The timing matters. Cities from Amsterdam to Nairobi are under pressure to streamline bloated digital infrastructures as the volume of publicly held visual data has grown exponentially. In San Diego, the problem became acute after the 2022 consolidation of several legacy planning databases into a unified platform — a migration that created thousands of image duplicates clogging search results and slowing page-load times on sites that residents depend on for permit searches, zoning maps, and neighborhood project updates.

What San Diego Has Done — and Where the Gaps Are

The city's approach relies on a two-phase process. The first phase, completed in March 2026, used automated hashing software to flag visually identical files. The second phase — still underway — requires human review of near-duplicate images that differ only slightly in resolution or metadata. That manual step is proving slow. As of June 30, roughly 4,200 near-duplicate images remain unresolved in the Development Services portal alone, according to the same internal reports.

The San Diego Public Library's digital branch, which maintains neighborhood history photo archives for communities including Barrio Logan, City Heights, and North Park, launched its own parallel deduplication project in January 2026. Library staff are using open-source tools to cross-reference scanned historical images against the California Digital Library's shared repository, a process that has already prevented several hundred duplicate uploads to the statewide archive. The library's digital collections team set a target of completing the project by September 30, 2026.

Contrast that with what Amsterdam has managed. The Dutch capital's municipal archive — the Stadsarchief Amsterdam — completed a full deduplication sweep of its 800,000-image public collection in 2024, deploying AI-assisted tools that cut processing time by roughly 60 percent compared to manual review, according to a published case study from the International Council on Archives. Nairobi's City Hall, working with a UN-Habitat digitisation grant, cleared duplicate mapping imagery from its urban planning portal in under eight months in 2025.

Cost and What Comes Next

San Diego's effort carries a price tag. The city contracted with a local digital services firm in Sorrento Valley for phase-one software licensing at approximately $280,000 — a figure that the city's Office of the Chief Information Officer confirmed is within the originally budgeted range for fiscal year 2025-26. Phase two's manual review component was not separately costed in documents made publicly available, which has drawn questions from the City Council's Smart & Sustainable Communities committee during its May 14 hearing.

Residents who use the city's online services may notice improved load times on the Development Services permit search tool — page speeds have measurably improved in testing — though officials caution that the full performance benefit depends on completing the phase-two review. For now, some neighborhood planning groups in Kensington and Golden Hill have noted that image search results on the city's community plan pages still surface redundant files.

The city plans to publish a public dashboard on the progress of phase two by the end of July 2026, which would give residents and watchdog groups a clearer view of the timeline. If San Diego moves quickly on its remaining backlog, it could align with the pace set by comparable mid-size cities like Lisbon and Cape Town, both of which wrapped similar projects within 18 months of starting them. If the manual review drags past the fiscal year, the city risks carrying the cost into a 2026-27 budget that is already under pressure from infrastructure and housing commitments across the region.