Vector Search Benchmarks with Encryption

EngineP95 (ms)P99 (ms)RPSBase → Enc PrecP99+Enc (ms)
Qdrant4.958.6212380.99 → 0.958.62
Weaviate7.1611.3311420.97 → 0.9311.33
Elasticsearch72.53135.687160.98 → 0.94135.68
Redis160.85167.356250.97 → 0.93167.35
Milvus441.32576.652190.99 → 0.95576.65

Key Findings

Encryption Overhead

  • Vector encryption: 0.0018432 ms per operation (1536D)
  • Total dataset encryption: 1.8432s (1M vectors)
  • Minimal impact: 0.037% overhead on fastest engine

Precision Analysis

  • Consistent 0.04 precision drop across engines
  • Ranking tiers maintained:
    • Tier 1 (0.95): Qdrant, Milvus
    • Tier 2 (0.94): Elasticsearch
    • Tier 3 (0.93): Weaviate, Redis

Technical Notes

  • Encryption cost: 0.0000012 ms per dimension
  • P99 latencies include worst-case encryption overhead
  • Higher dimensions increase encryption time linearly
  • A detailed benchmark will be open sourced in Q1.
  • Baseline metrics: Qdrant Benchmarks
  • Mirror SDK: All telemetry disabled
  • Dataset encryption is one-time indexing cost

Methodology

  1. Base metrics sourced from standard vector search benchmarks
  2. Encryption overhead measured independently
  3. Combined metrics represent worst-case scenarios
  4. All tests run on dbpedia-openai-1M-1536-angular dataset
  5. Precision measured against non-encrypted ground truth
  6. RPS calculated under sustained load conditions