Caching Strategies

<h2 id="caching-strategies-in-geode" class="position-relative d-flex align-items-center group"> Caching Strategies in Geode <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="caching-strategies-in-geode" aria-haspopup="dialog" aria-label="Share link: Caching Strategies in Geode"> Share link </button> </h2><div id="headingShareModal" class="heading-share-modal" role="dialog" aria-modal="true" aria-labelledby="headingShareTitle" hidden> <div class="hsm-dialog" role="document"> <div class="hsm-header"> <h2 id="headingShareTitle" class="h6 mb-0 fw-bold">Share this section</h2> <button type="button" class="hsm-close" aria-label="Close"> </button> </div> <div class="hsm-body"> <label for="headingShareInput" class="form-label small text-muted mb-1 text-uppercase fw-bold" style="font-size: 0.7rem; letter-spacing: 0.5px;">Permalink</label> <div class="input-group mb-4 hsm-url-group"> <input id="headingShareInput" type="text" class="form-control font-monospace" readonly aria-readonly="true" style="font-size: 0.85rem;" /> <button class="btn btn-primary hsm-copy" type="button" aria-label="Copy" title="Copy"> </button> </div> <div class="small fw-bold mb-2 text-muted text-uppercase" style="font-size: 0.7rem; letter-spacing: 0.5px;">Share via</div> <div class="hsm-share-grid"> <a id="share-twitter" class="btn btn-outline-secondary w-100" target="_blank" rel="noopener noreferrer"> Twitter </a> <a id="share-linkedin" class="btn btn-outline-secondary w-100" target="_blank" rel="noopener noreferrer"> LinkedIn </a> <a id="share-facebook" class="btn btn-outline-secondary w-100" target="_blank" rel="noopener noreferrer"> Facebook </a> </div> </div> </div> </div> <style> .heading-share-modal { position: fixed; inset: 0; display: flex; justify-content: center; align-items: center; background: rgba(0, 0, 0, 0.6); z-index: 1050; padding: 1rem; backdrop-filter: blur(4px); -webkit-backdrop-filter: blur(4px); } .heading-share-modal[hidden] { display: none !important; } .hsm-dialog { max-width: 420px; width: 100%; background: var(--bs-body-bg, #fff); color: var(--bs-body-color, #212529); border: 1px solid var(--bs-border-color, rgba(0,0,0,0.1)); border-radius: 1rem; box-shadow: 0 25px 50px -12px rgba(0, 0, 0, 0.25); overflow: hidden; animation: hsm-fade-in 0.2s ease-out; } @keyframes hsm-fade-in { from { opacity: 0; transform: scale(0.95); } to { opacity: 1; transform: scale(1); } } [data-bs-theme="dark"] .hsm-dialog { background: #1e293b; border-color: rgba(255,255,255,0.1); color: #f8f9fa; } .hsm-header { display: flex; justify-content: space-between; align-items: center; padding: 1rem 1.5rem; border-bottom: 1px solid var(--bs-border-color, rgba(0,0,0,0.1)); background: rgba(0,0,0,0.02); } [data-bs-theme="dark"] .hsm-header { background: rgba(255,255,255,0.02); border-color: rgba(255,255,255,0.1); } .hsm-close { background: transparent; border: none; color: inherit; opacity: 0.5; padding: 0.25rem 0.5rem; border-radius: 0.25rem; font-size: 1.2rem; line-height: 1; transition: opacity 0.2s; } .hsm-close:hover { opacity: 1; } .hsm-body { padding: 1.5rem; } .hsm-url-group { display: flex !important; align-items: stretch; } .hsm-url-group .form-control { flex: 1; min-width: 0; margin: 0; background: var(--bs-secondary-bg, #f8f9fa); border-color: var(--bs-border-color, #dee2e6); border-top-right-radius: 0; border-bottom-right-radius: 0; height: 42px; } .hsm-url-group .btn { flex: 0 0 auto; margin: 0; margin-left: -1px; border-top-left-radius: 0; border-bottom-left-radius: 0; height: 42px; display: flex; align-items: center; justify-content: center; padding: 0 1.25rem; z-index: 2; } [data-bs-theme="dark"] .hsm-url-group .form-control { background: #0f172a; border-color: #334155; color: #e2e8f0; } .hsm-share-grid { display: flex; flex-direction: column; gap: 0.5rem; } .hsm-share-grid .btn { display: flex; align-items: center; justify-content: center; font-size: 0.9rem; padding: 0.6rem; border-color: var(--bs-border-color); width: 100%; } [data-bs-theme="dark"] .hsm-share-grid .btn { color: #e2e8f0; border-color: #475569; } [data-bs-theme="dark"] .hsm-share-grid .btn:hover { background: #334155; border-color: #cbd5e1; } </style> <script> (function(){ const modal = document.getElementById('headingShareModal'); if(!modal) return; const input = modal.querySelector('#headingShareInput'); const copyBtn = modal.querySelector('.hsm-copy'); const twitter = modal.querySelector('#share-twitter'); const linkedin = modal.querySelector('#share-linkedin'); const facebook = modal.querySelector('#share-facebook'); const closeBtn = modal.querySelector('.hsm-close'); let lastFocus=null; let trapBound=false; function buildUrl(id){ return window.location.origin + window.location.pathname + '#' + id; } function isOpen(){ return !modal.hasAttribute('hidden'); } function hydrate(id){ const url=buildUrl(id); input.value=url; const enc=encodeURIComponent(url); const text=encodeURIComponent(document.title); if(twitter) twitter.href=`https://twitter.com/intent/tweet?url=${enc}&text=${text}`; if(linkedin) linkedin.href=`https://www.linkedin.com/sharing/share-offsite/?url=${enc}`; if(facebook) facebook.href=`https://www.facebook.com/sharer/sharer.php?u=${enc}`; } function openModal(id){ lastFocus=document.activeElement; hydrate(id); if(!isOpen()){ modal.removeAttribute('hidden'); } requestAnimationFrame(()=>{ input.focus(); }); trapFocus(); } function closeModal(){ if(!isOpen()) return; modal.setAttribute('hidden',''); if(lastFocus && typeof lastFocus.focus==='function') lastFocus.focus(); } function copyCurrent(){ try{ navigator.clipboard.writeText(input.value).then(()=>feedback(true),()=>fallback()); } catch(e){ fallback(); } } function fallback(){ input.select(); try{ document.execCommand('copy'); feedback(true);}catch(e){ feedback(false);} } function feedback(ok){ if(!copyBtn) return; const icon=copyBtn.querySelector('i'); if(!icon) return; const prev=copyBtn.getAttribute('data-prev')||icon.className; if(!copyBtn.getAttribute('data-prev')) copyBtn.setAttribute('data-prev',prev); icon.className= ok ? 'fa-duotone fa-clipboard-check':'fa-duotone fa-circle-exclamation'; setTimeout(()=>{ icon.className=prev; },1800); } function handleShareClick(e){ e.preventDefault(); const btn=e.currentTarget; const id=btn.getAttribute('data-share-target'); if(id) openModal(id); } function bindShareButtons(){ document.querySelectorAll('.h-share').forEach(btn=>{ if(!btn.dataset.hShareBound){ btn.addEventListener('click', handleShareClick); btn.dataset.hShareBound='1'; } }); } bindShareButtons(); if(document.readyState==='loading'){ document.addEventListener('DOMContentLoaded', bindShareButtons); } else { requestAnimationFrame(bindShareButtons); } document.addEventListener('click', function(e){ const shareBtn=e.target.closest && e.target.closest('.h-share'); if(shareBtn && !shareBtn.dataset.hShareBound){ handleShareClick.call(shareBtn, e); } }, true); document.addEventListener('click', e=>{ if(e.target===modal) closeModal(); if(e.target.closest && e.target.closest('.hsm-close')){ e.preventDefault(); closeModal(); } if(copyBtn && (e.target===copyBtn || (e.target.closest && e.target.closest('.hsm-copy')))) { e.preventDefault(); copyCurrent(); } }); document.addEventListener('keydown', e=>{ if(e.key==='Escape' && isOpen()) closeModal(); }); function trapFocus(){ if(trapBound) return; trapBound=true; modal.addEventListener('keydown', f=>{ if(f.key==='Tab' && isOpen()){ const focusable=[...modal.querySelectorAll('a[href],button,input,textarea,select,[tabindex]:not([tabindex="-1"])')].filter(el=>!el.hasAttribute('disabled')); if(!focusable.length) return; const first=focusable[0]; const last=focusable[focusable.length-1]; if(f.shiftKey && document.activeElement===first){ f.preventDefault(); last.focus(); } else if(!f.shiftKey && document.activeElement===last){ f.preventDefault(); first.focus(); } } }); } if(closeBtn) closeBtn.addEventListener('click', e=>{ e.preventDefault(); closeModal(); }); })(); </script>Caching is fundamental to database performance, reducing latency by avoiding repeated computation and I/O. Geode implements a sophisticated multi-layer caching architecture that optimizes performance at every level, from query planning to data retrieval. Understanding and properly configuring these caches can dramatically improve application performance. This guide explores Geode’s caching mechanisms, configuration options, and best practices for achieving optimal cache efficiency. <h3 id="caching-architecture-overview" class="position-relative d-flex align-items-center group"> Caching Architecture Overview <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="caching-architecture-overview" aria-haspopup="dialog" aria-label="Share link: Caching Architecture Overview"> Share link </button> </h3> <h4 id="multi-layer-cache-hierarchy" class="position-relative d-flex align-items-center group"> Multi-Layer Cache Hierarchy <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="multi-layer-cache-hierarchy" aria-haspopup="dialog" aria-label="Share link: Multi-Layer Cache Hierarchy"> Share link </button> </h4>Geode implements caching at multiple levels: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-fallback" data-lang="fallback">┌─────────────────────────────────────────────────────────────┐ │ Application Layer │ │ (Client-side caching, connection pooling) │ └──────────────────────────┬──────────────────────────────────┘ │ ┌──────────────────────────▼──────────────────────────────────┐ │ Query Result Cache │ │ (Complete query result memoization) │ └──────────────────────────┬──────────────────────────────────┘ │ ┌──────────────────────────▼──────────────────────────────────┐ │ Query Plan Cache │ │ (Compiled execution plans) │ └──────────────────────────┬──────────────────────────────────┘ │ ┌──────────────────────────▼──────────────────────────────────┐ │ Metadata Cache │ │ (Schema, statistics, indexes) │ └──────────────────────────┬──────────────────────────────────┘ │ ┌──────────────────────────▼──────────────────────────────────┐ │ Buffer Pool │ │ (Data and index pages) │ └──────────────────────────┬──────────────────────────────────┘ │ ┌──────────────────────────▼──────────────────────────────────┐ │ OS Page Cache │ │ (File system cache) │ └─────────────────────────────────────────────────────────────┘ </code></pre></div> <h4 id="cache-hit-flow" class="position-relative d-flex align-items-center group"> Cache Hit Flow <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cache-hit-flow" aria-haspopup="dialog" aria-label="Share link: Cache Hit Flow"> Share link </button> </h4>When a query executes, Geode checks caches top-down: <ol> <li>Result Cache: Return cached result if exact query matches</li> <li>Plan Cache: Use cached execution plan if available</li> <li>Metadata Cache: Use cached schema and statistics</li> <li>Buffer Pool: Return cached page if in memory</li> <li>OS Cache: Read from OS file cache if available</li> <li>Disk: Read from disk (slowest path)</li> </ol> <h3 id="query-result-cache" class="position-relative d-flex align-items-center group"> Query Result Cache <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="query-result-cache" aria-haspopup="dialog" aria-label="Share link: Query Result Cache"> Share link </button> </h3> <h4 id="how-it-works" class="position-relative d-flex align-items-center group"> How It Works <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="how-it-works" aria-haspopup="dialog" aria-label="Share link: How It Works"> Share link </button> </h4>The query result cache stores complete results for parameterized queries: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- First execution: cache miss, full execution MATCH (u:User {id: $id}) RETURN u.name, u.email; -- Time: 5ms -- Subsequent executions with same parameters: cache hit MATCH (u:User {id: $id}) -- Same query, same $id value RETURN u.name, u.email; -- Time: 0.1ms (from cache) </code></pre></div> <h4 id="configuration" class="position-relative d-flex align-items-center group"> Configuration <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="configuration" aria-haspopup="dialog" aria-label="Share link: Configuration"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-toml" data-lang="toml">[cache.query_result] enabled = true # Cache size limits max_size_mb = 512 max_entries = 10000 max_entry_size_kb = 1024 # Skip caching large results # Eviction policy eviction_policy = "lru" # lru, lfu, or ttl ttl_seconds = 300 # Time-to-live # Cache key settings include_user_context = true # Different cache per user include_transaction_context = false </code></pre></div> <h4 id="cache-invalidation" class="position-relative d-flex align-items-center group"> Cache Invalidation <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cache-invalidation" aria-haspopup="dialog" aria-label="Share link: Cache Invalidation"> Share link </button> </h4>Query cache entries are invalidated when underlying data changes: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-toml" data-lang="toml">[cache.query_result.invalidation] # Invalidation strategy strategy = "fine_grained" # fine_grained, table_level, or time_based # Fine-grained tracking track_dependencies = true max_tracked_entries = 100000 # Time-based fallback max_staleness_ms = 1000 </code></pre></div>Manual Cache Control: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Bypass cache for fresh results MATCH (u:User {id: $id}) RETURN u.name OPTION (NO_CACHE); -- Force cache refresh MATCH (u:User {id: $id}) RETURN u.name OPTION (REFRESH_CACHE); -- Clear all query cache CALL system.clear_query_cache(); -- Clear cache for specific query pattern CALL system.clear_query_cache('MATCH (u:User%)'); </code></pre></div> <h4 id="monitoring-query-cache" class="position-relative d-flex align-items-center group"> Monitoring Query Cache <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="monitoring-query-cache" aria-haspopup="dialog" aria-label="Share link: Monitoring Query Cache"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Query cache statistics SELECT total_entries, size_mb, hit_count, miss_count, hit_ratio, eviction_count, invalidation_count FROM system.query_cache_stats; -- Top cached queries SELECT query_hash, query_text, execution_count, cache_hits, hit_ratio, avg_result_size_kb FROM system.cached_queries ORDER BY cache_hits DESC LIMIT 20; </code></pre></div> <h3 id="query-plan-cache" class="position-relative d-flex align-items-center group"> Query Plan Cache <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="query-plan-cache" aria-haspopup="dialog" aria-label="Share link: Query Plan Cache"> Share link </button> </h3> <h4 id="plan-caching-mechanism" class="position-relative d-flex align-items-center group"> Plan Caching Mechanism <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="plan-caching-mechanism" aria-haspopup="dialog" aria-label="Share link: Plan Caching Mechanism"> Share link </button> </h4>Compiled execution plans are cached to avoid repeated parsing and optimization: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-fallback" data-lang="fallback">Query Processing Pipeline: ┌─────────┐ ┌─────────┐ ┌───────────┐ ┌─────────┐ │ Parse │───>│Validate │───>│ Optimize │───>│ Execute │ └─────────┘ └─────────┘ └───────────┘ └─────────┘ │ │ │ └──────────────┴───────────────┘ Plan Cache (Skip on cache hit) </code></pre></div> <h4 id="configuration-1" class="position-relative d-flex align-items-center group"> Configuration <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="configuration-1" aria-haspopup="dialog" aria-label="Share link: Configuration"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-toml" data-lang="toml">[cache.query_plan] enabled = true # Cache size max_entries = 5000 max_plan_size_kb = 64 # Plan lifetime revalidation_interval_seconds = 3600 statistics_sensitivity = 0.2 # Replan if stats change >20% # Parameterization auto_parameterize = true parameterization_threshold = 3 # Queries seen before parameterizing </code></pre></div> <h4 id="prepared-statements" class="position-relative d-flex align-items-center group"> Prepared Statements <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="prepared-statements" aria-haspopup="dialog" aria-label="Share link: Prepared Statements"> Share link </button> </h4>Prepared statements maximize plan cache efficiency: Python Client: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-python" data-lang="python">from geode_client import Client async def efficient_queries(): client = Client(host="localhost", port=3141) async with client.connection() as conn: # Prepare statement once stmt = await conn.prepare(""" MATCH (u:User {id: $id})-[:PURCHASED]->(p:Product) RETURN p.name, p.price """) # Execute multiple times with different parameters for user_id in user_ids: result, _ = await conn.execute_prepared(stmt, {"id": user_id}) # Uses cached plan every time </code></pre></div>Go Client: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-go" data-lang="go">import ( "database/sql" _ "geodedb.com/geode" ) func efficientQueries(db *sql.DB, userIDs []string) { // Prepare statement stmt, err := db.Prepare(` MATCH (u:User {id: $1})-[:PURCHASED]->(p:Product) RETURN p.name, p.price `) if err != nil { log.Fatal(err) } defer stmt.Close() // Execute with different parameters for _, userID := range userIDs { rows, err := stmt.Query(userID) // Uses cached plan } } </code></pre></div> <h4 id="monitoring-plan-cache" class="position-relative d-flex align-items-center group"> Monitoring Plan Cache <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="monitoring-plan-cache" aria-haspopup="dialog" aria-label="Share link: Monitoring Plan Cache"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Plan cache statistics SELECT total_entries, size_mb, hit_count, miss_count, hit_ratio, eviction_count, recompilation_count FROM system.plan_cache_stats; -- View cached plans SELECT plan_hash, query_pattern, execution_count, avg_planning_time_ms, avg_execution_time_ms, last_used FROM system.cached_plans ORDER BY execution_count DESC LIMIT 20; -- Clear plan cache CALL system.clear_plan_cache(); </code></pre></div> <h3 id="buffer-pool-cache" class="position-relative d-flex align-items-center group"> Buffer Pool Cache <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="buffer-pool-cache" aria-haspopup="dialog" aria-label="Share link: Buffer Pool Cache"> Share link </button> </h3> <h4 id="memory-management" class="position-relative d-flex align-items-center group"> Memory Management <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="memory-management" aria-haspopup="dialog" aria-label="Share link: Memory Management"> Share link </button> </h4>The buffer pool caches data and index pages in memory: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-toml" data-lang="toml">[cache.buffer_pool] # Total size size_mb = 8192 # 8 GB # Allocation data_percent = 70 # Data pages index_percent = 25 # Index pages temp_percent = 5 # Temporary operations # Eviction eviction_policy = "lru-k" k = 2 # Track last K accesses # Background writer background_writer_enabled = true background_writer_interval_ms = 100 dirty_page_threshold = 0.25 </code></pre></div> <h4 id="page-warming" class="position-relative d-flex align-items-center group"> Page Warming <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="page-warming" aria-haspopup="dialog" aria-label="Share link: Page Warming"> Share link </button> </h4>Preload frequently accessed data on startup: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-toml" data-lang="toml">[cache.buffer_pool.warming] enabled = true # Warming strategy strategy = "previous_state" # previous_state, explicit, or none # Previous state: restore pages from last shutdown restore_file = "/var/lib/geode/buffer_state.dat" # Explicit warming queries warming_queries = [ "MATCH (u:User) RETURN count(u)", "MATCH (p:Product) WHERE p.active = true RETURN count(p)" ] </code></pre></div>Manual Warming: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Warm specific table into buffer pool CALL system.warm_table('User'); -- Warm index CALL system.warm_index('user_email_idx'); -- Check warming progress SELECT table_name, pages_loaded, pages_total, percent_complete FROM system.warming_status; </code></pre></div> <h4 id="monitoring-buffer-pool" class="position-relative d-flex align-items-center group"> Monitoring Buffer Pool <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="monitoring-buffer-pool" aria-haspopup="dialog" aria-label="Share link: Monitoring Buffer Pool"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Buffer pool statistics SELECT total_pages, used_pages, dirty_pages, free_pages, hit_count, miss_count, hit_ratio, evictions_total FROM system.buffer_pool_stats; -- Buffer usage by table SELECT table_name, cached_pages, cached_mb, dirty_pages, access_count, hit_ratio FROM system.buffer_usage_by_table ORDER BY cached_mb DESC; -- Buffer usage by index SELECT index_name, cached_pages, cached_mb, hit_ratio FROM system.buffer_usage_by_index ORDER BY cached_mb DESC; </code></pre></div> <h3 id="metadata-cache" class="position-relative d-flex align-items-center group"> Metadata Cache <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="metadata-cache" aria-haspopup="dialog" aria-label="Share link: Metadata Cache"> Share link </button> </h3> <h4 id="schema-and-statistics-caching" class="position-relative d-flex align-items-center group"> Schema and Statistics Caching <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="schema-and-statistics-caching" aria-haspopup="dialog" aria-label="Share link: Schema and Statistics Caching"> Share link </button> </h4>Geode caches schema information and query statistics: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-toml" data-lang="toml">[cache.metadata] enabled = true # Schema cache schema_cache_size = 1000 # Entries schema_refresh_interval_seconds = 60 # Statistics cache statistics_cache_size = 10000 statistics_refresh_interval_seconds = 300 auto_analyze_threshold = 0.1 # 10% data change triggers refresh </code></pre></div> <h4 id="statistics-refresh" class="position-relative d-flex align-items-center group"> Statistics Refresh <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="statistics-refresh" aria-haspopup="dialog" aria-label="Share link: Statistics Refresh"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Refresh statistics for a table ANALYZE User; -- Refresh all statistics ANALYZE; -- View cached statistics SELECT table_name, row_count, distinct_values, null_fraction, avg_width, last_analyzed FROM system.table_statistics; -- Column statistics SELECT table_name, column_name, n_distinct, most_common_values, histogram_bounds FROM system.column_statistics WHERE table_name = 'User'; </code></pre></div> <h3 id="distributed-caching" class="position-relative d-flex align-items-center group"> Distributed Caching <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="distributed-caching" aria-haspopup="dialog" aria-label="Share link: Distributed Caching"> Share link </button> </h3> <h4 id="cache-coordination-in-clusters" class="position-relative d-flex align-items-center group"> Cache Coordination in Clusters <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cache-coordination-in-clusters" aria-haspopup="dialog" aria-label="Share link: Cache Coordination in Clusters"> Share link </button> </h4>In distributed deployments, Geode coordinates caches across nodes: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-toml" data-lang="toml">[cache.distributed] enabled = true # Cache coherence protocol coherence = "invalidate" # invalidate or update # Coordination coordinator = "leader" # leader or gossip invalidation_delay_ms = 10 # Local cache settings local_result_cache_mb = 256 local_plan_cache_entries = 1000 </code></pre></div> <h4 id="cache-invalidation-propagation" class="position-relative d-flex align-items-center group"> Cache Invalidation Propagation <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cache-invalidation-propagation" aria-haspopup="dialog" aria-label="Share link: Cache Invalidation Propagation"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-fallback" data-lang="fallback">Write on Node 1: ┌──────────┐ │ Node 1 │───Write───> Data │ (Leader) │ └────┬─────┘ │ Invalidate ▼ ┌────────────────────────────────────┐ │ Invalidation Broadcast │ └────┬──────────────┬───────────────┘ │ │ ▼ ▼ ┌──────────┐ ┌──────────┐ │ Node 2 │ │ Node 3 │ │ Cache │ │ Cache │ │ Invalid │ │ Invalid │ └──────────┘ └──────────┘ </code></pre></div> <h4 id="monitoring-distributed-cache" class="position-relative d-flex align-items-center group"> Monitoring Distributed Cache <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="monitoring-distributed-cache" aria-haspopup="dialog" aria-label="Share link: Monitoring Distributed Cache"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Distributed cache statistics SELECT node_id, local_cache_size_mb, invalidations_received, invalidations_sent, cache_coherence_lag_ms FROM system.distributed_cache_stats; -- Cross-node cache coordination SELECT event_type, source_node, target_nodes, entries_invalidated, latency_ms FROM system.cache_coordination_log ORDER BY timestamp DESC LIMIT 20; </code></pre></div> <h3 id="application-level-caching" class="position-relative d-flex align-items-center group"> Application-Level Caching <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="application-level-caching" aria-haspopup="dialog" aria-label="Share link: Application-Level Caching"> Share link </button> </h3> <h4 id="client-side-caching-patterns" class="position-relative d-flex align-items-center group"> Client-Side Caching Patterns <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="client-side-caching-patterns" aria-haspopup="dialog" aria-label="Share link: Client-Side Caching Patterns"> Share link </button> </h4>Implement application-layer caching for frequently accessed data: Python with Redis: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-python" data-lang="python">import redis import json from geode_client import Client class CachedGeodeClient: def __init__(self, geode_host, redis_host): self.geode = Client(host=geode_host, port=3141) self.redis = redis.Redis(host=redis_host) async def get_user(self, user_id, ttl=300): """Get user with Redis caching""" cache_key = f"user:{user_id}" # Check cache cached = self.redis.get(cache_key) if cached: return json.loads(cached) # Query Geode async with self.geode.connection() as conn: result, _ = await conn.query( "MATCH (u:User {id: $id}) RETURN u", {"id": user_id} ) if result.rows: user = dict(result.rows[0]['u']) # Cache result self.redis.setex(cache_key, ttl, json.dumps(user)) return user return None async def update_user(self, user_id, properties): """Update user and invalidate cache""" async with self.geode.connection() as conn: await conn.execute( "MATCH (u:User {id: $id}) SET u += $props", {"id": user_id, "props": properties} ) # Invalidate cache self.redis.delete(f"user:{user_id}") </code></pre></div>Go with In-Memory Cache: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-go" data-lang="go">import ( "sync" "time" "database/sql" _ "geodedb.com/geode" ) type CacheEntry struct { Data map[string]interface{} ExpiresAt time.Time } type CachedClient struct { db *sql.DB cache sync.Map ttl time.Duration } func NewCachedClient(dsn string, ttl time.Duration) (*CachedClient, error) { db, err := sql.Open("geode", dsn) if err != nil { return nil, err } return &CachedClient{db: db, ttl: ttl}, nil } func (c *CachedClient) GetUser(userID string) (map[string]interface{}, error) { cacheKey := "user:" + userID // Check cache if entry, ok := c.cache.Load(cacheKey); ok { ce := entry.(CacheEntry) if time.Now().Before(ce.ExpiresAt) { return ce.Data, nil } c.cache.Delete(cacheKey) } // Query database row := c.db.QueryRow( "MATCH (u:User {id: $1}) RETURN u.name, u.email", userID, ) var name, email string if err := row.Scan(&name, &email); err != nil { return nil, err } // Cache result data := map[string]interface{}{"name": name, "email": email} c.cache.Store(cacheKey, CacheEntry{ Data: data, ExpiresAt: time.Now().Add(c.ttl), }) return data, nil } </code></pre></div> <h4 id="cache-aside-pattern" class="position-relative d-flex align-items-center group"> Cache-Aside Pattern <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cache-aside-pattern" aria-haspopup="dialog" aria-label="Share link: Cache-Aside Pattern"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-python" data-lang="python">async def get_user_friends(user_id): """Cache-aside pattern for friend list""" cache_key = f"friends:{user_id}" # 1. Try cache first cached = await redis.get(cache_key) if cached: return json.loads(cached) # 2. Cache miss - query database async with geode.connection() as conn: result, _ = await conn.query(""" MATCH (u:User {id: $id})-[:FRIENDS_WITH]-(friend) RETURN friend.id, friend.name """, {"id": user_id}) friends = [dict(r) for r in result.rows] # 3. Update cache await redis.setex(cache_key, 300, json.dumps(friends)) return friends </code></pre></div> <h4 id="write-through-pattern" class="position-relative d-flex align-items-center group"> Write-Through Pattern <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="write-through-pattern" aria-haspopup="dialog" aria-label="Share link: Write-Through Pattern"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-python" data-lang="python">async def add_friend(user_id, friend_id): """Write-through: update cache on write""" async with geode.connection() as conn: # 1. Write to database await conn.execute(""" MATCH (u:User {id: $uid}), (f:User {id: $fid}) CREATE (u)-[:FRIENDS_WITH]->(f) """, {"uid": user_id, "fid": friend_id}) # 2. Update cache (or invalidate) cache_key = f"friends:{user_id}" # Option A: Invalidate await redis.delete(cache_key) # Option B: Update cache friends = await get_user_friends_from_db(user_id) await redis.setex(cache_key, 300, json.dumps(friends)) </code></pre></div> <h3 id="cache-tuning-and-optimization" class="position-relative d-flex align-items-center group"> Cache Tuning and Optimization <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cache-tuning-and-optimization" aria-haspopup="dialog" aria-label="Share link: Cache Tuning and Optimization"> Share link </button> </h3> <h4 id="sizing-guidelines" class="position-relative d-flex align-items-center group"> Sizing Guidelines <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="sizing-guidelines" aria-haspopup="dialog" aria-label="Share link: Sizing Guidelines"> Share link </button> </h4>Query Result Cache: <ul> <li>Size based on unique query patterns and result sizes</li> <li>Start with 256-512 MB for small deployments</li> <li>Scale to 1-4 GB for large deployments</li> </ul> Plan Cache: <ul> <li>Typically 2000-10000 entries sufficient</li> <li>Monitor miss rate; increase if >10%</li> </ul> Buffer Pool: <ul> <li>50-75% of available RAM</li> <li>Should hold working set for good hit ratio (>95%)</li> </ul> <h4 id="performance-tuning" class="position-relative d-flex align-items-center group"> Performance Tuning <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="performance-tuning" aria-haspopup="dialog" aria-label="Share link: Performance Tuning"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-toml" data-lang="toml"># High-performance caching configuration [cache] # Aggressive result caching for read-heavy workloads [cache.query_result] enabled = true max_size_mb = 2048 ttl_seconds = 600 eviction_policy = "lfu" # Favor frequently used # Large plan cache for complex applications [cache.query_plan] enabled = true max_entries = 10000 auto_parameterize = true # Buffer pool sized for working set [cache.buffer_pool] size_mb = 32768 # 32 GB eviction_policy = "lru-k" background_writer_enabled = true # Metadata refresh [cache.metadata] statistics_refresh_interval_seconds = 600 auto_analyze_threshold = 0.05 # More aggressive refresh </code></pre></div> <h4 id="cache-metrics-and-alerting" class="position-relative d-flex align-items-center group"> Cache Metrics and Alerting <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cache-metrics-and-alerting" aria-haspopup="dialog" aria-label="Share link: Cache Metrics and Alerting"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-yaml" data-lang="yaml"># Prometheus alerting rules groups: - name: geode_cache_alerts rules: - alert: QueryCacheHitRateLow expr: geode_query_cache_hit_ratio < 0.5 for: 10m labels: severity: warning annotations: summary: "Query cache hit rate below 50%" - alert: PlanCacheMissRateHigh expr: rate(geode_plan_cache_misses_total[5m]) / rate(geode_plan_cache_requests_total[5m]) > 0.1 for: 10m labels: severity: warning annotations: summary: "Plan cache miss rate above 10%" - alert: BufferPoolHitRateLow expr: geode_buffer_pool_hit_ratio < 0.95 for: 15m labels: severity: warning annotations: summary: "Buffer pool hit rate below 95%" - alert: CacheMemoryPressure expr: geode_cache_evictions_total > 1000 for: 5m labels: severity: info annotations: summary: "High cache eviction rate" </code></pre></div> <h3 id="best-practices" class="position-relative d-flex align-items-center group"> Best Practices <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="best-practices" aria-haspopup="dialog" aria-label="Share link: Best Practices"> Share link </button> </h3> <h4 id="general-guidelines" class="position-relative d-flex align-items-center group"> General Guidelines <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="general-guidelines" aria-haspopup="dialog" aria-label="Share link: General Guidelines"> Share link </button> </h4><ol> <li>Size caches appropriately: Monitor hit ratios and adjust sizes</li> <li>Use prepared statements: Maximize plan cache effectiveness</li> <li>Parameterize queries: Enable automatic parameterization</li> <li>Monitor invalidation: High invalidation rates may indicate issues</li> <li>Warm caches on startup: Reduce cold-start latency</li> </ol> <h4 id="query-result-cache-1" class="position-relative d-flex align-items-center group"> Query Result Cache <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="query-result-cache-1" aria-haspopup="dialog" aria-label="Share link: Query Result Cache"> Share link </button> </h4><ol> <li>Cache read-heavy queries: Greatest benefit for repeated reads</li> <li>Set appropriate TTL: Balance freshness vs. cache efficiency</li> <li>Exclude volatile data: Don’t cache rapidly changing results</li> <li>Use cache hints: Control caching per-query when needed</li> </ol> <h4 id="buffer-pool" class="position-relative d-flex align-items-center group"> Buffer Pool <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="buffer-pool" aria-haspopup="dialog" aria-label="Share link: Buffer Pool"> Share link </button> </h4><ol> <li>Size for working set: Hit ratio >95% is target</li> <li>Enable background writer: Smooth I/O patterns</li> <li>Monitor dirty pages: Keep below threshold</li> <li>Use page warming: Reduce cold-start impact</li> </ol> <h4 id="distributed-caching-1" class="position-relative d-flex align-items-center group"> Distributed Caching <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="distributed-caching-1" aria-haspopup="dialog" aria-label="Share link: Distributed Caching"> Share link </button> </h4><ol> <li>Choose coherence strategy: Invalidate for consistency, update for performance</li> <li>Monitor coordination lag: Alert on high latency</li> <li>Consider local caches: Reduce cross-node traffic</li> </ol> <h3 id="related-topics" class="position-relative d-flex align-items-center group"> Related Topics <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="related-topics" aria-haspopup="dialog" aria-label="Share link: Related Topics"> Share link </button> </h3><ul> <li><a href="/tags/performance/" >Performance</a> - Performance optimization</li> <li><a href="/tags/query-optimization/" >Query Optimization</a> - Query tuning</li> <li><a href="/tags/storage/" >Storage</a> - Storage engine details</li> <li><a href="/tags/monitoring/" >Monitoring</a> - Cache monitoring</li> <li><a href="/tags/configuration/" >Configuration</a> - Server configuration</li> <li><a href="/tags/indexing/" >Indexing</a> - Index management</li> </ul> <h3 id="further-reading" class="position-relative d-flex align-items-center group"> Further Reading <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="further-reading" aria-haspopup="dialog" aria-label="Share link: Further Reading"> Share link </button> </h3><ul> <li>Cache Configuration Deep Dive</li> <li>Query Result Cache Tuning</li> <li>Buffer Pool Optimization Guide</li> <li>Distributed Cache Architecture</li> <li>Application Caching Patterns</li> <li>Cache Monitoring Dashboard Setup</li> </ul>

Popular

Related Articles