Data Integrity & Consistency

Data integrity and consistency are fundamental to reliable database systems. Geode provides comprehensive mechanisms to ensure your graph data remains accurate, valid, and consistent through ACID transactions, schema constraints, validation rules, and automated integrity checks. <h3 id="data-integrity-fundamentals" class="position-relative d-flex align-items-center group"> Data Integrity Fundamentals <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="data-integrity-fundamentals" aria-haspopup="dialog" aria-label="Share link: Data Integrity Fundamentals"> Share link </button> </h3><div id="headingShareModal" class="heading-share-modal" role="dialog" aria-modal="true" aria-labelledby="headingShareTitle" hidden> <div class="hsm-dialog" role="document"> <div class="hsm-header"> <h2 id="headingShareTitle" class="h6 mb-0 fw-bold">Share this section</h2> <button type="button" class="hsm-close" aria-label="Close"> </button> </div> <div class="hsm-body"> <label for="headingShareInput" class="form-label small text-muted mb-1 text-uppercase fw-bold" style="font-size: 0.7rem; letter-spacing: 0.5px;">Permalink</label> <div class="input-group mb-4 hsm-url-group"> <input id="headingShareInput" type="text" class="form-control font-monospace" readonly aria-readonly="true" style="font-size: 0.85rem;" /> <button class="btn btn-primary hsm-copy" type="button" aria-label="Copy" title="Copy"> </button> </div> <div class="small fw-bold mb-2 text-muted text-uppercase" style="font-size: 0.7rem; letter-spacing: 0.5px;">Share via</div> <div class="hsm-share-grid"> <a id="share-twitter" class="btn btn-outline-secondary w-100" target="_blank" rel="noopener noreferrer"> Twitter </a> <a id="share-linkedin" class="btn btn-outline-secondary w-100" target="_blank" rel="noopener noreferrer"> LinkedIn </a> <a id="share-facebook" class="btn btn-outline-secondary w-100" target="_blank" rel="noopener noreferrer"> Facebook </a> </div> </div> </div> </div> <style> .heading-share-modal { position: fixed; inset: 0; display: flex; justify-content: center; align-items: center; background: rgba(0, 0, 0, 0.6); z-index: 1050; padding: 1rem; backdrop-filter: blur(4px); -webkit-backdrop-filter: blur(4px); } .heading-share-modal[hidden] { display: none !important; } .hsm-dialog { max-width: 420px; width: 100%; background: var(--bs-body-bg, #fff); color: var(--bs-body-color, #212529); border: 1px solid var(--bs-border-color, rgba(0,0,0,0.1)); border-radius: 1rem; box-shadow: 0 25px 50px -12px rgba(0, 0, 0, 0.25); overflow: hidden; animation: hsm-fade-in 0.2s ease-out; } @keyframes hsm-fade-in { from { opacity: 0; transform: scale(0.95); } to { opacity: 1; transform: scale(1); } } [data-bs-theme="dark"] .hsm-dialog { background: #1e293b; border-color: rgba(255,255,255,0.1); color: #f8f9fa; } .hsm-header { display: flex; justify-content: space-between; align-items: center; padding: 1rem 1.5rem; border-bottom: 1px solid var(--bs-border-color, rgba(0,0,0,0.1)); background: rgba(0,0,0,0.02); } [data-bs-theme="dark"] .hsm-header { background: rgba(255,255,255,0.02); border-color: rgba(255,255,255,0.1); } .hsm-close { background: transparent; border: none; color: inherit; opacity: 0.5; padding: 0.25rem 0.5rem; border-radius: 0.25rem; font-size: 1.2rem; line-height: 1; transition: opacity 0.2s; } .hsm-close:hover { opacity: 1; } .hsm-body { padding: 1.5rem; } .hsm-url-group { display: flex !important; align-items: stretch; } .hsm-url-group .form-control { flex: 1; min-width: 0; margin: 0; background: var(--bs-secondary-bg, #f8f9fa); border-color: var(--bs-border-color, #dee2e6); border-top-right-radius: 0; border-bottom-right-radius: 0; height: 42px; } .hsm-url-group .btn { flex: 0 0 auto; margin: 0; margin-left: -1px; border-top-left-radius: 0; border-bottom-left-radius: 0; height: 42px; display: flex; align-items: center; justify-content: center; padding: 0 1.25rem; z-index: 2; } [data-bs-theme="dark"] .hsm-url-group .form-control { background: #0f172a; border-color: #334155; color: #e2e8f0; } .hsm-share-grid { display: flex; flex-direction: column; gap: 0.5rem; } .hsm-share-grid .btn { display: flex; align-items: center; justify-content: center; font-size: 0.9rem; padding: 0.6rem; border-color: var(--bs-border-color); width: 100%; } [data-bs-theme="dark"] .hsm-share-grid .btn { color: #e2e8f0; border-color: #475569; } [data-bs-theme="dark"] .hsm-share-grid .btn:hover { background: #334155; border-color: #cbd5e1; } </style> <script> (function(){ const modal = document.getElementById('headingShareModal'); if(!modal) return; const input = modal.querySelector('#headingShareInput'); const copyBtn = modal.querySelector('.hsm-copy'); const twitter = modal.querySelector('#share-twitter'); const linkedin = modal.querySelector('#share-linkedin'); const facebook = modal.querySelector('#share-facebook'); const closeBtn = modal.querySelector('.hsm-close'); let lastFocus=null; let trapBound=false; function buildUrl(id){ return window.location.origin + window.location.pathname + '#' + id; } function isOpen(){ return !modal.hasAttribute('hidden'); } function hydrate(id){ const url=buildUrl(id); input.value=url; const enc=encodeURIComponent(url); const text=encodeURIComponent(document.title); if(twitter) twitter.href=`https://twitter.com/intent/tweet?url=${enc}&text=${text}`; if(linkedin) linkedin.href=`https://www.linkedin.com/sharing/share-offsite/?url=${enc}`; if(facebook) facebook.href=`https://www.facebook.com/sharer/sharer.php?u=${enc}`; } function openModal(id){ lastFocus=document.activeElement; hydrate(id); if(!isOpen()){ modal.removeAttribute('hidden'); } requestAnimationFrame(()=>{ input.focus(); }); trapFocus(); } function closeModal(){ if(!isOpen()) return; modal.setAttribute('hidden',''); if(lastFocus && typeof lastFocus.focus==='function') lastFocus.focus(); } function copyCurrent(){ try{ navigator.clipboard.writeText(input.value).then(()=>feedback(true),()=>fallback()); } catch(e){ fallback(); } } function fallback(){ input.select(); try{ document.execCommand('copy'); feedback(true);}catch(e){ feedback(false);} } function feedback(ok){ if(!copyBtn) return; const icon=copyBtn.querySelector('i'); if(!icon) return; const prev=copyBtn.getAttribute('data-prev')||icon.className; if(!copyBtn.getAttribute('data-prev')) copyBtn.setAttribute('data-prev',prev); icon.className= ok ? 'fa-duotone fa-clipboard-check':'fa-duotone fa-circle-exclamation'; setTimeout(()=>{ icon.className=prev; },1800); } function handleShareClick(e){ e.preventDefault(); const btn=e.currentTarget; const id=btn.getAttribute('data-share-target'); if(id) openModal(id); } function bindShareButtons(){ document.querySelectorAll('.h-share').forEach(btn=>{ if(!btn.dataset.hShareBound){ btn.addEventListener('click', handleShareClick); btn.dataset.hShareBound='1'; } }); } bindShareButtons(); if(document.readyState==='loading'){ document.addEventListener('DOMContentLoaded', bindShareButtons); } else { requestAnimationFrame(bindShareButtons); } document.addEventListener('click', function(e){ const shareBtn=e.target.closest && e.target.closest('.h-share'); if(shareBtn && !shareBtn.dataset.hShareBound){ handleShareClick.call(shareBtn, e); } }, true); document.addEventListener('click', e=>{ if(e.target===modal) closeModal(); if(e.target.closest && e.target.closest('.hsm-close')){ e.preventDefault(); closeModal(); } if(copyBtn && (e.target===copyBtn || (e.target.closest && e.target.closest('.hsm-copy')))) { e.preventDefault(); copyCurrent(); } }); document.addEventListener('keydown', e=>{ if(e.key==='Escape' && isOpen()) closeModal(); }); function trapFocus(){ if(trapBound) return; trapBound=true; modal.addEventListener('keydown', f=>{ if(f.key==='Tab' && isOpen()){ const focusable=[...modal.querySelectorAll('a[href],button,input,textarea,select,[tabindex]:not([tabindex="-1"])')].filter(el=>!el.hasAttribute('disabled')); if(!focusable.length) return; const first=focusable[0]; const last=focusable[focusable.length-1]; if(f.shiftKey && document.activeElement===first){ f.preventDefault(); last.focus(); } else if(!f.shiftKey && document.activeElement===last){ f.preventDefault(); first.focus(); } } }); } if(closeBtn) closeBtn.addEventListener('click', e=>{ e.preventDefault(); closeModal(); }); })(); </script>Data integrity ensures that data is: <ul> <li>Accurate: Data correctly represents real-world entities</li> <li>Valid: Data conforms to defined rules and constraints</li> <li>Consistent: Data is coherent across the database</li> <li>Complete: Required data is present and not missing</li> <li>Unique: Duplicate data is prevented where necessary</li> </ul> Geode enforces data integrity through multiple layers: <ol> <li>Transaction guarantees: ACID properties ensure consistent state</li> <li>Schema constraints: Rules enforced at the database level</li> <li>Validation rules: Custom business logic validation</li> <li>Referential integrity: Relationship consistency enforcement</li> <li>Checksums: Cryptographic verification of data authenticity</li> </ol> <h3 id="acid-guarantees" class="position-relative d-flex align-items-center group"> ACID Guarantees <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="acid-guarantees" aria-haspopup="dialog" aria-label="Share link: ACID Guarantees"> Share link </button> </h3>Geode provides full ACID (Atomicity, Consistency, Isolation, Durability) compliance: <h4 id="atomicity" class="position-relative d-flex align-items-center group"> Atomicity <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="atomicity" aria-haspopup="dialog" aria-label="Share link: Atomicity"> Share link </button> </h4>All operations in a transaction complete successfully or none do: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Transfer funds between accounts BEGIN; MATCH (from:Account {id: $from_id}) WHERE from.balance >= $amount SET from.balance = from.balance - $amount; MATCH (to:Account {id: $to_id}) SET to.balance = to.balance + $amount; -- If either operation fails, entire transaction rolls back COMMIT; </code></pre></div> <h4 id="consistency" class="position-relative d-flex align-items-center group"> Consistency <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="consistency" aria-haspopup="dialog" aria-label="Share link: Consistency"> Share link </button> </h4>Database transitions from one valid state to another: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Constraint ensures valid state CREATE CONSTRAINT positive_balance ON (a:Account) ASSERT a.balance >= 0; -- Transaction that violates constraint fails BEGIN; MATCH (a:Account {id: $account_id}) SET a.balance = -100; -- Fails: violates positive_balance constraint COMMIT; </code></pre></div> <h4 id="isolation" class="position-relative d-flex align-items-center group"> Isolation <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="isolation" aria-haspopup="dialog" aria-label="Share link: Isolation"> Share link </button> </h4>Concurrent transactions don’t interfere with each other: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Transaction 1 BEGIN TRANSACTION ISOLATION LEVEL SERIALIZABLE; MATCH (p:Product {sku: $sku}) WHERE p.inventory > 0 SET p.inventory = p.inventory - 1; COMMIT; -- Transaction 2 (concurrent) -- Waits for Transaction 1 to complete -- Ensures no double-booking of inventory </code></pre></div> <h4 id="durability" class="position-relative d-flex align-items-center group"> Durability <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="durability" aria-haspopup="dialog" aria-label="Share link: Durability"> Share link </button> </h4>Committed changes survive system failures: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"># Enable write-ahead logging for durability geode serve --wal-enabled=true \ --wal-sync-mode=fsync \ --wal-flush-interval=100ms # After crash, recover from WAL geode recover --wal-directory=/var/lib/geode/wal </code></pre></div> <h3 id="schema-constraints" class="position-relative d-flex align-items-center group"> Schema Constraints <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="schema-constraints" aria-haspopup="dialog" aria-label="Share link: Schema Constraints"> Share link </button> </h3>Define and enforce data quality rules at the schema level: <h4 id="uniqueness-constraints" class="position-relative d-flex align-items-center group"> Uniqueness Constraints <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="uniqueness-constraints" aria-haspopup="dialog" aria-label="Share link: Uniqueness Constraints"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Ensure email addresses are unique CREATE CONSTRAINT unique_email ON (u:User) ASSERT u.email IS UNIQUE; -- Ensure compound uniqueness CREATE CONSTRAINT unique_person_name ON (p:Person) ASSERT (p.first_name, p.last_name, p.birth_date) IS UNIQUE; -- Attempt to insert duplicate fails CREATE (:User {email: 'alice@example.com'}); CREATE (:User {email: 'alice@example.com'}); -- Error: Constraint violation </code></pre></div> <h4 id="existence-constraints" class="position-relative d-flex align-items-center group"> Existence Constraints <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="existence-constraints" aria-haspopup="dialog" aria-label="Share link: Existence Constraints"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Ensure required properties exist CREATE CONSTRAINT required_user_fields ON (u:User) ASSERT u.email IS NOT NULL AND u.created_at IS NOT NULL AND u.status IS NOT NULL; -- Insertion without required field fails CREATE (:User {name: 'Bob'}); -- Error: Missing required property 'email' </code></pre></div> <h4 id="property-type-constraints" class="position-relative d-flex align-items-center group"> Property Type Constraints <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="property-type-constraints" aria-haspopup="dialog" aria-label="Share link: Property Type Constraints"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Ensure property types CREATE CONSTRAINT email_format ON (u:User) ASSERT u.email MATCHES '^[a-zA-Z0-9._%+-]+@[a-zA-Z0-9.-]+\.[a-zA-Z]{2,}$'; CREATE CONSTRAINT age_range ON (p:Person) ASSERT p.age >= 0 AND p.age <= 150; CREATE CONSTRAINT positive_price ON (p:Product) ASSERT p.price > 0; </code></pre></div> <h4 id="relationship-constraints" class="position-relative d-flex align-items-center group"> Relationship Constraints <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="relationship-constraints" aria-haspopup="dialog" aria-label="Share link: Relationship Constraints"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Ensure relationship cardinality CREATE CONSTRAINT one_manager ON ()-[r:REPORTS_TO]->() ASSERT count {(person)-[:REPORTS_TO]->()} <= 1; -- Ensure relationship endpoints CREATE CONSTRAINT valid_employment ON ()-[r:EMPLOYED_BY]->() ASSERT start_node(r):Person AND end_node(r):Company; -- Ensure bidirectional relationships CREATE CONSTRAINT symmetric_friendship ON ()-[r:FRIENDS_WITH]->() ASSERT EXISTS { MATCH (a)-[r:FRIENDS_WITH]->(b) MATCH (b)-[:FRIENDS_WITH]->(a) }; </code></pre></div> <h3 id="referential-integrity" class="position-relative d-flex align-items-center group"> Referential Integrity <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="referential-integrity" aria-haspopup="dialog" aria-label="Share link: Referential Integrity"> Share link </button> </h3>Ensure relationships reference valid entities: <h4 id="foreign-key-constraints" class="position-relative d-flex align-items-center group"> Foreign Key Constraints <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="foreign-key-constraints" aria-haspopup="dialog" aria-label="Share link: Foreign Key Constraints"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Ensure order references valid customer CREATE CONSTRAINT valid_customer_reference ON (o:Order) ASSERT EXISTS { MATCH (o)-[:ORDERED_BY]->(c:Customer) }; -- Prevent orphaned orders -- Deletion of customer fails if orders exist MATCH (c:Customer {id: $customer_id}) DELETE c; -- Error if orders reference this customer </code></pre></div> <h4 id="cascade-operations" class="position-relative d-flex align-items-center group"> Cascade Operations <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cascade-operations" aria-haspopup="dialog" aria-label="Share link: Cascade Operations"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Delete customer and all related orders MATCH (c:Customer {id: $customer_id}) OPTIONAL MATCH (c)<-[:ORDERED_BY]-(o:Order) DELETE c, o; -- Update with cascade MATCH (c:Customer {id: $old_id}) SET c.id = $new_id WITH c MATCH (c)<-[r:ORDERED_BY]-(o:Order) -- Relationships automatically updated RETURN count(o) AS updated_orders; </code></pre></div> <h4 id="preventing-dangling-references" class="position-relative d-flex align-items-center group"> Preventing Dangling References <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="preventing-dangling-references" aria-haspopup="dialog" aria-label="Share link: Preventing Dangling References"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Before delete, check for references MATCH (p:Product {id: $product_id}) WHERE NOT EXISTS { MATCH (p)<-[:CONTAINS]-(order:Order) WHERE order.status IN ['pending', 'processing'] } DELETE p; -- If active references exist, deletion blocked </code></pre></div> <h3 id="validation-rules" class="position-relative d-flex align-items-center group"> Validation Rules <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="validation-rules" aria-haspopup="dialog" aria-label="Share link: Validation Rules"> Share link </button> </h3>Implement custom validation logic: <h4 id="pre-insert-validation" class="position-relative d-flex align-items-center group"> Pre-Insert Validation <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="pre-insert-validation" aria-haspopup="dialog" aria-label="Share link: Pre-Insert Validation"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Validate before insertion CREATE FUNCTION validate_user(props MAP) RETURNS BOOLEAN AS $$ RETURN props.email IS NOT NULL AND props.email MATCHES '^[a-zA-Z0-9._%+-]+@[a-zA-Z0-9.-]+\.[a-zA-Z]{2,}$' AND props.age >= 18 AND props.agreed_to_terms = true $$; -- Use in constraint CREATE CONSTRAINT valid_user ON (u:User) ASSERT validate_user(properties(u)); </code></pre></div> <h4 id="cross-field-validation" class="position-relative d-flex align-items-center group"> Cross-Field Validation <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="cross-field-validation" aria-haspopup="dialog" aria-label="Share link: Cross-Field Validation"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Ensure date ranges are valid CREATE CONSTRAINT valid_date_range ON (e:Event) ASSERT e.end_date >= e.start_date; -- Ensure conditional fields CREATE CONSTRAINT conditional_fields ON (o:Order) ASSERT (o.status = 'shipped' AND o.tracking_number IS NOT NULL) OR (o.status != 'shipped'); </code></pre></div> <h4 id="business-rule-validation" class="position-relative d-flex align-items-center group"> Business Rule Validation <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="business-rule-validation" aria-haspopup="dialog" aria-label="Share link: Business Rule Validation"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Ensure inventory is sufficient for order CREATE CONSTRAINT sufficient_inventory ON ()-[r:CONTAINS]->() ASSERT { MATCH (order)-[r:CONTAINS {quantity: qty}]->(product:Product) WHERE product.inventory >= qty RETURN true }; </code></pre></div> <h3 id="data-consistency-checks" class="position-relative d-flex align-items-center group"> Data Consistency Checks <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="data-consistency-checks" aria-haspopup="dialog" aria-label="Share link: Data Consistency Checks"> Share link </button> </h3> <h4 id="consistency-verification" class="position-relative d-flex align-items-center group"> Consistency Verification <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="consistency-verification" aria-haspopup="dialog" aria-label="Share link: Consistency Verification"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"># Run consistency check geode check-consistency --full \ --report=/var/log/geode/consistency-report.json # Example output: # Checking node integrity... OK (1,234,567 nodes) # Checking relationship integrity... OK (3,456,789 relationships) # Checking constraint violations... FOUND 3 violations # Checking orphaned relationships... OK # Checking index consistency... OK </code></pre></div> <h4 id="automated-consistency-checks" class="position-relative d-flex align-items-center group"> Automated Consistency Checks <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="automated-consistency-checks" aria-haspopup="dialog" aria-label="Share link: Automated Consistency Checks"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"># Enable periodic consistency checks geode serve --consistency-check-enabled=true \ --consistency-check-interval=daily \ --consistency-check-time=03:00 # Alert on inconsistencies geode serve --consistency-alert=true \ --alert-channel=email,pagerduty </code></pre></div> <h4 id="manual-verification-queries" class="position-relative d-flex align-items-center group"> Manual Verification Queries <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="manual-verification-queries" aria-haspopup="dialog" aria-label="Share link: Manual Verification Queries"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Find nodes missing required properties MATCH (u:User) WHERE u.email IS NULL OR u.created_at IS NULL RETURN count(u) AS invalid_users; -- Find orphaned relationships MATCH ()-[r:ORDERED_BY]->() WHERE NOT EXISTS { MATCH (o:Order)-[r]->(c:Customer) } RETURN count(r) AS orphaned_orders; -- Find duplicate data MATCH (u1:User), (u2:User) WHERE u1.email = u2.email AND id(u1) < id(u2) RETURN u1.email, count(*) AS duplicates; -- Verify relationship integrity MATCH (p:Person)-[r:WORKS_AT]->(c:Company) WHERE NOT EXISTS {(c:Company)} RETURN count(r) AS invalid_employment_relationships; </code></pre></div> <h3 id="checksums-and-verification" class="position-relative d-flex align-items-center group"> Checksums and Verification <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="checksums-and-verification" aria-haspopup="dialog" aria-label="Share link: Checksums and Verification"> Share link </button> </h3> <h4 id="data-checksums" class="position-relative d-flex align-items-center group"> Data Checksums <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="data-checksums" aria-haspopup="dialog" aria-label="Share link: Data Checksums"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"># Enable data checksums geode serve --data-checksums=enabled \ --checksum-algorithm=sha256 \ --verify-checksums-on-read=true # Verify data integrity geode verify-checksums --path=/var/lib/geode/data \ --report=checksum-report.json </code></pre></div> <h4 id="write-verification" class="position-relative d-flex align-items-center group"> Write Verification <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="write-verification" aria-haspopup="dialog" aria-label="Share link: Write Verification"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"># Enable write verification geode serve --verify-writes=true \ --write-verification-level=full # Reads data back after write to confirm </code></pre></div> <h3 id="transaction-integrity" class="position-relative d-flex align-items-center group"> Transaction Integrity <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="transaction-integrity" aria-haspopup="dialog" aria-label="Share link: Transaction Integrity"> Share link </button> </h3> <h4 id="savepoints" class="position-relative d-flex align-items-center group"> Savepoints <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="savepoints" aria-haspopup="dialog" aria-label="Share link: Savepoints"> Share link </button> </h4>Create savepoints for partial rollback: <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">BEGIN; -- First operation CREATE (p:Person {name: 'Alice', email: 'alice@example.com'}); -- Create savepoint SAVEPOINT after_person_creation; -- Second operation CREATE (c:Company {name: 'Acme Corp'}); CREATE (p)-[:WORKS_AT]->(c); -- Error occurs, rollback to savepoint ROLLBACK TO SAVEPOINT after_person_creation; -- Person still exists, company and relationship removed COMMIT; </code></pre></div> <h4 id="transaction-validation" class="position-relative d-flex align-items-center group"> Transaction Validation <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="transaction-validation" aria-haspopup="dialog" aria-label="Share link: Transaction Validation"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Validate entire transaction before commit BEGIN; -- Multiple operations CREATE (p:Person {name: 'Bob'}); CREATE (c:Company {name: 'TechCo'}); CREATE (p)-[:WORKS_AT]->(c); -- Validate constraints before commit CALL validate_transaction(); -- Only commits if all constraints satisfied COMMIT; </code></pre></div> <h3 id="error-handling" class="position-relative d-flex align-items-center group"> Error Handling <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="error-handling" aria-haspopup="dialog" aria-label="Share link: Error Handling"> Share link </button> </h3> <h4 id="constraint-violation-handling" class="position-relative d-flex align-items-center group"> Constraint Violation Handling <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="constraint-violation-handling" aria-haspopup="dialog" aria-label="Share link: Constraint Violation Handling"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-python" data-lang="python">from geode_client import Client, ConstraintViolationError client = Client('geode.example.com') try: await client.run(""" CREATE (:User {email: '[email protected]'}) """) except ConstraintViolationError as e: print(f"Constraint violation: {e.constraint_name}") print(f"Details: {e.message}") # Handle duplicate email gracefully </code></pre></div> <h4 id="transaction-conflict-resolution" class="position-relative d-flex align-items-center group"> Transaction Conflict Resolution <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="transaction-conflict-resolution" aria-haspopup="dialog" aria-label="Share link: Transaction Conflict Resolution"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-python" data-lang="python">max_retries = 3 retry_count = 0 while retry_count < max_retries: try: async with client.connection() as txn: await txn.begin() # Read current value result = await txn.run(""" MATCH (p:Product {sku: $sku}) RETURN p.inventory, p.version """, sku=sku) inventory, version = result.rows[0] # Update with optimistic locking await txn.run(""" MATCH (p:Product {sku: $sku}) WHERE p.version = $version SET p.inventory = $new_inventory, p.version = $version + 1 """, sku=sku, version=version, new_inventory=inventory - 1) await txn.commit() break except ConflictError: retry_count += 1 if retry_count >= max_retries: raise await asyncio.sleep(0.1 * (2 ** retry_count)) # Exponential backoff </code></pre></div> <h3 id="best-practices" class="position-relative d-flex align-items-center group"> Best Practices <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="best-practices" aria-haspopup="dialog" aria-label="Share link: Best Practices"> Share link </button> </h3><ol> <li>Define Constraints Early: Establish constraints during schema design, not after data is loaded</li> <li>Use ACID Transactions: Wrap related operations in transactions for consistency</li> <li>Validate Input: Validate data at application layer before database insertion</li> <li>Regular Consistency Checks: Run automated consistency checks periodically</li> <li>Monitor Constraint Violations: Alert on constraint violations to detect data quality issues</li> <li>Use Appropriate Isolation: Choose isolation level based on consistency requirements</li> <li>Implement Retry Logic: Handle transient errors with exponential backoff</li> <li>Test Constraints: Thoroughly test constraints before production deployment</li> <li>Document Data Rules: Maintain clear documentation of all data integrity rules</li> <li>Backup Before Changes: Always backup before making schema or constraint changes</li> </ol> <h3 id="monitoring-data-integrity" class="position-relative d-flex align-items-center group"> Monitoring Data Integrity <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="monitoring-data-integrity" aria-haspopup="dialog" aria-label="Share link: Monitoring Data Integrity"> Share link </button> </h3> <h4 id="integrity-metrics" class="position-relative d-flex align-items-center group"> Integrity Metrics <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="integrity-metrics" aria-haspopup="dialog" aria-label="Share link: Integrity Metrics"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"># Monitor integrity metrics geode stats --component=integrity \ --metrics=constraint_violations,checksum_errors,transaction_rollbacks # Example output: # Metric | Value | Trend # --------------------------|-------|------- # Constraint Violations | 12 | ↓ # Checksum Errors | 0 | → # Transaction Rollbacks | 145 | ↑ # Orphaned Relationships | 3 | ↓ # Duplicate Nodes | 0 | → </code></pre></div> <h4 id="audit-integrity-events" class="position-relative d-flex align-items-center group"> Audit Integrity Events <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="audit-integrity-events" aria-haspopup="dialog" aria-label="Share link: Audit Integrity Events"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"># Enable integrity event logging geode serve --audit-integrity-events=true \ --log-constraint-violations=true \ --log-data-corruption=true </code></pre></div> <h3 id="recovery-from-integrity-issues" class="position-relative d-flex align-items-center group"> Recovery from Integrity Issues <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="recovery-from-integrity-issues" aria-haspopup="dialog" aria-label="Share link: Recovery from Integrity Issues"> Share link </button> </h3> <h4 id="constraint-violation-cleanup" class="position-relative d-flex align-items-center group"> Constraint Violation Cleanup <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="constraint-violation-cleanup" aria-haspopup="dialog" aria-label="Share link: Constraint Violation Cleanup"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Find and fix constraint violations MATCH (u:User) WHERE u.email IS NULL SET u.email = 'unknown-' + toString(id(u)) + '@example.com'; -- Remove duplicates MATCH (u1:User), (u2:User) WHERE u1.email = u2.email AND id(u1) < id(u2) DELETE u2; </code></pre></div> <h4 id="orphaned-data-cleanup" class="position-relative d-flex align-items-center group"> Orphaned Data Cleanup <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="orphaned-data-cleanup" aria-haspopup="dialog" aria-label="Share link: Orphaned Data Cleanup"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-gql" data-lang="gql">-- Remove orphaned relationships MATCH ()-[r:ORDERED_BY]->() WHERE NOT EXISTS { MATCH (o:Order)-[r]->(c:Customer) } DELETE r; </code></pre></div> <h4 id="data-repair" class="position-relative d-flex align-items-center group"> Data Repair <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="data-repair" aria-haspopup="dialog" aria-label="Share link: Data Repair"> Share link </button> </h4><div class="highlight"><pre tabindex="0" class="chroma"><code class="language-bash" data-lang="bash"># Repair corrupted data geode repair --checksum-errors \ --orphaned-relationships \ --constraint-violations \ --dry-run # Apply repairs geode repair --apply </code></pre></div> <h3 id="related-topics" class="position-relative d-flex align-items-center group"> Related Topics <button type="button" class="h-share btn btn-link p-0 text-decoration-none link-secondary opacity-50 hover-opacity-100 transition-all ms-1" data-share-target="related-topics" aria-haspopup="dialog" aria-label="Share link: Related Topics"> Share link </button> </h3><ul> <li><a href="/tags/transactions/" >Transactions</a> - ACID transaction management</li> <li><a href="/tags/isolation/" >Isolation</a> - Transaction isolation levels</li> <li><a href="/tags/compliance/" >Compliance</a> - Regulatory compliance and data integrity</li> <li><a href="/tags/governance/" >Data Governance</a> - Data quality and governance</li> <li><a href="/tags/audit-logging/" >Audit Logging</a> - Tracking data modifications</li> <li><a href="/docs/guides/schema-design/" >Schema Design</a> - Schema design and constraints</li> <li><a href="/docs/reference/error-codes/" >Error Codes</a> - Error code reference for integrity errors</li> <li><a href="/docs/operations/backup/" >Backup and Recovery</a> - Data protection and recovery</li> </ul>

Popular

Related Articles

Transactions and Data Integrity