💻
System Design
  • System Design
  • System Design Overview
  • Basic Concepts
    • Memory Levels
    • Functional vs Non-Functional Requirements
  • Key Concepts and Definations
    • Scalability
    • Performance
    • Availability
    • Reliability
    • Consistency
    • Stateless vs Stateful Servers
    • CAP Theorem
    • Data Storage and Retrieval
    • Consistent Hashing
    • Rate Limit
    • Networking and Communication
    • Security and Privacy
  • Building Blocks
    • REST APIs
      • HTTP Request
    • Authentication and Authorisation
    • Caching
      • Caching with Redis + Python
      • LRU Caching Implementation
      • Caching: Case Study
    • Database
      • DBMS
      • SQL
      • NoSQL
      • Properties
      • Database
        • Elasticsearch
        • Neo4j
        • Redis
        • OrientDB
      • Use Cases
    • Message Queue
      • Kafka
      • Pulsar
      • Celery
      • Rabbimq
      • Redis
    • Deployment
      • Docker
        • Distroless
      • Kubernetes
      • CI - CD Pipeline
    • CDN
    • Nginx
      • Reverse Proxy
      • Load Balancer
      • Caching
    • Web Scrapper and Automation
    • Parallel Processing
    • Scheduling
      • Airflow
      • Azure Logic App
    • Networking Fundamentals
    • Cloud Services
      • AWS
        • Dynamic Website on AWS
      • Google Cloud
        • Dynamic Website on GCP
      • Azure
  • Miscellaneous
  • Git
    • Interesting Repos
      • Quantitative Finance
  • Visualization
    • Power BI
    • Kibana
    • Redash
  • rocksdb and Python
  • Python Framework
    • Python Concepts
      • miscellaneous Concepts
      • OOP
      • Built-in Class Attributes
      • Built-in Functions
      • Python Clean Code
      • Async io
      • Concurrency vs Parallelism
      • Client-Server Model
    • Flask
    • FastAPI
    • Tornado
    • Django
  • Java Script
    • Node js
    • Express js
  • Operating System
  • Big Data
    • Spark
      • Pyspark Working
    • EDW
      • EDW Concepts
    • GraphQL
    • Map Reduce
  • Search
  • UI UX
    • Figma
  • Logging in Python
  • Communication in Python
  • Hashing
  • Sample Application Structure
  • Data Transfer over Network
    • jwt Authentication
  • Rough
    • Authentication and Authorization
    • Pyspark Kubernetes Operator
    • Pulsar vs Kafka
    • Storage vs Compute Server
    • Bigdata Storage Server
    • Bigdata Storage + Compute Servers
    • Stream Data Storage
    • Columnary vs Row based
    • Big data Processing
    • Stream data Processing
    • Metadata and usage
    • Data Cataloging and Usage
    • Iceberg vs Hive
    • Page 1
  • SQL - A Complete Guide
    • SQL Queries
  • Data Engineer Interview
  • Elasticsearch
  • Lambda Architecture
  • Technology Stack
  • Machine Learning
    • Learning rate warm-up
  • System Designs
    • Thinking Mental Model
    • Design Fundamental Systems
      • Design Rate Limiter
      • Design Key-Value Store
      • Design a Web Crawler
      • Design Logging and Monitoring System
    • Design Spotify
    • Design ChatGPT
    • Design Tinder
    • Design Twitter
    • Design Hotel Booking System
    • Design Calender Management System
    • Design Reddit
    • Design Whatsapp
    • Design Youtube
    • Design Instagram
    • To Read
Powered by GitBook
On this page
  • Columnary data
  • Columnary data is suitable for OLAP operations

Was this helpful?

  1. Rough

Columnary vs Row based

PreviousStream Data StorageNextBig data Processing

Last updated 2 years ago

Was this helpful?

OLAP vs OLTP

Columnary data

Parquet

  • faster query run time

  • it is smaller in size

  • requires fewer data to be scanned compared to formats such as CSV

Columnary data is suitable for OLAP operations

  • What is OLAP:

https://hevodata.com/learn/columnar-databases/
https://www.sobyte.net/post/2021-11/whys-the-design-olap-column-oriented/
https://www.quora.com/Why-are-columnar-databases-more-suited-for-OLAP-applications?share=1
https://support.microsoft.com/en-us/office/overview-of-online-analytical-processing-olap-15d2cdde-f70b-4277-b009-ed732b75fdd6
https://learn.microsoft.com/en-us/azure/architecture/data-guide/relational-data/online-analytical-processing
https://www.ibm.com/cloud/learn/olap
https://dwgeek.com/column-oriented-database-stores-data-details.html/