Vanberra Signal
Free trial

Apache Spark

Curated by Signal

Apache Project - General engine for large-scale data processing

Enterprise Software & Infrastructurespark.apache.org

Overview

Spark is a general processing engine compatible with Hadoop data. It is designed to perform both batch processing (similar to MapReduce) and workloads like streaming, interactive queries, graph algorithms and machine learning. It uses in-memory technology to improve performance speed over Mapreduce. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, S3 and any Hadoop InputFormat. It was originally developed in 2009 in UC Berkeley’s AMPLab, and open sourced in 2010 as an Apache project.

Key facts

Founded
2010
Headquarters
Delaware, United States
Stage
Sign up to view
Industry
Enterprise Software & Infrastructure

More on Vanberra Signal

Members only
Business overviewCore metrics and financialsPeopleLeadership and key peopleSimilar companiesPeers and competitorsDeep AnalysisAI-generated strategic report

Competitors & similar companies

More Enterprise Software & Infrastructure companies

  • Affirmhealth

    Software solutions to prevent prescription drug abuse

    Enterprise Software & InfrastructureNashville, United States

  • Kwil

    AI based database creation solutions

    Enterprise Software & InfrastructureAustin, United States

  • Boomerang

    Cloud based decision support software

    Enterprise Software & InfrastructureHouston, United States

About Apache Spark

What does Apache Spark do?

Spark is a general processing engine compatible with Hadoop data.

Where is Apache Spark headquartered?

Apache Spark is headquartered in Delaware, United States.

When was Apache Spark founded?

Apache Spark was founded in 2010.

Which sector is Apache Spark in?

Apache Spark operates in Enterprise Software & Infrastructure.

Who are Apache Spark's competitors?

Companies similar to Apache Spark include Affirmhealth, Kwil, and Boomerang.