Big Data: Difference between revisions
From Federal Burro of Information
Jump to navigationJump to search
No edit summary |
|||
| Line 40: | Line 40: | ||
http://www.elasticsearch.org/ - also [[Elastic Search]] | http://www.elasticsearch.org/ - also [[Elastic Search]] | ||
== | == Reference == | ||
* [https://blog.rjmetrics.com/2015/10/15/the-data-infrastructure-meta-analysis-how-top-engineering-organizations-built-their-big-data-stacks/ how do the big guys do it?] | * [https://blog.rjmetrics.com/2015/10/15/the-data-infrastructure-meta-analysis-how-top-engineering-organizations-built-their-big-data-stacks/ how do the big guys do it?] | ||
* map of tools http://insightdataengineering.com/blog/pipeline_map.html | * map of tools http://insightdataengineering.com/blog/pipeline_map.html | ||
Revision as of 23:23, 30 April 2017
Overview
- node management
- key value stores
- storage management
- job management
Key Values Stores
list:
http://www.metabrew.com/article/anti-rdbms-a-list-of-distributed-key-value-stores
http://www.project-voldemort.com/voldemort/
https://en.wikipedia.org/wiki/Redis
Storage
Oracle Cluster File System (OCFS)
Old?
- https://oss.oracle.com/projects/ocfs2/
- https://oss.oracle.com/projects/ocfs/dist/documentation/RHAS_best_practices.html
GFS
Hadoop
- get key value with hbase (no sql)
- sql with hive
Examples
Log data
Hadoop Analysis of Apache Logs Using Flume-NG, Hive and Pig
http://cuddletech.com/blog/?p=795
http://www.elasticsearch.org/ - also Elastic Search
