Project

General

Profile

Actions
Copy link

Feature #1448

closed

test hadoop on sepia

Added by Sage Weil over 12 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Reviewed:
Affected Versions:
Component(FS):
Hadoop/Java
Labels (FS):
Java/Hadoop
Pull request ID:

Description

- set it up on some sepia nodes (8?)
- do some basic testing of ceph vs hdfs

from doug cutting:

>>> My suggestion is that you start with CDH then try to run the TeraSort
>>> benchmark program.  I'd start by running it on a small cluster (1-5
>>> nodes) and, if that goes well, try moving up to a larger cluster if you have
>>> one available.  Other benchmarks worth considering are TestDFSIO (a simple
>>> read or write throughput test) and GridMix (a blend of workloads).

it probably isn't necessary to tie this into teuthology right now. let's get a bit of experience spinning it up manually first.

Actions
Copy link

Also available in: Atom PDF