Project

General

Profile

Feature #4484

Enable Hadoop bindings to pull configuration options from the monitor

Added by Anonymous about 11 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
Reviewed:
Affected Versions:
Component(FS):
Hadoop/Java
Labels (FS):
Java/Hadoop
Pull request ID:

Description

At present, the Hadoop bindings require several options be specified in xml files.
It would be easier for users if they only had to specify the monitor and the keyring file, as is the case for mounting via the kernel client.

Ideally we'd embed the monitor and mountpoint in the fs.default.name setting like "ceph://192.168.0.1:6789:/" and then used a second setting for the keyring.

History

#1 Updated by Anonymous about 11 years ago

This replaces the current approach, which assumes that the host with the JobTracker (likely not an OSD and possibly not a Ceph node at all) has a ceph.conf file (which seems like an unnecessary requirement).

#2 Updated by Noah Watkins about 11 years ago

Seems like there are keyring files, secret strings, client usernames, etc… Which one(s) should we use?

http://ceph.com/docs/master/rados/operations/authentication/

#3 Updated by Anonymous about 11 years ago

I'd lean towards keyring files, but we may want to float this on Monday's stand-up.

#4 Updated by Noah Watkins about 11 years ago

ceph.git wip-4484
hadoop-common.git cephfs/wip-4484

#5 Updated by Noah Watkins about 11 years ago

  • Status changed from New to Fix Under Review

#6 Updated by Noah Watkins about 11 years ago

  • Status changed from Fix Under Review to Resolved

#7 Updated by Noah Watkins about 11 years ago

cdca0babf9145a8f6e7613ab7026cf0968b3bc91

#8 Updated by Greg Farnum over 7 years ago

  • Component(FS) Hadoop/Java added

#9 Updated by Patrick Donnelly about 5 years ago

  • Category deleted (48)
  • Labels (FS) Java/Hadoop added

Also available in: Atom PDF