Ceph

03/18/2021

03:56 AM rgw Support #49639: Getting Error while writing Spark Dataframe to Ceph Storage using Spark 3.0.1 (Hadoop 3.2) / Spark 2.4.5 (Hadoop 2.7)

This issue is resolved. I documented my answer and findings here - https://stackoverflow.com/questions/66468333/getti... Prateek Dubey

03/08/2021

08:15 AM rgw Support #49639: Getting Error while writing Spark Dataframe to Ceph Storage using Spark 3.0.1 (Hadoop 3.2) / Spark 2.4.5 (Hadoop 2.7)

So I tested same configuration and code in Cluster Mode on Spark via Spark Submit and it worked :)
So I think iss... Prateek Dubey

03/07/2021

12:59 PM rgw Support #49639: Getting Error while writing Spark Dataframe to Ceph Storage using Spark 3.0.1 (Hadoop 3.2) / Spark 2.4.5 (Hadoop 2.7)

Prateek Dubey wrote:
> Prateek Dubey wrote:
> > In my organisation we have currently deployed Ceph to replace HDFS ... Prateek Dubey

12:58 PM rgw Support #49639: Getting Error while writing Spark Dataframe to Ceph Storage using Spark 3.0.1 (Hadoop 3.2) / Spark 2.4.5 (Hadoop 2.7)

Prateek Dubey wrote:
> In my organisation we have currently deployed Ceph to replace HDFS to run our AI/ML workloads... Prateek Dubey

12:56 PM rgw Support #49639 (New): Getting Error while writing Spark Dataframe to Ceph Storage using Spark 3.0.1 (Hadoop 3.2) / Spark 2.4.5 (Hadoop 2.7)

In my organisation we have currently deployed Ceph to replace HDFS to run our AI/ML workloads using Spark on Kubernet... Prateek Dubey