Spark獨立運行作業報錯

Spark獨立運行作業報錯

幾天來一直被這個錯誤困擾,迫切需要幫助。

因此,在獨立部署模式下,我嘗試執行範例作業,但無論作業多麼簡單(甚至啟動 Spark-Shell 併計算數字數組),都會不斷彈出以下錯誤(循環日誌的完整週期)資訊):

INFO AppClient$ClientActor: Executor added: app-20150604024526-0001/3 on worker-20150604023842-localhost-54417 (localhost:54417) with 1 cores
INFO SparkDeploySchedulerBackend: Granted executor ID app-20150604024526-0001/3 on hostPort localhost:54417 with 1 cores, 512.0 MB RAM

INFO AppClient$ClientActor: Executor updated: app-20150604024526-0001/3 is now RUNNING

INFO AppClient$ClientActor: Executor updated: app-20150604024526-0001/3 is now LOADING

WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

INFO AppClient$ClientActor: Executor updated: app-20150604024526-0001/2 is now EXITED (Command exited with code 1)

INFO SparkDeploySchedulerBackend: Executor app-20150604024526-0001/2 removed: Command exited with code 1

ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 2

任何見解或建議將不勝感激!多謝!

相關內容