Falha nas tarefas Spark em mesos

0

Eu comecei o mesos cluster no Ubuntu 14.04 com um mesos-master e três escravos rodando e também o MesosClusterDispatcher rodando. Depois de implantar o aplicativo Spark em mesos, no terminal, ele mostra a saída como:

Driver is running

Mas quando eu verifico no mesos UI, ele mostra na seção de tarefas concluídas que o status da tarefa falhou.

Completed Tasks

Find...
Framework ID    Task ID Task Name   Role    State   Started Stopped Host    
…882622991d44-0001  driver-20171201082205-0009  Driver for LOGIN    *   **FAILED**      3 hours ago mesosserver Sandbox

and in sandbox errors, it shows as,

I1204 04:10:51.763131  1702 fetcher.cpp:444] Fetching URI '/usr/local/share/packages/spark-2.2.0-bin-hadoop2.7.tgz'
I1204 04:10:51.763134  1702 fetcher.cpp:285] Fetching directly into the sandbox directory
I1204 04:10:51.763147  1702 fetcher.cpp:222] Fetching URI '/usr/local/share/packages/spark-2.2.0-bin-hadoop2.7.tgz'
I1204 04:10:51.906798  1702 fetcher.cpp:207] Copied resource '/usr/local/share/packages/spark-2.2.0-bin-hadoop2.7.tgz' to '/var/lib/mesos/slaves/de03fa70-c688-44f0-a6c0-4621c66de5c2-S4/frameworks/444777ac-99a3-49ff-9474-882622991d44-0001/executors/driver-20171201071047-0008/runs/b8ae90a0-5072-4bde-8abb-567c26686c2d/spark-2.2.0-bin-hadoop2.7.tgz'
I1204 04:10:51.912394  1702 process.cpp:1202] libprocess is initialized on 127.0.0.1:59041 with 8 worker threads
I1204 04:10:54.033011  1702 fetcher.cpp:123] Extracted '/var/lib/mesos/slaves/de03fa70-c688-44f0-a6c0-4621c66de5c2-S4/frameworks/444777ac-99a3-49ff-9474-882622991d44-0001/executors/driver-20171201071047-0008/runs/b8ae90a0-5072-4bde-8abb-567c26686c2d/spark-2.2.0-bin-hadoop2.7.tgz' into '/var/lib/mesos/slaves/de03fa70-c688-44f0-a6c0-4621c66de5c2-S4/frameworks/444777ac-99a3-49ff-9474-882622991d44-0001/executors/driver-20171201071047-0008/runs/b8ae90a0-5072-4bde-8abb-567c26686c2d'
I1204 04:10:54.033048  1702 fetcher.cpp:590] Fetched '/usr/local/share/packages/spark-2.2.0-bin-hadoop2.7.tgz' to '/var/lib/mesos/slaves/de03fa70-c688-44f0-a6c0-4621c66de5c2-S4/frameworks/444777ac-99a3-49ff-9474-882622991d44-0001/executors/driver-20171201071047-0008/runs/b8ae90a0-5072-4bde-8abb-567c26686c2d/spark-2.2.0-bin-hadoop2.7.tgz'
I1204 04:10:54.033056  1702 fetcher.cpp:595] Successfully fetched all URIs into '/var/lib/mesos/slaves/de03fa70-c688-44f0-a6c0-4621c66de5c2-S4/frameworks/444777ac-99a3-49ff-9474-882622991d44-0001/executors/driver-20171201071047-0008/runs/b8ae90a0-5072-4bde-8abb-567c26686c2d'
I1204 04:10:54.816875  2054 exec.cpp:162] Version: 1.5.0
I1204 04:10:54.829228  2270 exec.cpp:237] Executor registered on agent de03fa70-c688-44f0-a6c0-4621c66de5c2-S4
I1204 04:10:54.832170  2270 executor.cpp:171] Received SUBSCRIBED event
I1204 04:10:54.833003  2270 executor.cpp:175] Subscribed executor on ubuntu236
I1204 04:10:54.835278  2267 executor.cpp:171] Received LAUNCH event
I1204 04:10:54.838256  2267 executor.cpp:637] Starting task driver-20171201071047-0008
I1204 04:10:54.848989  2267 executor.cpp:477] Running '/usr/local/share/packages/mesos/build/src/mesos-containerizer launch '
I1204 04:10:54.853162  2267 executor.cpp:650] Forked command at 2289
/var/lib/mesos/slaves/de03fa70-c688-44f0-a6c0-4621c66de5c2-S4/frameworks/444777ac-99a3-49ff-9474-882622991d44-0001/executors/driver-20171201071047-0008/runs/b8ae90a0-5072-4bde-8abb-567c26686c2d/spark-2.2.0-bin-hadoop2.7/bin/spark-class: line 71: /usr/bin/java: Argument list too long
I1204 04:10:55.123322  2271 executor.cpp:929] Command exited with status 126 (pid: 2289)
I1204 04:10:56.127331  2275 process.cpp:887] Failed to accept socket: future discarded

Alguém pode ajudar com isso, pois não tenho certeza qual é o problema - obrigado.

    
por Ankita 04.12.2017 / 06:38

0 respostas