4.1.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Connect
Spark Connect server
application UI
Details for Stage 165 (Attempt 0)
Submitted:
2026/09/03 16:10:23
Duration
4 s
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 2
Input Size / Records:
20.2 KiB / 602112
Associated Job Ids:
154
DAG Visualization
digraph G { id="graph_165"; subgraph graph_stage_165 { id="graph_stage_165"; isCluster="true"; label="Stage 165"; subgraph cluster_863 { id="cluster_863"; isCluster="true"; label="Scan parquet "; 344 [id="node_344" labelType="html" label="FileScanRDD [344]<br>Spark Connect - session_id: "29cbf5ee-3bc4-44da-a6fe-5b90efeec9f0"\nplan {\n command {\n write_operation {\n input {\n common {\n ...}"]; 345 [id="node_345" labelType="html" label="MapPartitionsRDD [345]<br>Spark Connect - session_id: "29cbf5ee-3bc4-44da-a6fe-5b90efeec9f0"\nplan {\n command {\n write_operation {\n input {\n common {\n ...}"]; } subgraph cluster_860 { id="cluster_860"; isCluster="true"; label="WholeStageCodegen (1)"; 346 [id="node_346" labelType="html" label="MapPartitionsRDD [346]<br>Spark Connect - session_id: "29cbf5ee-3bc4-44da-a6fe-5b90efeec9f0"\nplan {\n command {\n write_operation {\n input {\n common {\n ...}"]; } } 344->345; 345->346; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time