4.1.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Connect
Spark Connect server
application UI
Details for Stage 151 (Attempt 0)
Submitted:
2026/09/03 06:04:57
Duration
4 s
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Process local: 15
Input Size / Records:
140.9 KiB / 24576
Shuffle Write Size / Records:
326.8 KiB / 6000
Associated Job Ids:
106
DAG Visualization
digraph G { id="graph_151"; subgraph graph_stage_151 { id="graph_stage_151"; isCluster="true"; label="Stage 151"; subgraph cluster_697 { id="cluster_697"; isCluster="true"; label="Scan parquet "; 442 [id="node_442" labelType="html" label="FileScanRDD [442]<br>Spark Connect - session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"\nplan {\n root {\n common {\n plan_id: 16\n }\n limit {\n inp...}"]; 443 [id="node_443" labelType="html" label="MapPartitionsRDD [443]<br>Spark Connect - session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"\nplan {\n root {\n common {\n plan_id: 16\n }\n limit {\n inp...}"]; } subgraph cluster_693 { id="cluster_693"; isCluster="true"; label="WholeStageCodegen (1)"; 444 [id="node_444" labelType="html" label="MapPartitionsRDD [444]<br>Spark Connect - session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"\nplan {\n root {\n common {\n plan_id: 16\n }\n limit {\n inp...}"]; } subgraph cluster_692 { id="cluster_692"; isCluster="true"; label="CollectLimit"; 445 [id="node_445" labelType="html" label="MapPartitionsRDD [445]<br>Spark Connect - session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"\nplan {\n root {\n common {\n plan_id: 16\n }\n limit {\n inp...}"]; 446 [id="node_446" labelType="html" label="MapPartitionsRDD [446]<br>Spark Connect - session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"\nplan {\n root {\n common {\n plan_id: 16\n }\n limit {\n inp...}"]; } } 442->443; 443->444; 444->445; 445->446; }
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time