4.1.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Connect
Spark Connect server
application UI
Details for Stage 37 (Attempt 0)
Submitted:
2026/09/01 05:38:11
Duration
0.3 s
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 2
Input Size / Records:
247.4 KiB / 32
Shuffle Write Size / Records:
252.0 B / 32
Associated Job Ids:
27
DAG Visualization
digraph G { id="graph_37"; subgraph graph_stage_37 { id="graph_stage_37"; isCluster="true"; label="Stage 37"; subgraph cluster_118 { id="cluster_118"; isCluster="true"; label="Scan json "; 121 [id="node_121" labelType="html" label="FileScanRDD [121]<br>Spark Connect - session_id: "de6f26de-bb97-4181-a42a-3ea99c6daf12"\nplan {\n root {\n common {\n plan_id: 3\n }\n limit {\n inpu...}"]; 122 [id="node_122" labelType="html" label="MapPartitionsRDD [122]<br>Spark Connect - session_id: "de6f26de-bb97-4181-a42a-3ea99c6daf12"\nplan {\n root {\n common {\n plan_id: 3\n }\n limit {\n inpu...}"]; } subgraph cluster_115 { id="cluster_115"; isCluster="true"; label="WholeStageCodegen (1)"; 123 [id="node_123" labelType="html" label="MapPartitionsRDD [123]<br>Spark Connect - session_id: "de6f26de-bb97-4181-a42a-3ea99c6daf12"\nplan {\n root {\n common {\n plan_id: 3\n }\n limit {\n inpu...}"]; } subgraph cluster_114 { id="cluster_114"; isCluster="true"; label="CollectLimit"; 124 [id="node_124" labelType="html" label="MapPartitionsRDD [124]<br>Spark Connect - session_id: "de6f26de-bb97-4181-a42a-3ea99c6daf12"\nplan {\n root {\n common {\n plan_id: 3\n }\n limit {\n inpu...}"]; 125 [id="node_125" labelType="html" label="MapPartitionsRDD [125]<br>Spark Connect - session_id: "de6f26de-bb97-4181-a42a-3ea99c6daf12"\nplan {\n root {\n common {\n plan_id: 3\n }\n limit {\n inpu...}"]; } } 121->122; 122->123; 123->124; 124->125; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time