4.1.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Connect
Spark Connect server
application UI
Details for Stage 167 (Attempt 0)
Submitted:
2026/09/03 16:10:27
Duration
12 s
Resource Profile Id:
0
Total Time Across All Tasks:
22 s
Locality Level Summary:
Process local: 2
Input Size / Records:
15.2 KiB / 3723833
Output Size / Records:
72.9 MiB / 3723833
Associated Job Ids:
156
DAG Visualization
digraph G { id="graph_167"; subgraph graph_stage_167 { id="graph_stage_167"; isCluster="true"; label="Stage 167"; subgraph cluster_873 { id="cluster_873"; isCluster="true"; label="Scan parquet "; 349 [id="node_349" labelType="html" label="FileScanRDD [349]<br>Spark Connect - session_id: "29cbf5ee-3bc4-44da-a6fe-5b90efeec9f0"\nplan {\n command {\n write_operation {\n input {\n common {\n ...}"]; 350 [id="node_350" labelType="html" label="MapPartitionsRDD [350]<br>Spark Connect - session_id: "29cbf5ee-3bc4-44da-a6fe-5b90efeec9f0"\nplan {\n command {\n write_operation {\n input {\n common {\n ...}"]; } subgraph cluster_870 { id="cluster_870"; isCluster="true"; label="WholeStageCodegen (1)"; 351 [id="node_351" labelType="html" label="MapPartitionsRDD [351]<br>Spark Connect - session_id: "29cbf5ee-3bc4-44da-a6fe-5b90efeec9f0"\nplan {\n command {\n write_operation {\n input {\n common {\n ...}"]; } } 349->350; 350->351; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time