4.1.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Connect
Spark Connect server
application UI
Details for Stage 16 (Attempt 0)
Submitted:
2026/08/31 22:16:42
Duration
93 ms
Resource Profile Id:
0
Total Time Across All Tasks:
65 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
15.5 KiB / 2
Associated Job Ids:
11
DAG Visualization
digraph G { id="graph_16"; subgraph graph_stage_16 { id="graph_stage_16"; isCluster="true"; label="Stage 16"; 49 [id="node_49" labelType="html" label="JsonFile: file:/home/jovyan/data/openaq-api-data/bidhannagar_20260831_214910.json,file:/home/jovyan/data/openaq-api-data/bidhannagar_20260831_220410.json [49]<br>Spark Connect - session_id: "f486fc65-e5b0-488d-9a87-31e3485cc012"\nplan {\n root {\n common {\n plan_id: 4\n }\n limit {\n inpu...}"]; subgraph cluster_45 { id="cluster_45"; isCluster="true"; label="map"; 50 [id="node_50" labelType="html" label="MapPartitionsRDD [50]<br>Spark Connect - session_id: "f486fc65-e5b0-488d-9a87-31e3485cc012"\nplan {\n root {\n common {\n plan_id: 4\n }\n limit {\n inpu...}"]; } subgraph cluster_46 { id="cluster_46"; isCluster="true"; label="mapPartitions"; 51 [id="node_51" labelType="html" label="MapPartitionsRDD [51]<br>Spark Connect - session_id: "f486fc65-e5b0-488d-9a87-31e3485cc012"\nplan {\n root {\n common {\n plan_id: 4\n }\n limit {\n inpu...}"]; } } 49->50; 50->51; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time