Skip to content

feat(server-utils): Record time to first chunk on streamed gen_ai spans #66462

feat(server-utils): Record time to first chunk on streamed gen_ai spans

feat(server-utils): Record time to first chunk on streamed gen_ai spans #66462

Job Run time
10s
3s
1m 43s
37s
0s
1m 35s
1m 7s
1m 4s
1m 13s
12m 7s
1m 41s
1m 45s
1m 19s
1m 51s
2m 17s
2m 1s
2m 1s
5m 43s
4m 52s
1m 32s
2m 13s
1m 44s
1m 2s
1m 49s
2m 3s
2m 15s
2m 2s
1m 58s
1m 28s
2m 22s
56s
1m 59s
2m 18s
2m 58s
1m 47s
2m 30s
2m 9s
1m 41s
2m 23s
2m 28s
1m 35s
2m 3s
2m 44s
2m 56s
2m 42s
2m 25s
2m 10s
2m 40s
2m 17s
2m 11s
3m 2s
3m 8s
2m 33s
2m 55s
2m 21s
2m 9s
2m 37s
2m 14s
2m 9s
3m 20s
2m 57s
2m 44s
2m 49s
2m 9s
2m 20s
2m 44s
2m 32s
2m 45s
3m 0s
0s
2m 44s
2m 7s
3m 13s
2m 23s
2m 58s
0s
0s
0s
38s
1m 2s
59s
2m 26s
2m 44s
2m 11s
55s
1m 4s
59s
1m 3s
33s
1m 31s
1m 8s
35s
39s
2m 39s
46s
37s
1m 26s
49s
37s
1m 1s
1m 45s
27s
1m 2s
41s
1m 25s
38s
43s
18s
1m 0s
33s
36s
20s
25s
40s
1m 9s
24s
26s
34s
26s
56s
42s
38s
22s
1m 47s
1m 17s
24s
47s
49s
57s
47s
1m 2s
3m 13s
1m 17s
34s
46s
45s
3m 29s
49s
40s
1m 18s
45s
36s
49s
30s
2m 26s
41s
27s
37s
34s
27s
37s
28s
49s
31s
36s
36s
1m 5s
37s
37s
51s
1m 12s
22s
1m 14s
40s
30s
1m 5s
37s
49s
41s
1m 27s
54s
37s
37s
31s
1m 11s
1m 9s
1m 29s
42s
1m 25s
30s
35s
41s
49s
38s
43s
1m 22s
48s
1m 37s
26s
34s
56s
46s
53s
35s
27s
55s
55s
28s
45s
32s
53s
50s
1m 2s
36s
56s
48s
32s
1m 14s
37s
1m 50s
40s
1m 4s
1m 51s
1m 48s
1m 28s
32s
1m 56s
45s
31s
43s
2m 1s
1m 2s
46s
36s
57s
34s
44s
1m 5s
28s
1m 10s
55s
1m 42s
35s
35s
1m 15s
25s
1m 3s
1m 50s
2m 16s
35s
1m 5s
1m 33s
46s
51s
1m 39s
38s
1m 42s
37s
30s
35s
38s
39s
1m 22s
34s
32s
1m 48s
1m 49s
2m 15s
2m 28s
2m 22s
2m 0s
2m 24s
2m 12s
2m 25s
1m 56s
33s
36s
2m 20s
49s
51s
2m 24s
2m 48s
30s
1m 52s
2m 58s
2m 9s
2m 21s
2m 5s
50s
2m 7s
35s
1m 50s
36s
2m 17s
2m 19s
2m 15s
1m 27s
1m 23s
2m 28s
53s
46s
2m 18s
1m 23s
1m 49s
1m 2s
1m 6s
0s
4s
6h 49m 35s