No items found.
7:30
7:30
9:00
9:10
9:30
9:30
9:45
9:50
10:00
10:15
10:30
10:30
10:30
10:45
10:50
11:00
11:00
11:30
11:30
11:30
11:45
11:50
12:00
12:00
12:15
12:30
12:30
12:45
13:00
13:00
13:30
14:00
14:00
14:00
14:15
14:30
14:40
14:45
15:00
15:00
15:05
15:10
15:15
15:20
15:20
15:25
15:30
15:30
15:35
15:40
15:40
15:45
15:50
15:55
16:00
16:00
16:15
16:20
16:30
16:40
16:45
17:00
17:10
17:15
17:30
17:30
17:35
18:00
7:30
9:00
9:10
9:30
9:30
9:50
10:00
10:00
10:10
10:15
10:30
10:30
10:50
11:00
11:00
11:05
11:10
11:15
11:25
11:30
11:35
11:45
11:50
11:55
12:00
12:15
12:30
12:30
12:45
13:00
13:00
14:00
14:00
14:00
14:15
14:30
14:30
14:40
14:45
15:00
15:10
15:15
15:30
15:30
15:40
15:45
16:00
16:00
16:00
16:15
16:30
16:30
16:45
17:00
17:00
17:10
17:15
17:30
17:35
17:40
17:40
17:45
17:50
17:50
17:55
18:00
18:00
Go back to Agenda
Thu
11 Jun
10:10 am
-
10:50 am

The New AI Bottleneck: Inference at Scale

As AI moves from model training to real-world deployment, inference is becoming the defining bottleneck across cost, latency, throughput and the infrastructure needed to serve intelligence at global scale.

40 min
Plaud Main Stage

About

As AI moves from model training to real-world deployment, inference is becoming the defining bottleneck across cost, latency, throughput and the infrastructure needed to serve intelligence at global scale.

Powered By

Speakers

3D wireframe model of a human brain in gray on a white background.
Andy Hock
CSO and SVP
Cerebras Systems
3D wireframe model of a human brain in gray on a white background.
Shantu Roy
VP, Developer Relations
Arm
AI Infrastructure
Byung Gon Chun3D wireframe model of a human brain in gray on a white background.
Byung-Gon Chun
Founder and CEO
FriendliAI
AI Infrastructure

Moderator

3D wireframe model of a human brain in gray on a white background.
Kate Park
Contributing Writer
TechCrunch
Advertising / Media
Previous Session
Previous
Next Session
Next
All tickets sold out

Ticket sales now closed

SuperAI KV key visual