The computing power available to run AI applications such as chatbots and agents for the user. Inference is an old AI term that dates back to early expert systems. The inference software uses an AI model that has been trained on massive amounts of general data or specific data depending on the intended use. See
inference and
expert system. Contrast with
training compute.