The execution of an AI system. An inference engine comprises the hardware and software that produces results. Years ago and relying entirely on human rules, "expert systems" were the first AI inference engines; however, today's neural networks and GPTs have greatly surpassed them in capability. In both old and new AI systems, the actual computer processing is performed by an inference engine.
Inference vs. Training
The inference engine is the processing component of an AI in contrast to the fact gathering or learning side of the system, which uses considerably more computer power. In today's world, the inference engine makes decisions and predictions and generates original content. See
AI training vs. inference,
AI processing methods,
AI training,
neural network,
GPT,
deep learning and
expert system.