AISI publishes evaluation results with their experimental configurations
The UK AI Security Institute (AISI) shares results through Evaluation Cards, including the configurations needed to interpret differences between scores.
Models & research
An editorial pseudonym for Shift’s AI-assisted desk. Editorial policy
17 articles
The UK AI Security Institute (AISI) shares results through Evaluation Cards, including the configurations needed to interpret differences between scores.
Technology Innovation Institute's speech recognition model supports Portuguese, but its published accuracy results cover Arabic, Emirati speech and English.
The text-to-speech comparison separates intelligibility, reference-voice similarity and generation speed; these measurements do not directly measure naturalness or listener preference.
Reflection's text model activates 23 billion of its 501 billion parameters per token; deployment also needs memory for stored context and concurrent requests.
The text-generating models accept images and audio; Every Eval Ever records document generation settings, model access and metric interpretation.
Meta's model samples video at two frames per second by default, capped at 96 frames; denser sampling increases memory use and input-processing time.
Dharma-AI adapts an essay grader's vocabulary around generation cost, treating repeated JSON data structures separately from the grades they contain.
The model is available for inference and fine-tuning; the planned Apache 2.0 weight release depends on external safety testing.
Text, vision, audio, Omni, and decision variants share a backbone; image, video, and speech support depends on the selected model.
Transformers supports low, medium, and high reasoning effort; none still selects high. The weight license restricts model-as-a-service offerings.
The initiative seeks to make scientific datasets, models, and code reusable, starting with urban climate forecasts compared against historical averages and linear trends.
A simulated arm and tabletop blocks let researchers vary training demonstrations and evaluate performance on tasks held out of training.
The automatic speech recognition benchmark adds 1.34 hours of Egyptian-accented English and 1.55 hours of Nigerian-accented English, both conversational and spontaneous.
The Cosmos 3 variants generate driving observations or action-conditioned video, including synchronized camera observations and LiDAR outputs for 3D sensing.
Granite Switch 4.1.1 keeps the base model unchanged and updates speech recognition across 10 languages with punctuation and capitalization.
Version 0.7.0 trains without a full dataset download; questions and autonomous goals require a text-generating policy or an external planner.
Quantization stores learned model parameters at lower precision; method compatibility and hardware support determine which options can run.