Difference between revisions of "Mistral AI"

From wikieduonline
Jump to navigation Jump to search
 
(10 intermediate revisions by the same user not shown)
Line 1: Line 1:
[[wikipedia:Mistral AI]]
+
[[wikipedia:Mistral AI]] ([https://www.crunchbase.com/organization/mistral-ai Crunchbase])
  
 
* [[Arthur Mensch]], [[Timothée Lacroix]] and [[Guillaume Lample]]
 
* [[Arthur Mensch]], [[Timothée Lacroix]] and [[Guillaume Lample]]
  
* [[Mixtral 8x7B]]
+
* Products:
 +
** [[Mistral 7B]], [[Mixtral 8x7B]]
 +
** [[Mistral Small]], [[Mistral Medium]], [[Mistral Large]]
  
  
{{LLM}}
+
[[Mistral 7B]] uses [[Grouped-query attention (GQA)]] intended for faster inference and [[Sliding Window Attention (SWA)]] intended to handle longer sequences
 +
 
 +
== Related ==
 +
* <code>[[ollama run mistral]]</code>
 +
* <code>[[ollama run dolphin-mistral:latest]]</code>
 +
* [[token]]
 +
* [[Amazon Bedrock]]
 +
 
 +
== See also ==
 +
* {{Mistral}}
 +
* {{LLM}}
 +
 
 +
[[Category:AI]]

Latest revision as of 09:51, 10 April 2024

Advertising: