Skip to content

Latest commit

 

History

History
77 lines (65 loc) · 1.74 KB

ramalama-inspect.1.md

File metadata and controls

77 lines (65 loc) · 1.74 KB

% ramalama-inspect 1

NAME

ramalama-inspect - inspect the specified AI Model

SYNOPSIS

ramalama inspect [options] model

DESCRIPTION

Inspect the specified AI Model about additional information like the repository, its metadata and tensor information.

OPTIONS

--all

Print all available information about the AI Model. By default, only a basic subset is printed.

--help, -h

Print usage message

--json

Print the AI Model information in json format.

EXAMPLES

Inspect the smollm:135m model for basic information

$ ramalama inspect smollm:135m
smollm:135m
   Path: /var/lib/ramalama/models/ollama/smollm:135m
   Registry: ollama
   Format: GGUF
   Version: 3
   Endianness: little
   Metadata: 39 entries
   Tensors: 272 entries

Inspect the smollm:135m model for all information in json format

$ ramalama inspect smollm:135m --all --json
{
    "Name": "smollm:135m",
    "Path": "/home/mengel/.local/share/ramalama/models/ollama/smollm:135m",
    "Registry": "ollama",
    "Format": "GGUF",
    "Version": 3,
    "LittleEndian": true,
    "Metadata": {
        "general.architecture": "llama",
        "general.base_model.0.name": "SmolLM 135M",
        "general.base_model.0.organization": "HuggingFaceTB",
        "general.base_model.0.repo_url": "https://huggingface.co/HuggingFaceTB/SmolLM-135M",
        ...
    },
    "Tensors": [
        {
            "dimensions": [
                576,
                49152
            ],
            "n_dimensions": 2,
            "name": "token_embd.weight",
            "offset": 0,
            "type": 8
        },
        ...
    ]
}

SEE ALSO

ramalama(1)

HISTORY

Feb 2025, Originally compiled by Michael Engel [email protected]