ESM-2
Analyze protein sequences and generate embeddings.
Analyze protein sequences and generate embeddings.
ESM-2 is a family of protein language models developed by Meta AI. ProteinIQ runs the 650 million parameter model, esm2_t33_650M_UR50D, which has 33 transformer layers and produces 1280 features per amino acid. It learns sequence representations through masked amino acid prediction rather than requiring an experimental structure as input.
An embedding is a numerical representation of a residue in its sequence context. The downloaded arrays can become inputs to a classifier, clustering analysis, or other downstream model. Individual embedding dimensions do not correspond to named physical properties or probabilities.
This tool returns embeddings, not predicted coordinates, function annotations, or mutation scores. For a predicted protein structure, use ESMFold.
Paste protein sequences in FASTA format, upload a sequence file, or fetch sequences by RCSB PDB ID. Select a representation layer and whether to include mean pooling. ProteinIQ returns downloadable NumPy arrays for every sequence, with a heatmap preview for inspecting the embeddings without a local model installation.
| Input or setting | Accepted values and behavior |
|---|---|
Protein | FASTA text or .fasta, .fa, and .txt files. An RCSB fetch option retrieves sequences from a PDB entry. |
Representation layer | 33 (default), 24, 12, or 6. One layer is extracted per run. |
Include mean pooling | On by default. Adds one vector per sequence alongside the per-residue array. |
Each FASTA record is processed separately, in its original order, and its full header identifies the result. Uploaded files can contain multiple records. Results also retain the attachment identity and record position so repeated headers in separate files remain distinguishable. Duplicate headers within one FASTA file are rejected by ESM's parser.
Use uppercase sequences. ESM's own tokenizer accepts the standard amino acids,
X, B, U, Z, O, . and -. ProteinIQ preserves these symbols rather than
deleting them. Unsupported tokens produce an error instead of being silently
removed. Previously saved results retain their original interpretation.
Keep the checkpoint and representation layer consistent when combining embeddings into a dataset. Equal array dimensions do not make features from different layers interchangeable. Layer 33 is the default starting point; compare layers on held-out data when choosing features for a predictive model.
ESM-2 uses a transformer architecture similar to large language models, but trained on protein sequences instead of text. The model processes sequences using self-attention, where each amino acid attends to all other positions to build context-aware representations.
During training, amino acids are masked and the model predicts their identities from surrounding sequence context. The hidden representations learned for this task can then be extracted without training a new model for each input sequence.
The per-residue output has shape (L, 1280), where L is the sequence length. ProteinIQ removes the beginning and end special tokens before saving the array. With mean pooling enabled, it averages those residue rows into a single vector of shape (1280,).
ESM-2 outputs embeddings in NPY format. Result metadata retains the original sequence label. File names normally use that label; colliding names receive a suffix, and labels that cannot safely form a file path receive a generated name. No tensor is discarded because two labels match.
| File | Shape | Intended use |
|---|---|---|
<label>_embeddings.npy | (L, 1280) | Residue-level features, such as inputs to a model that labels each sequence position. |
<label>_mean_embedding.npy | (1280,) | One feature vector per protein for sequence-level classification or clustering. Only included when mean pooling is enabled. |
Array row zero corresponds to the first input residue. For a 76-residue sequence, the expected shape is (76, 1280). A residue numbered 42 in that input is at array row 41; PDB residue numbers are not stored as the array index.
Mean pooling gives proteins of different lengths the same feature-vector size. It discards the separate representation of each position, so use the per-residue array when a downstream task needs to locate a motif or label individual residues.
The preview samples embedding dimensions and, for longer sequences, residue positions. Its colors are normalized within each sequence for display. Download the NPY files for numerical comparisons; heatmap colors are not confidence scores, and similar-looking plots do not establish functional similarity.
ESM-2 embeddings can be reused as fixed input features for a classifier or regressor. Preserve sequence identifiers, layer selection, and the train/test split alongside the arrays so results remain reproducible.
Clustering or cosine similarity can help prioritize sequences for further investigation. An embedding neighbor is a candidate relationship, not proof of shared function. HMMER can test sequence homology against a supplied protein database and report statistical evidence for matches.
For variant studies, these arrays can support a model trained on measured effects. A large distance between wild-type and mutant embeddings alone does not establish whether a mutation is beneficial, harmful, or neutral.
Sequence embeddings do not explicitly describe ligands, solvent, experimental conditions, or the chemistry of post-translational modifications. Use protein sequence input rather than structure coordinates or chemical modification notation.
Memory use increases with sequence length. ProteinIQ processes each submitted sequence as a whole; this tool does not automatically split long proteins into chunks. Splitting a sequence externally changes the context available to the model, so chunk-derived features should not be treated as equivalent to full-sequence embeddings.
The usefulness of embeddings depends on the downstream task and its evaluation data. Test performance on the kinds of proteins being studied, especially when applying a model trained on natural sequences to engineered designs.
Predict non-germline residues and generate embeddings for paired or unpaired antibody sequences.
Generate protein embeddings with ESM-C.
Bidirectional translation between protein sequences and 3Di structural tokens
Score amino acid substitutions with masked protein language models.
Predict protein aggregation nucleation propensity from amino acid sequences.
Predict protein solubility from sequence with feature-level and windowed profile outputs.
Identify co-evolving residue sectors in protein families using Statistical Coupling Analysis.
Restore residues and generate antibody-specific representations or likelihood scores.
Score single and multi-site protein mutations with evolutionary and inverse-folding profiles.
Predict protein stability changes across single amino acid substitutions.