Polly NER token-classification model

Model summary

This standard Transformers token-classification model predicts these configured contiguous entity types: DISEASE, GENE_PROTEIN. Token labels use deterministic BIO encoding, while Polly NER returns character spans.

• Base model: microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext at immutable revision e1354b7a3a09615f6aba48dfad4b7a613eef7062
• Polly NER source: ssh://github.com/ElucidataInc/polly-ner.git at commit b73b3012e113e58c8f1a7f6426e14fd838527c08
• W&B run: Not available

Training data references

The private training data is referenced for provenance only. No corpus text, record metadata, predictions, or error examples are included in this repository.

• train: ElucidataInc/curated-ner-corpus-gene-disease at 3d6ec920a6b06009162cb9553de41bd53e79e80c, configuration default, split train
• validation: ElucidataInc/curated-ner-corpus-gene-disease at 3d6ec920a6b06009162cb9553de41bd53e79e80c, configuration default, split validation
• evaluation: ElucidataInc/curated-ner-corpus-gene-disease at 3d6ec920a6b06009162cb9553de41bd53e79e80c, configuration default, split test

Intended uses

• Detect configured named-entity mentions in caller-supplied text.
• Run through Polly NER for deterministic character spans or through the native Transformers token-classification pipeline.

Non-goals and limitations

• This model does not perform entity linking, normalization, relation extraction, abbreviation resolution, or assertion classification.
• It supports contiguous, non-overlapping entities only.
• Inputs are not split or truncated. Callers must keep text within the model context limit and manage document chunking and cross-chunk merging themselves.
• Predictions can be incomplete or incorrect and require task-appropriate review.

Evaluation

Metrics require exact equality of character start, end, and semantic label.

Training configuration summary

{
  "experiment": "curated-gene-disease-v0.1",
  "gradient_accumulation_steps": 1,
  "learning_rate": 3e-05,
  "mixed_precision": "no",
  "num_train_epochs": 10.0,
  "per_device_train_batch_size": 16,
  "seed": 42,
  "warmup_ratio": 0.0,
  "weight_decay": 0.0
}

Polly NER inference

from polly_ner import NERPredictor

predictor = NERPredictor.from_pretrained(
    "ElucidataInc/polly-ner-gene-disease",
    revision="v0.1.0",
)
result = predictor.predict(
    id="example-1",
    text="Example entity text.",
)

Native Transformers inference

from transformers import pipeline

ner = pipeline(
    "token-classification",
    model="ElucidataInc/polly-ner-gene-disease",
    revision="v0.1.0",
    aggregation_strategy="simple",
)
predictions = ner("Example entity text.")

License

The releaser supplied the license identifier mit. Review the license and organizational approval before publication.