/ Модель

Характеристики

Контекст
512 токенов
Лицензия
Apache 2.0
Архитектура
distilbert · dense
Опубликована
16 мар 2026

IrishCore-GlobalPointer-ContextPII-135M-v1-rc29

Разметка токеновТекст → label4 профессии

Модель на базе DistilBERT обнаруживает и маскирует персональные данные в ирландских и английских текстах для государственных и гражданских сервисов.

546скачиваний за 30 дней0лайковвеса обновлены16 мар 2026

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

IrishCore-GlobalPointer-ContextPII-135M-v1-rc29 — модель Temsa для обнаружения и маскирования персональных данных в текстах на ирландском и английском языках. Она использует архитектуру на основе DistilBERT с извлечением spans методом GlobalPointer и предназначена для потоков государственных служб Ирландии, HSE и поддержки граждан.

Модель выполняет однопроходное извлечение фрагментов PII из исходного текста и заменяет их метками вида [PII:LABEL]. Поддерживает контекстно- и ролево-зависимую политику декодирования для пользовательских сообщений, поисковых запросов и публичных ответов ассистента. В репозитории представлены веса Safetensors и граф ONNX; заявленная длина контекста — 512 токенов.

В README указаны высокие результаты на опубликованных наборах оценки для ирландских государственных сценариев, однако эти метрики относятся к конкретным тестовым наборам и не гарантируют аналогичного качества на произвольных данных. Релиз rc29 меняет политику декодирования и упаковку среды выполнения, сохраняя веса и граф ONNX версии rc25. Лицензия — Apache-2.0.

Сценарии применения

  • маскирование персональных данных в сообщениях граждан
  • обнаружение адресов и контактных данных в ирландских текстах
  • обезличивание публичных ответов чат-бота
  • защита пользовательских запросов и поисковых фраз перед обработкой
  • извлечение фрагментов PII для последующей замены метками

Ограничения

Указанные в README результаты получены на ограниченных оценочных наборах и не гарантируют такое же качество на произвольных текстах. Модель рассчитана на контекст до 512 токенов; описание рекомендует обрабатывать сообщения отдельно, не объединяя весь диалог в один текст.

Для каких профессий подходит4

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

IrishCore-GlobalPointer-ContextPII-135M-v1-rc29

IrishCore-GlobalPointer-ContextPII-135M-v1-rc29 is the current raw-only contextual PII masking release for Irish public-sector, HSE, and citizen-support flows.

It keeps the same weights and ONNX graph as the public temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc25, but adds a role-aware decode policy for assistant/public prose and fixes the shared decoder inventory handling.

Positioning

  • raw-only
  • scanner-free
  • validator-free
  • single-pass GlobalPointer span extraction
  • deterministic [PII:LABEL] replacement

What Changed

  • adds a role-aware decode policy: assistant_public for assistant/public prose, default for user turns and search queries

  • fixes the shared decoder so it respects the model label inventory instead of inventing contextual labels on non-context releases

  • keeps the same weights and ONNX graph as the previous public checkpoint; this is a decode/runtime packaging release

  • recovers Gaelic Árasán/Aonad + Teach/building-name + street address spans more completely

  • restores full prefixed Irish city forms such as nDún Dealgan instead of suffix fragments

  • keeps mixed contact phones after names/emails from being missed in assistant or user turns

  • adds the fresh unseen contextual exact holdout v20 to the public release bundle

Benchmarks

ONNX q8

SuiteF1Examples/s
Irish gov assistant public policy v11.000077.7081
Irish gov user contextual policy v11.000052.5213
Irish core1.0000232.6825
Gov contact policy v11.0000157.8220
Gov chatbot red-team v20.9861150.9410
Gov chatbot gap holdout v21.0000152.3345
Context holdout v18 exact1.0000156.9332
Context holdout v19 exact1.0000200.0472
Context holdout v20 exact1.0000158.2634
Multilingual PPSN overall0.9333297.5885
Multilingual PPSN label-only1.0000—

Evaluation Notes

  • eval/q8_irish_gov_assistant_public_policy_v1.json: role-aware assistant/public policy suite; measures the conservative assistant profile on English and Irish assistant text
  • eval/q8_irish_gov_user_contextual_policy_v1.json: role-aware user-contextual policy suite; measures the default profile on English and Irish user turns
  • eval/q8_globalpointer_context_holdout_v18_exact.json: fresh unseen contextual holdout for public-office addresses, mixed public/private contacts, and Irish month-name negatives
  • eval/q8_globalpointer_context_holdout_v19_exact.json: fresh unseen contextual holdout for standalone unit/building address spans and multilingual admin cue negatives
  • eval/q8_globalpointer_context_holdout_v20_exact.json: fresh unseen contextual holdout for Gaelic Teach/building spans, prefixed Irish city forms, mixed contact phones, and admin-code negatives
  • eval/q8_irish_gov_chatbot_gap_holdout_v2.json: Irish gov-chatbot holdout, 1.0000
  • eval/q8_irish_gov_chatbot_redteam_v2.json: Irish gov-chatbot red-team suite, 0.9861

Role-Aware Usage

Use the model per message, not on a flattened whole transcript.

  • --role user or --role search_query: uses the default contextual profile. This is the intended path for citizen turns and search queries.
  • --role assistant: switches to the conservative assistant_public profile. This keeps direct structured identifiers such as PHONE_NUMBER, EMAIL, and POSTCODE, but suppresses contextual/demographic labels such as AGE, DATE_OF_BIRTH, CITY, COUNTY, STREET_ADDRESS, FIRST_NAME, and LAST_NAME in public explanatory prose.
  • --profile ... overrides the role-derived default if you need explicit control.

Examples:

python3 inference_mask_onnx.py   --model temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc29   --role user   --text "I'm 76 and I live at Rose Cottage, Galway Road, Loughrea, Galway County (H62 HF96)."

python3 inference_mask_onnx.py   --model temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc29   --role assistant   --text "If you need to contact the Carer’s Allowance Section directly: Phone: 0818 927 999. Email: carers@example.gov.ie. Address: ... N39 E4E0."

For multi-turn transcripts, prefer the bundled role-aware helper instead of flattening the conversation into one string:

python3 inference_mask_messages_onnx.py \
  --model temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc29 \
  --input-file messages.json \
  --json
python3 inference_mask_onnx.py --model temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc29 --text "My PPSN is 1234567T and my address is Unit 6, Harbour Point, 19 Railway Road, Portlaoise, County Laois, R32 AB12."

Portfolio Comparison

Updated: 2026-03-16.

Use this section for the fastest public comparison across the temsa PII masking portfolio.

  • The first core table only includes public checkpoints that ship both comparable q8 accuracy and q8 CPU throughput.
  • The first PPSN table only includes public artifacts that ship comparable PPSN accuracy and CPU throughput.
  • Missing cells in the archive tables mean the older release did not ship that metric in its public bundle.
  • DiffMask rows use the reconciled clean_single_pass harness that matches the deployed runtime.
  • GlobalPointer rows use the public raw-only span-matrix release bundle and its packaged q8 ONNX artifact.
  • The same content is shipped as PORTFOLIO_COMPARISON.md inside each public model repo.

Irish Core PII: Comparable Public Checkpoints

RepoStackFull Core F1Q8 Core F1Q8 Multilingual PPSN F1Q8 Core ex/s
temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc64-layer GlobalPointer distilled fast student1.00001.00000.9333282.9
temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc54-layer GlobalPointer distilled fast student1.00001.00000.9333282.9
temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc34-layer GlobalPointer distilled fast student1.00001.00000.9333317.9
temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc24-layer GlobalPointer distilled fast student1.00001.00000.9333292.5
temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc14-layer GlobalPointer distilled fast student1.00001.00000.9333337.3
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc29GlobalPointer raw-only + context labels1.00001.00000.9333232.7
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc28GlobalPointer raw-only + context labels1.00001.00000.9333232.7
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc25GlobalPointer raw-only + context labels1.00001.00000.9333212.1
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc24GlobalPointer raw-only + context labels1.00001.00000.9333278.9
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc23GlobalPointer raw-only + context labels1.00001.00000.9333237.6
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc22GlobalPointer raw-only + context labels1.00001.00000.9333106.8
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc21GlobalPointer raw-only + context labels1.00001.00000.9333150.8
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc20GlobalPointer raw-only + context labels1.00001.00000.9333181.9
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc19GlobalPointer raw-only + context labels1.00001.00000.933373.1
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc18GlobalPointer raw-only + context labels1.00001.00000.9333126.2
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc17GlobalPointer raw-only + context labels1.00001.00000.9333125.5
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc16GlobalPointer raw-only + context labels1.00001.00000.9333125.5
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc15GlobalPointer raw-only + context labels1.00001.00000.9333125.5
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc14GlobalPointer raw-only + context labels1.00001.00000.9333119.2
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc13GlobalPointer raw-only + context labels1.00001.00000.9333126.1
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc12GlobalPointer raw-only + context labels1.00001.00000.933373.6
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc11GlobalPointer raw-only + context labels1.00001.00000.933394.1
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc10GlobalPointer raw-only + context labels1.00001.00000.9333125.8
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc9GlobalPointer raw-only + context labels1.00001.00000.9333119.8
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc8GlobalPointer raw-only + context labels1.00001.00000.9333128.9
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc7GlobalPointer raw-only + context labels1.00001.00000.933389.0
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc6GlobalPointer raw-only + context labels1.00001.00000.933389.0
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc5GlobalPointer raw-only + context labels1.00001.00000.933384.5
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc4GlobalPointer raw-only + context labels0.99350.99350.933361.5
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc3GlobalPointer raw-only + context labels0.99350.99350.933361.5
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc2GlobalPointer raw-only + context labels0.99350.99350.922261.5
temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc1GlobalPointer raw-only + context labels0.99350.99350.922261.5
temsa/IrishCore-GlobalPointer-135M-v1-rc4GlobalPointer raw-only span-matrix1.00001.00000.9333221.6
temsa/IrishCore-GlobalPointer-135M-v1-rc3GlobalPointer raw-only span-matrix1.00001.00000.9213204.9
temsa/IrishCore-GlobalPointer-135M-v1-rc2GlobalPointer raw-only span-matrix0.99340.99340.9326231.2
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc8Raw-only token-span0.97370.97370.917646.1
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc7Hybrid classifier + generated scanner spec1.00000.99341.000030.0
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc6Hybrid classifier + repair decoders1.00000.99341.000029.5
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5Hybrid classifier + repair decoders0.97370.96690.933334.4
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc4Hybrid classifier + repair decoders0.98700.97400.9600114.2
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc3Hybrid classifier + repair decoders0.98060.96770.933344.9
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc2Hybrid classifier + repair decoders0.95540.96150.7887119.1
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v1Hybrid classifier baseline0.95300.93330.9882103.3
temsa/IrishCore-DiffMask-135M-v1-rc6DiffMask token-span, scanner-free0.98010.97330.9274130.3
temsa/IrishCore-DiffMask-135M-v1-rc5DiffMask token-span, scanner-free0.97330.97330.9379249.2
temsa/IrishCore-DiffMask-135M-v1-rc4DiffMask token-span, scanner-free0.97330.97330.937129.5
temsa/IrishCore-DiffMask-135M-v1-rc3DiffMask token-span, scanner-free0.96640.96640.959130.0
temsa/IrishCore-DiffMask-135M-v1-rc2DiffMask token-span, scanner-free0.96640.96640.9212247.1
temsa/IrishCore-DiffMask-135M-v1-rc1DiffMask token-span, scanner-free0.98010.99340.9412251.2

Irish Core PII: Other Public Checkpoints

RepoStackFull Core F1Q8 Core F1Q8 Multilingual PPSN F1Notes
temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc1Hybrid classifier prototype0.9487——Predates the public q8 artifact.

Finance-boundary q8 F1 is 1.0000 for OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc6, OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc7, OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc8, and all public IrishCore-DiffMask releases from rc1 to rc6. OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5 ships 0.8750 on that public q8 suite.

PPSN-Only: Comparable Public Artifacts

RepoArtifactIrish Large F1Multilingual PPSN F1User Raw F1QA v8 F1CPU ex/s
temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1fp32 canonical checkpoint0.89790.97040.80000.738557.4
temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1-fp16fp16 CPU/GPU artifact—0.97040.80000.738545.8
temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1-q8dynamic int8 CPU artifact—0.9040——132.1

PPSN-Only: Historical Public Checkpoints

RepoMain Published MetricsNotes
temsa/OpenMed-PPSN-mLiteClinical-v1same as canonical fp32 repo: multilingual 0.9704, user raw 0.8000Legacy alias; prefer temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1.
temsa/OpenMed-PPSN-v6-raw-rc2irish_reg_v5 0.8750; user_raw 0.8000; qa_v8 0.7385Raw PPSN-only research checkpoint; no packaged multilingual CPU benchmark row.
temsa/OpenMed-PPSN-v5_1irish_large_v2 raw 0.9285; qa_v6 hybrid strict 1.0000Hybrid PPSN-only checkpoint; predates the canonical multilingual suite packaging.
temsa/OpenMed-PPSN-v5irish_reg_v5 raw 0.8235; irish_reg_v5 hybrid strict 1.0000Hybrid PPSN-only checkpoint; predates the canonical multilingual suite packaging.
temsa/OpenMed-PPSN-v4synthetic non-PPSN drift check onlyPredates the current PPSN eval suite; no packaged apples-to-apples multilingual CPU row.

If you need the strongest current raw-only Irish core model, start with IrishCore-GlobalPointer-135M-v1-rc4. If you need the fastest CPU-first raw-only line, compare it against IrishCore-DiffMask-135M-v1-rc6. If you need a PPSN-only artifact, compare the canonical fp32, fp16, and q8 variants of OpenMed-mLiteClinical-IrishPPSN-135M-v1 directly in the table above.

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · token-classification

Можно запустить

Подбираем GPU…

Класс архитектуры
IrishCoreGlobalPointerModel
Ревизия весов
1cce3d6

0 моделей