Posts on John Paulett

ModernBERT in Radiology Part 3: Fine-tuning a Classifier

Tue, 07 Jan 2025 18:00:00 -0500

In Part 3 of the ModernBERT in Radiology series, we will fine-tune a ModernBERT Classifier to predict the UMLS CUIs given a radiology report. It will combine our fine-tuning from Part 2 to produce a better classifier than the simple scikit-learn Logistic Regression from Part 1.

You can follow along with the associated Colab Notebook for Part 3🔥!

The ModernBERT in Radiology Series

Part 1: Simple Classifier using Hidden States.

Build a multi-label classification using a simple scikit-learn Logistic Regression model on top of the pre-trained ModernBERT body.

ModernBERT in Radiology Part 2: Fine Tuning a Masked Language Model (MLM)

Mon, 06 Jan 2025 17:00:00 -0500

In Part 2 of the ModernBERT in Radiology series, we will fine-tune ModernBERT against the ROCOv2 dataset for Radiology for the Masked Language Model task so that given an input of ninth [MASK] fracture the model would predict ninth rib fracture.

You can follow along with the associated Colab Notebook for Part 2🔥!

The ModernBERT in Radiology Series

Part 1: Simple Classifier using Hidden States.

Build a multi-label classification using a simple scikit-learn Logistic Regression model on top of the pre-trained ModernBERT body.

ModernBERT in Radiology Part 1: Simple Classifier using Hidden States

Sun, 05 Jan 2025 07:00:00 -0500

In Part 1 of the ModernBERT in Radiology series, we will explore ModernBERT and the ROCOv2 dataset for Radiology. We build a multi-label classifier using a simple Logistic Regression model on top of the pre-trained ModernBERT body.

You can follow along with the associated Colab Notebook for Part 1🔥!

The ModernBERT in Radiology Series

Part 1: Simple Classifier using Hidden States. 👈 This Post

Build a multi-label classification using a simple scikit-learn Logistic Regression model on top of the pre-trained ModernBERT body.

And we're back

Sun, 22 Dec 2024 18:39:58 -0500

After setting up by bluesky to use a custom @johnpaulett handle (learn how set up your own domain handle), a friend pointed out my website was dead! Apparently sometime in the past 15 years (🤯) without touching it, my custom Django blog app written in Django v1.3 got disconnected from its Heroku Postgres.

Figured I should simplify the setup, since there is no need to have a database and app server (that costs $10/mo) to serve a blog that probably gets a few pageviews a month, a static generated site will work.