Settings

Theme

Prompts for Cleaning and Processing Data with AI

subsystem.ai

2 points by cccybernetic 2 years ago · 2 comments

Reader

cccyberneticOP 2 years ago

A blog on using using LLMs to clean, process, and enrich data. It includes prompts and code snippets. The post draws on my experiences and two really interesting papers:

- Can Foundation Models Wrangle Your Data? (https://arxiv.org/abs/2205.09911)

- Large Language Models as Data Preprocessors (https://arxiv.org/abs/2308.16361)

I cover:

- Error and Anomaly Detection

- Enriching Data with LLMs

- Matching Data Labels

- Identifying Matching Records

Thank you and I'd appreciate your feedback.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection