Tadpole - NFHN Reader

Write Declarative, Modular Scraping Code

Section titled “Write Declarative, Modular Scraping Code”

Tadpole is built to be composable by allowing you to import modules from local files or remote repositories! All of the complexity of interacting with the browser is now completely abstracted away by the language! Building scrapers has never been easier!

tadpole run redfin.kdl --input '{"text": "Seattle, WA"}' --auto --output output.json

redfin.kdl
output

import "modules/redfin/mod.kdl" repo="github.com/tadpolehq/community"
main {
  new_page {
    redfin.search text="=text"
    wait_until
    redfin.extract_from_card extract_to="addresses" {
      address {
        redfin.extract_address_from_card
      }
    }
  }
}