Settings

Theme

Show HN: PyScrappy, self-healing web scraping selectors plus an MCP server

github.com

22 points by vedaant00 · 5 comments

Reader

1 thread
rhythmshahriar

does the inmemory cache has a max size to eviction policy, or will a long running mcp server with cache_ttl enabled accumulate entries indefinitely until process restart?

  • vedaant00OP

    Good question. PyScrappy's shared response cache is LRU-bounded with a configurable max size (cache_max_size, default 512), so it won't grow indefinitely even for a long-running MCP server hitting many distinct URLs. Oldest entries are evicted at the cap, expired ones are dropped on access, and reads promote to most-recently-used, so it stays bounded regardless of access pattern. Just shipped this in the latest release.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection