Settings

Theme

Scrapingworld.com – Scraping Directory: components, providers, knowledge base

scrapingworld.com

10 points by kaltsturm 5 years ago · 12 comments

Reader

varenc 5 years ago

Interesting collection of resources.

I found the residential IP proxy services a bit eyebrow raising. This one, https://luminati.io/ethical, apparently gets their residential IPs by having app developers embed the Luminati SDK. So when you use their proxy network, your request will be routed through some oblivious person’s phone or laptop. I assume that the requests can’t be end to end encrypted and that whatever user whose device is making the request will be able to see it.

While there’s certainly some legitimate and even noble uses of residential IP proxies, I can think of plenty nefarious ones too. Must be a constant challenge for this company to combat that. If they do.

  • kaltsturmOP 5 years ago

    Thank you for sharing your insights - indeed. If residential proxies are needed for scraping, we shall keep your insights in mind.

hombre_fatal 5 years ago

If you're going to start a directory, why wouldn't you do the research to seed it with elementary content? Your only info link is a wikipedia link about scraping and you're hoping people email you with more links.

Seems a bit bizarre to me.

  • kaltsturmOP 5 years ago

    You are right - we just wanted to kickstart and will work on our own for sure to add more content. What are your top links with respect to scraping?

deaquino 5 years ago

Chrome Extension: https://www.webscraper.io/

kaltsturmOP 5 years ago

Do you know of any site-specific scraping services, e.g. eBay, Google, ... ?

kaltsturmOP 5 years ago

If you miss functionality - not content - on scrapingworld.com, please comment here.

kaltsturmOP 5 years ago

If you miss best in class links for - providers - knowledge posts - components

please comment here - we will add them on scrapingworld.com

elxavicio 5 years ago

Check out proxyland.io!

bhargavdigi 5 years ago

nice thanks for sharing us

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection