I run a SearXNG instance and rate limiting has never been a issue until now. so i wanted to ask what the cheapest and most privacy respecting vpn/proxys are to use.

  • shrek_is_love@lemmy.ml
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 day ago

    Take this with a grain of salt since I haven’t done much scraping (yet; I have a project I just started planning)

    I’ve heard you’re more likely to get blocked for using a VPN since some sites will block requests originating from data centers, which is less likely to happen coming from a residential IP address. (Although if you’re already using a VPS, the right proxy may help)

    This might be useless advice, but it might just be best to increase (and randomize) the amount of time between requests.

    And to answer your question, Mullvad is what I use, and it’s what I see reccomended (from both Reddit, and The Wirecutter) the most often because they store so little of your data, and you can even pay in cash.