Raspberry Pi + Squid: Building a Proxy Server with your Raspberry Pi for Web-scraping

Great tutorial! I would love to connect a few of these to a single RPI to monitor my filament containers. Do you know if that is possible? And, if so, maybe where there is a howto on something like that?

But if the raspberry "proxy" is on the same local network isn't it using the same public ip address to do webscrapping ? Shouldn't this raspberry proxy be on a network with a different ISP provided public ip so that it can be leveraged correctly to avoid throttling ?

How can you adjust the squid.conf to allow remote use of the proxy? If I set the proxy I made as my browser proxy on my laptop it works great when I’m connected to the same wifi network but if I’m at a friends house on their wifi and try using the proxy as my browser proxy, it will not prompt for user authentication hence disallowing remote connection.

Great tutorial! I was wondering if we could use 3-4 4G LTE modems and rotate the IPs whenever there's a block. Do you have any suggestions on how to achieve this? Please provide some guidance.

I loved to use tail -f comand to the squid log. so I get the real time ip and connections the client was connecting to. it was very helpful to diagnose what IP's i need to block in the firewall

Can you make 2 VM raspberry. One is act like client and the other one is a proxy server squid

Is there any Web-Interface for a Proxy? Like simple remote (web) config und reading logs etc within the lan?

Does integrating HasData's scraping API enhance the performance of a Squid proxy on Raspberry Pi for web scraping tasks?