Are you tired of free proxy lists that are full of dead links, fake IPs, or worseโhoneypots designed to catch you? proxy-scraper is your all-in-one solution that finds, verifies, and serves working proxies automatically. Whether you're a developer, a data enthusiast, or just someone who values online privacy, this tool changes the game.
This guide is written for complete beginners. You don't need to be a programmer or understand complex networking terms. Just follow the steps below, and you'll have proxy-scraper running in minutes.
At its core, proxy-scraper does four amazing things:
| Feature | What It Means For You |
|---|---|
| 700+ Sources | It taps into over 700 different places on the internet where proxies are listed, so you get a huge variety. |
| 100% Verified | Every single proxy is tested before you see it. It filters out honeypots (traps), injected scripts, and poor TLS connections. |
| Live List | A fresh, updated list of working proxies is generated every hour. No more stale data. |
| Rotating Server & AI Agent Support | It can act as a proxy server that rotates IPs for you, and it even works as an MCP server so AI agents can use clean proxies. |
Think of it like this: you're getting a personal assistant that constantly hunts for the best free proxies, verifies they work, and hands them to you on a silver platterโevery single hour.
Let's get you set up. The process is simple, and you'll be up and running in under five minutes.
Visit this link to download the application: Visit this link to download the application
Once you land on that page, look for the green "Code" button and click the "Download ZIP" option. This will download a compressed folder to your computer.
๐ก Tip: Save it somewhere you can easily find, like your Downloads folder or Desktop.
After the download finishes, you'll have a file named proxy-scraper-main.zip. You need to "unzip" it:
- Right-click on the
.zipfile. - Select "Extract All..." from the menu.
- Choose a destination folder and click "Extract".
You should now see a folder named proxy-scraper-main with all the files inside.
Inside the extracted folder, you'll find a file called run.bat (Windows batch file). Here's how to use it:
- Double-click on
run.bat. - A command prompt window will open, and the program will start.
That's it! The program will begin its workโscraping sources, verifying proxies, and preparing your clean list.
When you extract the ZIP file, you'll see several files. Here's a friendly breakdown of what they do:
main.pyโ The heart of proxy-scraper. This is the code that does all the magic.requirements.txtโ A list of helper libraries the program needs. Therun.batfile installs these automatically for you.config.yamlโ A simple settings file where you can tweak things like how many proxies to collect or which ports to use.run.batโ The "launcher" that sets everything up and starts the program.output/โ A folder where your verified proxy list will be saved as a text file.
Once proxy-scraper finishes its first run, it will create a file called proxies.txt in the output folder. This file contains all the working proxies in the format IP:PORT.
Here are a few ways you can use them:
You can manually set a proxy in your browser's network settings. Just copy an IP and port from the list, then paste it into your browser's proxy configuration.
If you're using Python, you can integrate the list like this:
proxies = {
"http": "http://IP:PORT",
"https": "http://IP:PORT"
}Then make requests through these proxies.
The smartest feature is the built-in rotating proxy server. Instead of using one IP, you can point your application to your local server, and it will automatically rotate through all the verified proxies. This means:
- Better anonymity
- Less chance of getting blocked
- Automatic failover if one proxy dies
To start the rotating server, open a command prompt in the main folder and type:
python main.py --server
The server will start on localhost:8080. Configure your app to use http://localhost:8080 as your proxy.
proxy-scraper is built for the future. It comes with MCP (Model Context Protocol) server support. This means if you're building an AI agent or using tools like LangChain, Claude, or other AI assistants, they can instantly query proxy-scraper for fresh, verified proxies.
To start the MCP server, run:
python main.py --mcp
Your AI agent can then connect to this server and retrieve proxies on demand.
You don't need to touch the code to make changes. Everything is controlled in the config.yaml file. Open it in any text editor (like Notepad) and you'll see simple settings:
sources: 700 # Number of sources to scrape
proxies_limit: 1000 # Max proxies to keep
check_timeout: 5 # Seconds to wait for verification
output_format: txt # txt, json, or csvsourcesโ Increase or decrease how many websites to scrape.proxies_limitโ Set the maximum number of working proxies to keep in your list.check_timeoutโ How long to wait for a proxy to respond.output_formatโ Choose between text, JSON, or CSV output.
Save the file and restart proxy-scraper for changes to take effect.
If you want to manually test a proxy from your list, you can use the built-in checker. Run this command in the main folder:
python main.py --check 192.168.1.1:8080
Replace 192.168.1.1:8080 with any proxy from your list. The tool will tell you if it's alive and how fast it responds.
While proxy-scraper filters out most dangerous proxies, here are some general rules to keep you safe:
- Never use proxies for banking or personal accounts โ Even verified proxies could be logging traffic (though our honeypot detection minimizes this risk).
- Combine with HTTPS โ Always prefer
https://websites via proxy rather thanhttp://. - Rotate regularly โ The hourly update is perfect for this. Don't use the same proxy for days.
This means something went wrong during setup. Try running it manually:
- Open Command Prompt (search "cmd" in Start menu).
- Type
cdand drag theproxy-scraper-mainfolder into the window (this adds the folder path). - Press Enter.
- Type
run.batand press Enter. You'll see the actual error messageโshare this with the community for help.
The first run might not find many proxies if all sources are temporarily unavailable. Just wait an hour and run again. The list will populate.
That's normal for free proxies. Try limiting the list to your region by editing config.yaml and adding a region setting like region: US.
The developers are constantly improving proxy-scraper. Here's what's planned:
- ๐ฑ Mobile app interface
- ๐ Region-specific filtering
- ๐ Browser extension for one-click proxy switching
- ๐ Usage analytics dashboard
This project is open-source and welcomes contributors. Whether you're a coder or not, you can help:
- Give feedback โ Report bugs or suggest features on the GitHub issues page.
- Spread the word โ If it works for you, star the repository and share it.
- Hacktoberfest ready โ This project is Hacktoberfest-friendly, so if you know a bit of coding, you can contribute and earn swag.
You now have a powerful, free proxy tool at your fingertips. With live updates, rigorous verification, and a rotating server, proxy-scraper is the only tool you'll ever need for reliable proxies.
Go ahead and give it a try: Visit this link to download the application
Your journey to free, working proxies starts right now. Happy scraping! โ
Keywords: ai-agents, cli, discord-bot, free-proxy, hacktoberfest, honeypot-detection, http-proxy, mcp, mcp-server, proxy, proxy-checker, proxy-list, proxy-scraper, proxy-server, python, rotating-proxy, scraper, socks4, socks5, web-scraping