Исходники - Софт - 🔍 Proxy Ultimate | PARSER | ПАРСЕР ПРОКСИ | FREE | End Way — сообщество разработчиков и готовых решений
  • Больше материалов без ожидания и лишних условий
    Доступ к скрытым публикациям на 2 месяца, 3 месяца или навсегда. Ограничения «Команда форума» и «Личный» сохраняются.

    Сравнить варианты доступа →

    🔔 EndWay в Telegram

    Следите за новостями и релизами:
    EndWay | EndSoft

Исходники Софт 🔍 Proxy Ultimate | PARSER | ПАРСЕР ПРОКСИ | FREE

mrak66

breaking lives with two sixes
Автор темы
10 Янв 2026
31
2
​

🔍 Proxy Ultimate​


Author: mrak66 | Telegram channel: «allwersia» {xdkill} | End Way - Форум программирования и сливов различных скриптов
Python 3.8+
Parse 130+ sources, validate with 500+ concurrent connections, enrich with GeoIP, export by country
​

✨ Features​

CategoryDetails
130+ SourcesGitHub raw lists, ProxyScrape, GeoNode, PubProxy, HideMyName, Spys.one, Pastebin, and more
Multi-ProtocolHTTP, HTTPS, SOCKS4, SOCKS5 — parse and validate all types
Blazing FastUp to 500+ concurrent checks via asyncio + aiohttp
GeoIP Enrichment3-stage lookup: ip-api.com batch → single → ipwho.is fallback with rate-limit handling
Anonymity DetectionDeep check: Elite, Anonymous, Transparent classification
Smart ExportAuto-export by country, protocol, and speed ranking
SQLite DatabasePersistent storage with index optimization
Web API ServerREST API for stats, proxy lists, and random proxy
Rich Terminal UIProgress bars, tables, colored output via rich
Zero DependenciesWorks with only aiohttp (optional: rich, aiosqlite)
Cross-PlatformWindows, Linux, macOS — with ProactorEventLoop fix
Premium SupportOxylabs & BrightData via environment variables
SchedulerAuto-run collection at configurable intervals



📖 Usage​

Basic Modes​

# Full pipeline: collect + check + export
python proxy_ultimate.py

# Only collect from sources (no validation)
python proxy_ultimate.py --mode collect

# Only validate previously collected proxies
python proxy_ultimate.py --mode check

# Start web API server
python proxy_ultimate.py --mode serve --web-port 9090

Protocol Filtering​

# Only HTTP proxies
python proxy_ultimate.py --protocol http

# Only SOCKS5 proxies
python proxy_ultimate.py --protocol socks5

# Only HTTPS proxies
python proxy_ultimate.py --protocol https

Performance Tuning​

# 500 concurrent connections, 15s timeout
python proxy_ultimate.py --concurrent 500 --timeout 15

# Check only first 1000 proxies
python proxy_ultimate.py --max-check 1000

# Use only 50 sources (faster collection)
python proxy_ultimate.py --sources 50

Deep Analysis​

# Full analysis: anonymity check + GeoIP enrichment
python proxy_ultimate.py --mode all --deep --geoip

# Filter by specific countries
python proxy_ultimate.py --geoip --countries "US,GB,DE,RU"

# Elite proxies only from specific countries
python proxy_ultimate.py --deep --anonymity elite --geoip --countries "US,DE"

Advanced​

# Load proxies from file instead of collecting
python proxy_ultimate.py --mode check --input-file my_proxies.txt

# Custom output directory
python proxy_ultimate.py --output-dir ./results

# Schedule auto-run every 30 minutes
python proxy_ultimate.py --schedule 30

# Verbose logging
python proxy_ultimate.py --log-level DEBUG --verbose


⚙️ CLI Arguments​

ArgumentDefaultDescription
--modeallcollect, check, serve, all
--sources0Limit number of sources (0 = all)
--concurrent200Max concurrent validation threads
--timeout10.0Connection timeout in seconds
--protocolallhttp, https, socks4, socks5, all
--anonymityNonetransparent, anonymous, elite
--max-speed9999Max response time filter (ms)
--max-check0Max proxies to check (0 = all)
--deepfalseEnable anonymity level detection
--geoipfalseEnable GeoIP country/city/ISP lookup
--countries""Filter by country codes (comma-separated)
--output-dir./outputOutput directory for results
--db-path./proxies.dbSQLite database path
--web-port8080Web API server port
--schedule0Auto-run interval in minutes
--no-colorfalseDisable colored output
--verbosefalseVerbose terminal output
--log-levelWARNINGDEBUG, INFO, WARNING, ERROR
--input-fileNoneLoad proxies from file

🌐 Web API​

Start the REST API server to access proxies programmatically:

python proxy_ultimate.py --mode serve --web-port 9090

Endpoints​

EndpointMethodDescription
/api/healthGETHealth check + timestamp
/api/statsGETFull statistics (valid, by protocol, by country)
/api/proxiesGETList all valid proxies (filter: ?protocol=http&format=json)
/api/randomGETGet one random proxy

Examples​

# Get statistics
curl http://localhost:9090/api/stats

# Get only SOCKS5 proxies as text
curl http://localhost:9090/api/proxies?protocol=socks5

# Get all proxies as JSON
curl http://localhost:9090/api/proxies?format=json

# Random proxy
curl http://localhost:9090/api/random


📁 Output Structure​

After running, results are saved to ./output/:

output/
├── http.txt # All valid HTTP proxies
├── socks5.txt # All valid SOCKS5 proxies
├── fastest.txt # Top 200 fastest proxies
└── by_country/ # Proxies grouped by country code
├── US.txt
├── DE.txt
├── RU.txt
├── GB.txt
└── ... # One file per country


All files are in ip:port format, one proxy per line.


📡 Sources (130+)​

TypeCountExamples
GitHub Raw53TheSpeedX, monosans, jetkai, clarketm, mmpx12, prxchk...
API (Text)24ProxyScrape, proxy-list.download, PubProxy, ProxySpace, FoxTools
HTML Tables20free-proxy-list.net, sslproxies.org, hidemy.name, geonode.com
JSON APIs9GeoNode, FreeProxy, GimmeProxy, OpenTrack
PubProxy Pages15Paginated requests (5 pages x 3 protocols)
Special Parsers4Spys.one, HideMyName, GimmeProxy, Pastebin search
Extra Raw28Additional GitHub sources
Premium2Oxylabs, BrightData (via API keys)

Premium Providers​

# Set API keys as environment variables
export OXYLABS_KEY="your_key_here"
export BRIGHTDATA_KEY="your_key_here"

# Run — premium sources will be included automatically
python proxy_ultimate.py


🏗 Architecture​

proxy_ultimate.py # Single-file, zero-dependency core
├── ProxyParser # Source collection & parsing
│ ├── GitHub raw lists
│ ├── API text endpoints
│ ├── HTML table scraping
│ ├── JSON API parsing
│ ├── Pastebin search
│ └── Premium providers
├── ProxyChecker # Validation engine
│ ├── HTTP/HTTPS check # Via test URLs (Google, httpbin, etc.)
│ ├── SOCKS4 check # Raw SOCKS4 handshake
│ ├── SOCKS5 check # Raw SOCKS5 handshake
│ ├── Anonymity detect # httpbin.org/headers analysis
│ └── GeoIP enrich # 3-stage: batch → single → fallback
├── ProxyManager # In-memory proxy store
│ ├── Deduplication
│ ├── Filtering (protocol, country, speed, anonymity)
│ └── Statistics
├── DatabaseManager # SQLite persistence
├── Exporter # Smart file export
├── WebServer # REST API (aiohttp.web)
├── Scheduler # Interval-based auto-run
└── ConsoleUI # Rich terminal output



🔧 How It Works​

Validation Pipeline​

┌──────────┐ ┌───────────┐ ┌────────────┐ ┌──────────┐
│ Collect │───>│ Deduplicate│───>│ Validate │───>│ Export │
│ 130+ src │ │ by key │ │ concurrent │ │ by group │
└──────────┘ └───────────┘ └────────────┘ └──────────┘
│
┌───────────┼───────────┐
▼ ▼ ▼
HTTP/HTTPS SOCKS4 SOCKS5
test URLs handshake handshake


GeoIP Pipeline​

Stage 1: ip-api.com/batch (50 per request, rate-limited)
↓ missed IPs
Stage 2: ip-api.com/single (4 concurrent, rate-limited)
↓ still missed
Stage 3: ipwho.is + ipwhois.app fallback (6 concurrent)
↓
100% coverage target



📊 Example Output​

___ ___ _ _ _____ _ _____
| \/ |(_) (_)_ _| | | _ |
| . . | _ _ __ _ | | | | | | | | |
| |\/| || || '_ \| || | | | | | | | |
| | | || || | | || | |_| | \_/\_/
\_| |_/|_||_| |_||_/ \___/ \___/

Ultimate Proxy Parser & Validator v3.1
130+ sources | asyncio+aiohttp

Collecting from 130 sources...
Collected 48231 new (total: 48231)
Checking 48231 proxies (500 concurrent)...
██████████████████████████████ 100% 12m 34s
[OK] Checked 48231: 3847 valid, 12 auth, 41231 dead, 3141 timeout

┌────────────────── Results ──────────────────┐
│ Total 48231 │
│ Valid (no auth) 3847 │
│ Auth Required 12 │
│ Invalid 41231 │
│ Elite 1203 │
│ Avg Speed 847ms │
└─────────────────────────────────────────────┘

Top Countries Count
US 842
DE 634
RU 521
FR 412
GB 387



🛠 Requirements​

PackageRequiredPurpose
aiohttpYesAsync HTTP client for collection & validation
richNoColored terminal output, progress bars, tables
aiosqliteNoAsync SQLite database persistence
# Minimal (works without rich and aiosqlite)
pip install aiohttp

# Recommended
pip install aiohttp rich aiosqlite

Python 3.8+ required. Tested on Windows, Linux, and macOS.


📄 License​

MIT License. Use freely for personal and commercial projects.

 
Последнее редактирование:
  • 1
Реакции: 1 user
Активность:
Пока что здесь никого нет