Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Forward incoming proxy requests with ProxyPoolPlugin don't load some websites #1331

Open
goodvanity opened this issue May 2, 2023 · 2 comments
Assignees
Labels
Bug Bug report in proxy server

Comments

@goodvanity
Copy link

I have foreign proxy service and i want to forward requests through them using proxy.py and this command:
proxy --port 1090 --plugins proxy.plugin.ProxyPoolPlugin --proxy-pool username:[email protected]:2222
Then some sites loaded like expected, but some sites not loaded at all.

For example:
curl --proxy 127.0.0.1:1090 https://www.reddit.com
output is html
log in proxy.py:
pid:14 [I] proxy_pool.access_log:219 - 172.26.0.1:52412 - CONNECT www.reddit.com:443 -> proxysite.com:2222 - 5130 bytes - 478.96 ms

but then i try another site, for example https://www.instagram.com
curl --proxy 127.0.0.1:1090 https://www.instagram.com
output:
curl: (56) Proxy CONNECT aborted
Chrome displays:
ERR_EMPTY_RESPONSE
log in proxy.py:
pid:20 [I] proxy_pool.access_log:219 - 172.26.0.1:55120 - CONNECT www.instagram.com:443 -> proxysite.com:2222 - 0 bytes - 10916.32 ms

I try this with docker and on the host, Windows and Linux, the result is the same. On the other hand if i use username:[email protected]:2222 directly in curl or in browser then all works as expected. Sites do not change, if the site does not load, then it does not load after restart, reboot etc.

What could be the reason?

@goodvanity goodvanity added the Bug Bug report in proxy server label May 2, 2023
@abhinavsingh
Copy link
Owner

abhinavsingh commented May 3, 2023

@goodvanity Thank you for reporting this. I'll need to check this out locally once.

I am wondering iff this could be related to any Via header added by local proxy.py. If you are able to see raw headers on remote proxy, may be you can help double check/verify. E.g. iff Via header is present, Instagram can detect it as a proxy request and may be try to abort the request (just a thought that crossed my mind).

@goodvanity
Copy link
Author

@abhinavsingh thanks for the feedback

Browser(curl) --1--> Proxy.py --2--> Remote Proxy --3--> target site(instagram)

I only have access to 1 and 2 connections. Do you need any dump?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Bug report in proxy server
Projects
None yet
Development

No branches or pull requests

3 participants
@abhinavsingh @goodvanity and others