Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support SOCKS proxy for CheerioCrawler #2599

Open
sushantdhiman opened this issue Aug 2, 2024 · 0 comments
Open

Support SOCKS proxy for CheerioCrawler #2599

sushantdhiman opened this issue Aug 2, 2024 · 0 comments
Labels
feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.

Comments

@sushantdhiman
Copy link

Which package is the feature request for? If unsure which one to select, leave blank

@crawlee/cheerio (CheerioCrawler)

Feature

CheerioCrawler currently only supports HTTP proxy. It should also support SOCKS(4/5) proxy via ProxyConfiguration

Motivation

I would like to use SOCKS proxies along with HTTP proxies when using Cheerio crawler.

Ideal solution or implementation, and any additional constraints

I should be able to pass socks based proxyUrls when constructing ProxyConfiguration object

Alternative solutions or implementations

No response

Other context

No response

@sushantdhiman sushantdhiman added the feature Issues that represent new features or improvements to existing features. label Aug 2, 2024
@B4nan B4nan added the t-tooling Issues with this label are in the ownership of the tooling team. label Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
Projects
None yet
Development

No branches or pull requests

2 participants