LunaProxy Web Unlocker is an AI-based proxy solution that integrates proxy technology to smoothly collect required data even on websites with advanced anti-crawler mechanisms.
As a proxy solution to anti-crawling mechanisms. it breaks through the limitations of target websites with the help of technologies such as automatic IP rotation ,verification code management, browser fingerprint simulation, JavaScript rendering, etc. What is particularly important is that you only need to pay for successful data crawling results, which is undoubtedly the preferred solution to reduce the cost of developing and maintaining infrastructure.
Verification codes are used to distinguish between human users and computer programs and can protect web pages from unusual attacks. CAPTCHAs usually present some difficult problems that are easy for humans to solve but difficult for automatic programs to solve. The following are several common types of CAPTCHA:
Text-based CAPTCHA
As the most common type of CAPTCHA, it works by randomly generating a string of characters and twisting, rotating, changing colors, etc., making it difficult for robots to decipher. It usually consists of numbers and text, with a wavy and blurred background.
Image-based CAPTCHA
In this type of CAPTCHA, you will see a set of separated images and ask you to select the image that contains a specific object. They usually form a whole or several parts, and you can complete it by clicking on the image that meets the requirements within a specified time. However, these images are quite challenging for automated scripts and often require complex image recognition capabilities.
Audio CAPTCHA
Unlike the two types of CAPTCHAs mentioned above, audio CAPTCHA is designed for people with visual impairments. It plays a voice clip of letters or numbers mixed with background noise. You need to listen and enter what you hear according to the requirements. Sometimes you need to listen to a section of numbers and type them out in order, or follow the audio instructions you hear.
reCAPTCHA
reCAPTCHA is a free service from Google that is used to distinguish between humans and robots and protect websites from spam. It is an upgraded version of the CAPTCHA system. Google reCAPTCHA performs tasks such as recognizing traffic signs in images or simply checking a box that says "I'm not a robot". It also operates in the background and evaluates the user's interaction with the website to confirm whether the user is human.
The triggering of the verification code is actually the target website's defense response to abnormal traffic. When the same IP initiates a large number of requests in a short period of time, accesses sensitive content from an IP in an uncommon area, or is determined to be a non-human operation, the verification code is likely to be intercepted.
Based on the above interception scenarios, LunaProxy's Web Unlocker can automatically rotate proxies for you, solve any type of verification code, and perform large-scale web crawling.
Using Web Unlocker , you need to register and log in to LunaProxy, submit an application and you can get a seven-day free trial.
1. After logging in and registering, navigate to [the Personal Center] - [Dashboard], enter [the Web Unlocker] - [Sub-Account] interface, click [Add Sub]-[Account] on the right, and create a sub-account for your Web Unlocker.
2. Assign a name to your Web Unlocker API.
3. Click [Submit] and the subaccount is created successfully .
LunaProxy offers two methods for accessing the Web Unblocker, both delivering the same results while catering to different customer workflows:
1.Direct API access
Click [Request Configuration], select the country, username, and fill in the target website. You will see the API token in the access details and a request example in the request area on the right:
Here is an example of a simple Web Unlocker API curl request:
Request Failure
API endpoint: https://unlocker-api.lunaproxy.com/
Authorization header: Authorization: Bearer [INSERT YOUR API TOKEN] - Your API token is found in your Web Unlocker area.
url: The target URL you wish to access through Web Unlocker.
2.Local proxy-based access
In order to access Web Unlocker, you will need to provide credentials consisting of the following, which can be viewed in [Request Configuration]- [Access Details].
Access credentials include your host, port, username, and password, which will be used to authenticate proxy requests.
The following is an example of HTTPS proxy code . Once you have the credentials, use the following code to send your first request:
The emergence of Lunaproxy web unlocker helps bypass complex anti-crawler mechanisms, automatically bypass verification codes, and quickly obtain data information. At the same time, we must also pay attention to the issue of legality. Bypassing the verification code may violate the terms of service of the target website and even involve legal risks.
If you want to experience the anti-crawling solution brought by the web unlocker immediately, log in to the lunaproxy official website for a free trial. If you have any questions, please feel free to contact us at [email protected].
Please Contact Customer Service by Email
We will reply you via email within 24h