Apify Proxy Integration
Using Bright Data proxies with Apify boosts web scraping efficiency by ensuring secure, anonymous data extraction and reducing the risk of IP blocks and detection.
- 72M+ Residential IPs
- Sticky and rotating sessions
- 99.95% success rate
- Geo-location targeting - FREE
What is Apify?
Apify is a powerful web scraping, data extraction, and web RPA platform. It can automate anything you can do manually in a web browser, and run it at scale. Apify Store has hundreds of ready-to-use scraping tools that just require you to change a few settings.
Proxies are often an essential part of web scraping. You should always secure your identity when web scraping and you may also need to deal with anti-scraping measures and other restrictions deployed by your target website.
That’s where Bright Data comes in 💪
Bright Data’s proxies can help you successfully complete your scraping and automation tasks. Bright Data proxies seamlessly integrate with Apify so you can perform your job without being blocked.
How to setup Apify
with Bright Data proxies:
Head over to Bright Data:
- Log in into your Bright Data account and go to the dashboard
- Click on Proxies & Infra and create a zone
- You can choose between Datacenter, Residential, ISP, & Mobile IPs
- Configure and create the zone according to your project requirements
- Click on the Settings icon next to the zone name.
- Get the username and password.
Head over to Apify:
- Head over to apify.com and log in into your account.
- Once you’re in Apify Console, click on Actors in the left-hand menu.
- Under the Store tab you’ll find Web scraper. We’ll use this as our example. Click on it.
- Navigate to the Input tab.
- Enter lumtest as start URL to scrape : https://lumtest.com/myip.json
- In the Page function paste this code :
async function pageFunction(context) {
// jQuery is handy for finding DOM elements and extracting data from them.
// To use it, make sure to enable the "Inject jQuery" option.
const $ = context.jQuery;
// Select the element using the 'body > pre' CSS selector and extract its text content.
const data = $('body > pre').text();
// Return an object with the extracted data. It will be stored in the resulting dataset.
return {
data: data
};
}
- Then scroll down to find proxy and browser configuration.
- Click on own proxy and input your proxy credentials in the following format.
- http://username:[email protected]:33335 and password can be taken from the zone settings that we just created.
- The hostname for Bright Data proxies is :brd.superproxy.io and the port is 33335.
- This is what the final Bright Data proxy URL will look like: http://lum-customer-c_375eb5c4-zone-zone5:[email protected]:33335
- Then just click Start.
- You can then preview and download the data as HTML, JSON, CSV, Excel, XML, and RSS feed, or view it in the output tab
- To confirm that Apify used the proxy, go to your Bright Data dashboard, navigate to proxies and then check the event log.
⚠️Important note: If you are using Bright Data’s Residential Proxies, Web Unlocker or SERP API, you need to install an SSL certificate to enable end-to-end secure connections to your target website(s). This is a simple process, see https://docs.brightdata.com/general/account/ssl-certificate#installation-of-the-ssl-certificate for instructions.
Get proxies for Apify
Impulsionado por uma infraestrutura de proxy residencial premiada
Mais de 72 milhões de proxies residenciais, a melhor tecnologia da categoria e a capacidade de segmentar qualquer país, cidade, operadora e ASN, torna nossos serviços de proxy premium a melhor escolha para desenvolvedores.
Tipos de proxy para todas as necessidades
Proxies residenciais
- Mais de 72.000.000 IPs
- Disponível em 195 países
- A maior rede de IPs rotativos de pares reais
- Aceda e rastreie todos os sítios web sofisticados
Proxies de datacenter
- Mais de 1.600.000 IPs
- Disponível em 98 países
- Grupos de IPs partilhados e dedicados disponíveis
- Acesso rápido a sítios web não complexos
Proxies de ISP
- Mais de 700.000 IPs
- Disponível em 35 países
- IPs residenciais estáticos reais sem rotação de IP
- Ideal para iniciar sessão em várias conta
Proxies móveis
- Mais de 7.000.000 IPs
- Disponível em 195 países
- A maior rede de IPs 3G/4G de pares reais do mundo
- Verificar anúncios móveis e rastrear sítios móveis
Proxy Network Pricing
Líder em proxies e coleta de dados
Para os clientes, a melhor experiência do ramo
Novos lançamentos de recursos todos os dias
Para responder a qualquer pergunta quando você precisar
Painel de desempenho de rede em tempo real
Para otimizar seu desempenho
Para atingir suas metas de coleta de dados