Mehmetcan Şahin - flaresolverr

Mehmetcan Şahin - flaresolverr https://mehmetcansahin.com Software engineering notes by Mehmetcan Şahin on web, mobile, DevOps, and practical development workflows. Zola en Thu, 08 Oct 2026 00:00:00 +0000 Camouflare: Moving from FlareSolverr to Camoufox Thu, 08 Oct 2026 00:00:00 +0000 Mehmetcan Şahin https://mehmetcansahin.com/blog/camouflare-moving-from-flaresolverr-to-camoufox/ https://mehmetcansahin.com/blog/camouflare-moving-from-flaresolverr-to-camoufox/ <p><img src="/images/camouflare-cover.png" alt="Camouflare: Moving from FlareSolverr to Camoufox" /></p> <p>When I started collecting data from the web, I tried FlareSolverr, one of the more popular options. I developed Camouflare to address the speed and stability problems I ran into.</p> <h2 id="why-camoufox">Why Camoufox?</h2> <p>First, let's look at how FlareSolverr works. It runs Chrome/Chromium using Selenium and <code>undetected-chromedriver</code>. Without a persistent session, each request starts a new browser. Sending several requests at once increases memory usage, and you also have to wait for the browser to start each time. The project's documentation recommends limiting concurrent requests on machines with little RAM. <a rel="external" href="https://github.com/FlareSolverr/FlareSolverr#how-it-works">FlareSolverr documentation</a></p> <p>Besides resource usage, requests can get stuck on verification steps and time out. Users have reported these problems in the project's issues. Those reports relate to specific versions and setups, but they show some of the problems that lead people to look for alternatives. <a rel="external" href="https://github.com/FlareSolverr/FlareSolverr/issues/1741">Example issue</a></p> <p>Camoufox is a Firefox-based browser built for web scraping. It removes unnecessary components to optimize memory usage and startup time. It also makes changes at the browser level to handle fingerprinting and automation detection. These features were a better fit for what I needed. <a rel="external" href="https://github.com/daijro/camoufox#introduction">Camoufox</a></p> <p>Byparr was another project built for this purpose, but it didn't work reliably in my setup either. So I started building my own solution that keeps the FlareSolverr API and uses Camoufox underneath.</p> <h2 id="how-does-camouflare-work">How does Camouflare work?</h2> <p>Like FlareSolverr, Camouflare accepts requests through <code>/v1</code>. It supports GET, POST, and commands to create, list, and delete sessions. You can retrieve a page's HTML and cookies for use in your own application. Extracting the data you need from that HTML is still your responsibility.</p> <p>On the browser side, a small pool keeps browsers ready to use. Requests use these browsers instead of starting a new one every time. With the default configuration, the pool can grow to two browsers, each running one browser context at a time.</p> <p>Requests without a session run in separate contexts. If you want to reuse a session across requests, you can create a persistent session. Its cookies and browser state are then preserved.</p> <p>When the pool is full, new requests wait for an available slot within a configured timeout. Browsers are also replaced when they reach their usage or age limits. You can adjust the number of browsers and the waiting times to suit your workload. <a rel="external" href="https://github.com/mehmetcansahin/camouflare/blob/main/docs/deployment.md">Configuration details</a></p> <p>You can watch the Camouflare introduction video below:</p> <div style="aspect-ratio: 16 / 9; width: 100%;"> <iframe src="https://www.youtube-nocookie.com/embed/oEZkk81Et4w" title="Camouflare introduction video" style="width: 100%; height: 100%; border: 0;" loading="lazy" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen> </iframe> </div> <h2 id="installation-and-usage">Installation and usage</h2> <p>You can run Camouflare directly using its Docker image. First, create an API token and start the service:</p> <pre class="giallo" style="color-scheme: light dark; color: light-dark(#24292E, #E1E4E8); background-color: light-dark(#FFFFFF, #24292E);"><code data-lang="shellscript"><span class="giallo-l"><span style="color: light-dark(#D73A49, #F97583);">export</span><span> CAMOUFLARE_API_TOKEN</span><span style="color: light-dark(#D73A49, #F97583);">=</span><span style="color: light-dark(#032F62, #9ECBFF);">"</span><span style="color: light-dark(#032F62, #9ECBFF);">$(</span><span style="color: light-dark(#6F42C1, #B392F0);">openssl</span><span style="color: light-dark(#032F62, #9ECBFF);"> rand</span><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">hex</span><span style="color: light-dark(#005CC5, #79B8FF);"> 32</span><span style="color: light-dark(#032F62, #9ECBFF);">)</span><span style="color: light-dark(#032F62, #9ECBFF);">"</span></span> <span class="giallo-l"></span> <span class="giallo-l"><span style="color: light-dark(#6F42C1, #B392F0);">docker</span><span style="color: light-dark(#032F62, #9ECBFF);"> run</span><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-detach</span><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-rm</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-name</span><span style="color: light-dark(#032F62, #9ECBFF);"> camouflare</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-publish</span><span style="color: light-dark(#032F62, #9ECBFF);"> 127.0.0.1:8191:8191</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-env</span><span style="color: light-dark(#032F62, #9ECBFF);"> CAMOUFLARE_API_TOKEN</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-shm-size</span><span style="color: light-dark(#032F62, #9ECBFF);"> 2g</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-stop-timeout</span><span style="color: light-dark(#005CC5, #79B8FF);"> 45</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#032F62, #9ECBFF);"> mehmetcansahin/camouflare:2.0.2</span></span></code></pre> <p>You need to send this token with your requests. You can check whether the service is ready through <code>/ready</code>:</p> <pre class="giallo" style="color-scheme: light dark; color: light-dark(#24292E, #E1E4E8); background-color: light-dark(#FFFFFF, #24292E);"><code data-lang="shellscript"><span class="giallo-l"><span style="color: light-dark(#6F42C1, #B392F0);">curl</span><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-fail</span><span style="color: light-dark(#032F62, #9ECBFF);"> http://127.0.0.1:8191/ready</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-header</span><span style="color: light-dark(#032F62, #9ECBFF);"> "</span><span style="color: light-dark(#032F62, #9ECBFF);">Authorization: Bearer </span><span style="color: light-dark(#032F62, #9ECBFF);">$</span><span style="color: light-dark(#032F62, #9ECBFF);">{</span><span>CAMOUFLARE_API_TOKEN</span><span style="color: light-dark(#032F62, #9ECBFF);">}</span><span style="color: light-dark(#032F62, #9ECBFF);">"</span></span></code></pre> <p>Once the service is ready, let's send an example GET request:</p> <pre class="giallo" style="color-scheme: light dark; color: light-dark(#24292E, #E1E4E8); background-color: light-dark(#FFFFFF, #24292E);"><code data-lang="shellscript"><span class="giallo-l"><span style="color: light-dark(#6F42C1, #B392F0);">curl</span><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-request</span><span style="color: light-dark(#032F62, #9ECBFF);"> POST</span><span style="color: light-dark(#032F62, #9ECBFF);"> http://127.0.0.1:8191/v1</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-header</span><span style="color: light-dark(#032F62, #9ECBFF);"> '</span><span style="color: light-dark(#032F62, #9ECBFF);">Content-Type: application/json</span><span style="color: light-dark(#032F62, #9ECBFF);">'</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-header</span><span style="color: light-dark(#032F62, #9ECBFF);"> "</span><span style="color: light-dark(#032F62, #9ECBFF);">Authorization: Bearer </span><span style="color: light-dark(#032F62, #9ECBFF);">$</span><span style="color: light-dark(#032F62, #9ECBFF);">{</span><span>CAMOUFLARE_API_TOKEN</span><span style="color: light-dark(#032F62, #9ECBFF);">}</span><span style="color: light-dark(#032F62, #9ECBFF);">"</span><span style="color: light-dark(#005CC5, #79B8FF);"> \</span></span> <span class="giallo-l"><span style="color: light-dark(#005CC5, #79B8FF);"> -</span><span style="color: light-dark(#005CC5, #79B8FF);">-data</span><span style="color: light-dark(#032F62, #9ECBFF);"> '</span><span style="color: light-dark(#032F62, #9ECBFF);">{</span></span> <span class="giallo-l"><span style="color: light-dark(#032F62, #9ECBFF);"> "cmd": "request.get",</span></span> <span class="giallo-l"><span style="color: light-dark(#032F62, #9ECBFF);"> "url": "https://example.com",</span></span> <span class="giallo-l"><span style="color: light-dark(#032F62, #9ECBFF);"> "maxTimeout": 60000</span></span> <span class="giallo-l"><span style="color: light-dark(#032F62, #9ECBFF);"> }</span><span style="color: light-dark(#032F62, #9ECBFF);">'</span></span></code></pre> <p>In this example, <code>request.get</code> opens the specified page. <code>maxTimeout</code> sets the overall time budget for the request to 60 seconds. If the request succeeds, you can read the HTML from <code>solution.response</code>.</p> <h2 id="captcha-support">CAPTCHA support</h2> <p>Camouflare also includes an integrated solver that uses the ClickSolver component from <a rel="external" href="https://pypi.org/project/playwright-captcha/">playwright-captcha</a>. It attempts to complete the click steps on Cloudflare verification pages opened in the browser. Success depends on the challenge and the target site.</p> <p>This feature is disabled by default. To enable it, add the following option to the <code>docker run</code> command above:</p> <pre class="giallo" style="color-scheme: light dark; color: light-dark(#24292E, #E1E4E8); background-color: light-dark(#FFFFFF, #24292E);"><code data-lang="shellscript"><span class="giallo-l"><span style="color: light-dark(#6F42C1, #B392F0);">--env</span><span style="color: light-dark(#032F62, #9ECBFF);"> CHALLENGE_SOLVER=click</span></span></code></pre><h2 id="moving-from-flaresolverr">Moving from FlareSolverr</h2> <p>If your application already uses the FlareSolverr API, you can continue using the commands Camouflare supports. Your client needs to be able to send the API token.</p> <p>There are some compatibility differences. For example, <code>download</code>, <code>returnRawHtml</code>, and <code>tabs_till_verify</code> are accepted but ignored. If you use these fields, I recommend reading the <a rel="external" href="https://github.com/mehmetcansahin/camouflare#flaresolverr-compatibility">compatibility section</a> before switching.</p> <p>I designed Camouflare to run with a single trusted user and one application worker. This is a design choice. Sessions and the browser pool are kept within the process and aren't shared between workers. If you want to support multiple users or run multiple instances, you need to use separate containers and manage request routing yourself. Requests belonging to the same session also need to reach the same instance.</p> <h2 id="monitoring-the-service">Monitoring the service</h2> <p>A running service doesn't necessarily mean its browsers are ready to handle requests. <code>/health</code> checks whether the application is running, while <code>/ready</code> checks whether the browser infrastructure is ready.</p> <p>You can use <code>/diagnostics</code> to inspect the pool and session state. Prometheus metrics are also available. Error responses help you distinguish between insufficient capacity, timeouts, and closed browser connections.</p>