FlareSolverr Support

[ppfeister]

Checklist

• I'm reporting a feature request
• I've checked for similar feature requests including closed ones

Description

Several years ago, a solution like cloudscraper may have been ideal. Now, there doesn't seem to be any actively maintained solution outside of FlareSolverr. This solution wouldn't be a good build-in, but it can function as a proxy with a couple adjustments.

I was able to put together a somewhat viable proof of concept in #2079 (would be re-engineered if desired, though).

The caveat is that FlareSolverr doesn't seem to properly pass along return codes right now. That would mean it can only be reliably used for message and possibly for redirect_url. When FlareSolverr is detected, we would have status_code requests bypass the proxy and function normally.

Seems that some messages may need a minor tweak depending on how sites handle l10n and such, but they would be similar if changed at all (as in the data.json diff).

Would this partial support be desired, or would we prefer to wait until FlareSolverr more properly supports status_code as well?

[ppfeister]

Minor update --

Referencing FlareSolverr/FlareSolverr#1162

Exploring the possibility of opening a PR on FlareSolverr to shoehorn in status code and/or return header support despite Selenium being a PITA. Would be a perfect companion for Sherlock if successful, but who knows if it's even feasible or not yet.

---

Edited to add:

Paused work on (linked) upstream issue while focusing on another problem, will likely resume soon if of interest.

[asulwer]

this is an issue with Selenium. this issue has been discussed and they are not including support for this.

Selenium Devs say no