Products
- Muse^® Federated Search, today’s most powerful of its kind, is known as best of multiple target searching and content normalization to a single data model.
- Muse^® Proxy is a highly customizable multi-platform proxy server, easy to use and manage, acting as a gateway to authenticated content.
- Muse^® Harvest is based on different types of controlled extraction, such as search, date or feed based. it features a consistent delivery record format.
  - Overview
  - Features
- Muse^® Hybrid brings a powerful new approach to content discovery by combining real-time global federated searching with high performance central indexed searching.
  - Overview
  - Features
Services
Support
- FAQ
- Downloads
About
Contact

Does Muse Proxy work with a Cloudflare secured site?

Categories:
General
Muse Proxy

To make sure Muse Proxy rewrites a website protected by Cloudflare the most reliable way is for the publisher to list the outbound IP address at Cloudflare. This is a must especially if the Cloduflare challenge is set to Interactive Challenge (the captcha-like one).

For publishers not intending to support rewriting proxies, if the publisher site is set up with a non-interactive JS challenge, then the Muse Proxy source profile can be configured using a base64 filter:

<FILTER> <PATTERNS>Use corresponding URL patterns here</PATTERNS> <FIND><![CDATA["(aHR0cHM6Ly[^"]+)",]]></FIND> <REPLACE base64="true" rewrite="1"><![CDATA["$1",]]></REPLACE> </FILTER>

Also some Cloudflare cases may require the following profile settings
<KEEP_HEADER_ORDER>true</KEEP_HEADER_ORDER> <SSL_CLIENT_ENABLED_PROTOCOLS>TLSv1.3</SSL_CLIENT_ENABLED_PROTOCOLS> <SSL_CLIENT_PROTOCOL>TLSv1.3</SSL_CLIENT_PROTOCOL>