Content Readability score with Unkey X Firecrawl X Streamlit

The app analyzes the readability of content from a provided URL, using various metrics to assess its complexity and clarity. It generates a comprehensive report, including scores like Flesch Reading Ease and SMOG Index, alongside visualizations for better understanding.

This app is rate limited using Unkey. So you can only make 3 requests per 3 minutes.

Prerequisites

• Python 3.x
• Streamlit
• Requests library
• An account with Unkey with Root Key
• Firecrawl with valid API Key

Setup Unkey

1. Go to unkey ratelimits

2. Create a new namespace with name firecrawl.streamlit

3. Go to settings/root-keys and create a root key with Ratelimit permissions

4. You can follow this link to create the root key with ratelimit permissions https://app.unkey.com/settings/root-keys/new?permissions=ratelimit..create_namespace,ratelimit..read_namespace,ratelimit..limit,ratelimit..update_namespace,ratelimit.*.delete_namespace

5. Add it in the .env file UNKEY_ROOT_KEY

Quickstart

1. Clone this repository:

   Copy

   1git clone https://github.com/harshsbhat/unkey-streamlit-firecrawl.git
   2cd unkey-streamlit-firecrawl
   3
   4
   

2. Set up a virtual environment (optional but recommended): :

   Copy

   1python3 -m venv venv   # For Linux/macOS
   2source venv/bin/activate  # For Linux/macOS
   3
   4python -m venv venv   # For Windows
   5venv\Scripts\activate  # For Windows
   6
   

3. Set up your environment variables: Create a .env file in the project root and add the following variables. Get the Unkey rootkey from unkey dashboard. You can also get the Firecrawl API key from Firecrawl

   Copy

   1 FIRECRAWL_API_KEY=""
   2 UNKEY_ROOT_KEY=""

4. Install the required dependencies

   Copy

   1pip install -r requirements.txt

5. Run the app

   Copy

   1streamlit run app.py

Usage

https://www.loom.com/share/dab87938ac9f453fadab5673881e59d5?sid=7266731d-8c90-4184-a04f-d0f10708a562