> ## Documentation Index
> Fetch the complete documentation index at: https://docs.getgalaxy.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Browserbase

> Scraping website content for Galaxy

Scrape website content and bring it into Galaxy for processing. Galaxy fetches content, processes it, and extracts structure, text, and entities.

<Frame>
  <img src="https://mintcdn.com/galaxy-d7fe996b/35sJCgDRfkDqH-xs/images/browserbase-1.png?fit=max&auto=format&n=35sJCgDRfkDqH-xs&q=85&s=71d4fc349ab06c3e53c79634c608d353" alt="Browserbase 1" width="2880" height="2048" data-path="images/browserbase-1.png" />
</Frame>

## How to Connect

1. **Select Browserbase** as the Source type
2. **Name the Source**: Give your Website Scrape Source a name
3. **Provide base URL**: Enter the base URL of the website to scrape
4. **(Optional) Add a Prompt**: Provide additional instructions to guide extraction (e.g., focus on product documentation, ignore navigation, prioritize structured data)
5. **Choose Credentials**
   * Galaxy managed (Recommended) — Galaxy handles Browserbase credentials automatically
   * Bring your own API key — Connect your own Browserbase account
6. **(Optional) Configure Max URLs to Scrape**: Set the maximum number of URLs Galaxy should process from the starting page.

Once created, Galaxy begins scraping the specified URL and processing the content.

## <kbd>COMING SOON</kbd> More Configuration Options

* **Max Depth**: Maximum depth to crawl from the base URL
* **Max Pages**: Maximum number of pages to scrape
* **Allowed Domains**: List of domains that are allowed to be scraped (leave empty to allow all)
* **Delay Between Requests**: Delay in milliseconds between requests (helps avoid overwhelming servers)
* **Respect robots.txt**: Whether to respect robots.txt rules
* **User Agent**: Custom user agent string to identify the scraper

### Content Processing

Galaxy processes scraped website content with:

* **Text extraction**: Extracts text content from web pages, preserving structure and layout
* **Content normalization**: Normalizes scraped content for consistency
* **Entity extraction**: Automatically extracts and normalizes semantic entities including:
  * Dates and times (normalized to standard formats)
  * Email addresses and URLs
  * Phone numbers
  * Measurements, money, and percentages
  * Serial numbers, model numbers, and part numbers
  * IP addresses and version numbers
  * Technical measurements (temperature, pressure, voltage, current, frequency)
* **Normalization**: Extracted entities are normalized to standardized formats

<Info>
  Don’t see a source type you're looking for? We connect to hundreds of systems - reach out to [support@getgalaxy.io](mailto:support@getgalaxy.io) to request access.
</Info>

## What's Next

<CardGroup cols={2}>
  <Card icon="database" horizontal href="/sources" title="Sources">
    Learn about Sources in general
  </Card>

  <Card icon="diagram-project" horizontal href="/projects" title="Projects">
    Understand how to use Sources in Projects
  </Card>
</CardGroup>