> ## Knowledge Base Index
> Fetch the complete knowledge base index at: https://krystal-dev.crisp.help/sitemap.xml
> Use this file to discover available pages before exploring further.
> Pure-Markdown content can be obtained by appending a '.md' suffix to the content URLs listed in the sitemap (without the trailing slash).

# Setting up the LiteSpeed Cache crawler

Sometimes when you visit your site, you may notice that the initial load takes significantly longer than normal, even though you're already using a caching plugin.

The cache is designed in a way so that the first user that hits an un-cached page will generate a fresh copy that will then be served to all subsequent visitors. During quiet periods however, there may be situations where a page is only visited frequently enough that each user encounters an expired cache and has to generate a fresh copy when they load the page, increasing the load times.

To get around this, we can utilise the LiteSpeed crawler to hit each page and generate a cached copy and then re-crawl the site every few hours replacing the cache.

#### Setting up the LiteSpeed Crawler

| Please Note: The LiteSpeed Crawler is only available on our Business hosting plans (Emerald and above).

1.  Log in to your WordPress Dashboard
2.  Navigate to the LiteSpeed Cache plugin

![](https://storage.crisp.chat/users/helpdesk/website/7a6c3b3444c16800/febdebb3-70ba-44e5-b2f9-affa8e_14nap5u.png)

1.  Select the "**Crawle**r" option

![](https://storage.crisp.chat/users/helpdesk/website/37cccff03897d400/933876e1-b003-4e0c-87b4-0a52b3_1eak9oi.png)

1.  Navigate to the "**Sitemap Settings**" tab and enter your sitemap URL.

![](https://storage.crisp.chat/users/helpdesk/website/4565c35483557400/f765441d-94e6-4901-987e-cc50db_115nlyw.png)

| Tip: This will normally be "https://yourdomainname.tld/wp-sitemap.xml", however, this can change depending on the plugins you're using:All in one SEO : https://yourdomainname.tld/sitemap.xmlRankMath SEO : https://yourdomainname.tld/sitemap_index.xml

1.  Once this has been added, you can navigate to "**General settings**" and set the crawler to "**ON**".

![](https://storage.crisp.chat/users/helpdesk/website/5775a48dbbb7d400/a98c02a3-a9c7-4880-808a-c912ee_1vsml0o.png)

1.  Then navigate to the "**Map**" tab and click the "**Refresh Crawler Map**" button.

![](https://storage.crisp.chat/users/helpdesk/website/5d2a983a937f1000/5c70d70d-6a21-44f8-a2be-0f6e5f_12fuitq.png)

1.  Lastly, head to the "**Summary**" tab and select "**Manually Run**" to start the first crawl straight away.

![](https://storage.crisp.chat/users/helpdesk/website/9bb159dd31b5b000/58edc26b-324c-4159-9b70-bc8b12_p9gteq.png)

1.  Done!

The LiteSpeed crawler will initially do a first pass of every page on the site and ensure that this is cached. The first pass will normally take upwards of a few hours so you won't see the benefit immediately.

Once the first pass is complete, any further passes will only crawl pages that are un-cached or due to expire to ensure that every single page has a pre warmed cache to be served to human visitors.

* * *

* * *