Website

1. Add Website, enter the starting website URL and restrict the path prefix to the content you want to index.
2. Set a conservative page limit and test the connection. Use a public, reachable site for the first test.
3. Choose scheduled or manual synchronization, review scope and grant CogLake role access before saving.
4. Start a sync and inspect the imported pages, links and search results.

The connector converts supported page content into searchable documents and retains discovered links. It is not an interactive browser login: JavaScript-only pages or authentication walls may need another source. Robots rules, network safety restrictions and crawl limits apply. Do not use a crawl to bypass a site's access controls. Confirm that you have permission to index the source and consider whether its content should be visible to all selected roles.