docs
Scraping

Web Scraping

Web scraping is how your chatbots can fill their knowledgeable with your data.

On the dashboard, on the bots section, You will see there is an initializing button beside the chatbot you have just created.

Antibot mitigation

By using our services you agree that you have permission to scrape said website.

  • Some websites will flag our scraper as malicious traffic.
  • In some cases it is recommended to temporarily remove this protection.
  • Botflow.io uses proxies in order to spread this traffic across multiple ips

Strict mode (Coming soon!)

  • Meant for websites with strong antibot protections

More on webscraping can be found in the terms of service