Templates Plugins Courses

How to create a web crawler that searches other websites?


#1

Hi. I’d like to browse the themes from many websites by searching (for example: ‘e-commerce’) on my site, how to do that?
And can I add my link when they click on the theme that’s crawled?
How to create a web crawler that searches other websites?


#2

Hello @nicharee.sn

The development of a web crawler is a scope that cannot be achieved using only bubble functionalities. The most reliable solution would be to use an external API and connect it through “API connector”. Here you can find more details about API connection with bubble.
https://manual.bubble.io/using-plugins/special-plugins.html#the-api-connector
https://manual.bubble.io/building-plugins/adding-api-connections.html
For example, you can connect this Crawlbot or any other web crawler that suits your needs.

Regards,
Alex