Welcome to the Question2Answer Q&A. There's also a demo if you just want to try it out.
0 votes
401 views
in Q2A Core by
edited by

I am building a search engine, Sturtz Search, and what is Q2A's policy on crawling their site? And if anyone wants, I can crawl there site for them, Request a site to be crawled

Q2A version: 1.8.5

1 Answer

+2 votes
by
selected by
 
Best answer
It's fine, as long as your crawler is respectful and doesn't overload the site. If you start hammering the site you'll end up blocked.
by
Ok thank you!
...