Welcome to the Question2Answer Q&A. There's also a demo if you just want to try it out.
–1 vote
in Q2A Core by
edited ago by

I am building a search engine, Sturtz Search, and what is Q2A's policy on crawling their site? And if anyone wants, I can crawl there site for them, Request a site to be crawled

Q2A version: 1.8.5

1 Answer

+2 votes
ago by
selected ago by
Best answer
It's fine, as long as your crawler is respectful and doesn't overload the site. If you start hammering the site you'll end up blocked.
ago by
Ok thank you!