photo

Peter

shared this idea
3 years ago

Employees Involved

photo

SCM

Admin

Statistics

3
Comments
1
Views

Share

103
votes

[Request] Multithreading

SCM is good, but slow. Lets say i want to use 100KWs for article creation (and i need 20-30+ such articles per day), it will take ages (because SCM search google with 1 thread only) no matter how many proxies i give SCM (and i dont want to 1-2 hours to get work done). Scraping google and looking for articles with 1 thread only is limiting SCM and users.

Hope we will se version with multithreading soon.

Official Answer
photo Employee
SCM Posted 3 years ago

Experimental support added its not stable (2 threads max)

The slowdown is due to Google scraper not being threaded.

A solution for that should be requested as the article scraper is multithreaded.

Add Comment

Comments (3)

photo
56

any update i need 5000 article for unique keyword list for bulk scrapping if multithreading is enable we can do this task fast

photo Employee
44

Belvendran Ranjan wrote:

any update i need 5000 article for unique keyword list for bulk scrapping if multithreading is enable we can do this task fast
Multhreading is enable for article scraper. Only the google scraping is not multithreaded.

photo
36

So still it is not possible i can not use google scraping with Multhreading.

Leave Comment

photo