photo

spiritfly

shared this idea
5 years ago

Employees Involved

photo

SCM

Admin

Statistics

0
Comments
1
Views

Share

Tags

191
votes

Article Downloader: Save Filters

It would be really helpful if we were able to save our filters so we can call the at any time during article scraping. It's really hard putting together the same set of rules every time for filtering out paragraphs like:

- Submit Cancel The posting of advertisements, profanity, or personal attacks is prohibited. Click here to review our Terms of Use

- If you believe this comment is offensive or violates the CNET's Site Terms of Use , you can report it below (this will not automatically remove the comment). Once reported, our staff will be notified and the comment will be reviewed.

- Note: Your e-mail address is used only to let the recipient know who sent the e-mail and in case of transmission error. Neither your address nor the recipients's address will be used for any other purpose.

These lines above are being considered as paragraphs and cannot be removed with the word count filter. Therefore it would be very helpful if you could just add them to a standard junk filter, save it and load it everytime you want to scrape the same type of articles.

Official Answer
photo Employee
SCM Posted 5 years ago

Coming in 4.0.1.5

Ability to save and load filters in article downloader

Article downloader will save and load automatically the last active filter.

Leave Comment

photo