【Smart Mode】【Flowchart Mode】How to filter data | Web Scraping Tool | ScrapeStorm

In the process of setting up the scraping task, sometimes we encounter some unneeded data, such as data with empty values ​​or data containing characters, which affects the speed and effect of the scraping. The ScrapeStorm team developed data filtering function that can be filtered before starting a task.

The Filters is located in the upper right corner of the task action bar. You can click the button directly and then filter the data.

On the “Data Filter” interface, the user can choose whether to save data or discard data when the lower condition is satisfied.

1. New Group

Click the “New Group” button to add a new group filter condition. The relationship between group and group is “or”.

2. New Rule

Click the “New Rule” button to add a new in-group filter condition, and the relationship between the filters within the group is the “and” relationship. Please note that the new rules are added to the latest group. If you need to set grouping conditions in multiple groups, you need to set them before creating new groups.

3. Delete Rule

Select the conditions or groupings you want to delete and click the “Delete Rule” button.

4. Field

Users can select the fields that need data filtering in the options.

5. Condition

In the condition option box, there are 10 conditional options including “null, not null, contains, not contains, equal, not equal, more than, less than, time equal, time before, time after”, and the user can select conditions according to requirements.

6. Value

You can enter text, numbers, time, etc. in the input box.

7. Save

Remember to click OK to save the settings.