CSV Parser
Last updated
Last updated
Address
VNG CorporationCSV parser is a filter that helps read and parse tabular data stored in CSV (Comma-Seperated Values) format into another data structure, usually a JSON logs structure.
To create a CSV parser configuration, follow the instructions below:
In the Processor information section , enter general information for a processor according to the instructions in Processor . In this content, you will choose Processor type as CSV Parser .
In the Parsing rule section , enter the following information:
Enter Source field : field containing logs that will need to be parsed. Filed logs need to be in CSV log format.
Enter the Target field : the field will be overwritten in the destination log project, normally you will not need to enter this information
Enter Columns: enter the column names in the corresponding order on the Source field, the system will map these column names as the corresponding field names on the Destination field.
Separator : enter the separator character between corresponding columns on the Source field, the system default is the character ",".
For example:
Source log project | Destination log project | Message (field logs mà chúng tôi thực hiện parser) | Columns | Seperator | Kết quả parser |
webserver | webserver-parse | Message (field logs mà chúng tôi thực hiện parser) | time,action,ip_address,message | , | { "time": "2020-09-01 10:35:25", "action": "RESTART", "ip_address": "192.168.1.3", "message": "System restarts" } |
You can store a parsing rule by checking Save this rule , then entering a memorable name for the parsing rule you want to store. The mnemonic name has a minimum length of 5 characters, a maximum length of 255 characters and can only include upper and lower case letters (az, AZ), numbers (0-9), and dots (.), space ( ), underscore (_), hyphen (-), and the @ character.
After the parsing rule has been stored, in subsequent processor creations you can reuse this rule by selecting Rule presets in the Pasing rule section.