{"id":141480,"date":"2023-01-25T14:18:13","date_gmt":"2023-01-25T05:18:13","guid":{"rendered":"https:\/\/support.questetra.com\/?p=141480"},"modified":"2023-01-30T15:06:27","modified_gmt":"2023-01-30T06:06:27","slug":"multiline-string-filter-by-regexp-2023","status":"publish","type":"post","link":"https:\/\/support.questetra.com\/en\/addons\/multiline-string-filter-by-regexp-2023\/","title":{"rendered":"Multiline String, Filter by RegExp"},"content":{"rendered":"\n

Multiline String, Filter by RegExp<\/strong><\/h4>\n\n\n\n

\u8907\u6570\u884c\u6587\u5b57\u5217, \u6b63\u898f\u8868\u73fe\u30d5\u30a3\u30eb\u30bf<\/a><\/p>\n\n\n\n

Narrows down to just the matched lines from the multiline text. A regular expression (RegExp) can be specified as the match condition. Each line is determined to match a regular expression. Also stores the filtered-out lines (removed lines).<\/p>\n\n\n\n

\"Auto<\/figure>\n\n\n\n
\n
Configs for this Auto Step<\/summary>
\n
\n
StrConfA1<\/dt>
A1: Set Multiline Text *<\/span>#{EL}<\/sup><\/span><\/dd>\n
StrConfB1<\/dt>
B1: Set Matching Condition (REGEXP) for each line *<\/span>#{EL}<\/sup><\/span><\/dd>\n
BoolConfB2<\/dt>
B2: Case Sensitive or Case should be Ignored<\/dd>\n
SelectConfC1<\/dt>
C1: Select STRING that stores Narrowed Text (update)<\/dd>\n
SelectConfC2<\/dt>
C2: Select STRING that stores Removed Lines (update)<\/dd>\n\n<\/dl>\n<\/div><\/details><\/div>\n<\/div>\n\n\n\n
\n
Script (click to open)<\/summary>
\n
\/\/ GraalJS Script (engine type: 2)\n\n\/\/\/\/\/\/\/\/ START "main()" \/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\nmain();\nfunction main(){ \n\n\/\/\/\/ == Config Retrieving \/ \u5de5\u7a0b\u30b3\u30f3\u30d5\u30a3\u30b0\u306e\u53c2\u7167 ==\nconst strInput         = configs.get      ( "StrConfA1" );    \/\/\/ REQUIRED\n  if( strInput       === "" ){\n    throw new Error( "\\n AutomatedTask ConfigError:" +\n                     " Config {A1: String} is empty \\n" );\n  }\nconst strRegexp        = configs.get      ( "StrConfB1" );    \/\/\/ REQUIRED\n  if( strRegexp      === "" ){\n    throw new Error( "\\n AutomatedTask ConfigError:" +\n                     " Config {B1: String} is empty \\n" );\n  }\nconst boolIgnoreCase   = configs.getObject( "BoolConfB2" );   \/\/\/ TOGGLE\n  \/\/ https:\/\/questetra.zendesk.com\/hc\/en-us\/articles\/360024574471-R2300 "Boolean object"\nconst strPocketOutput  = configs.getObject( "SelectConfC1" ); \/\/ NotRequired\nconst strPocketRemoved = configs.getObject( "SelectConfC2" ); \/\/ NotRequired\n\n\n\/\/\/\/ == Data Retrieving \/ \u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u30c7\u30fc\u30bf\u306e\u53c2\u7167 ==\n\/\/ (Nothing. Retrieved via Expression Language in Config Retrieving)\n\n\n\/\/\/\/ == Calculating \/ \u6f14\u7b97 ==\nconst arrInput         = strInput.split( '\\n' );\nconst regConstructor   = boolIgnoreCase ?\n                         new RegExp( strRegexp, 'i' ) : new RegExp( strRegexp );\n\/\/ engine.log( " AutomatedTask RegExp: " + regConstructor.toString() );\n\nlet   arrOutput    = [];\nlet   arrRemoved   = [];\n\nfor ( let i = 0; i < arrInput.length; i++ ) {\n  if ( regConstructor.test( arrInput[i] ) ){\n    arrOutput.push ( arrInput[i] );\n  } else {\n    arrRemoved.push ( arrInput[i] );\n  }\n}\n\nlet strOutput  = arrOutput?.join( '\\n' ) ?? "";\nlet strRemoved = arrRemoved?.join( '\\n' ) ?? "";\n\/\/ https:\/\/developer.mozilla.org\/en-US\/docs\/Web\/JavaScript\/Reference\/Operators\/Optional_chaining\n\n\n\/\/\/\/ == Data Updating \/ \u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u30c7\u30fc\u30bf\u3078\u306e\u4ee3\u5165 ==\nif ( strPocketOutput !== null ) {\n  engine.setData ( strPocketOutput,  strOutput );\n}\nif ( strPocketRemoved !== null ) {\n  engine.setData ( strPocketRemoved, strRemoved );\n}\n\n} \/\/\/\/\/\/\/\/ END "main()" \/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\n\n\n\n\/*\nNotes:\n- When a process reaches this automated step, "multi-line text" is automatically processed.\n    - Each line of multiline text is tested with RegExp, and only lines matching the condition are output.\n    - Note that it is possible to store not only filtered-down lines, but also filtered-out lines.\n- If the amount of calculation is too large, the process will be terminated in the middle.\n    - A large number of Lines or complex RegExp that requires more than 30 secs will result in a termination.\n- No line feed code is inserted at the end of the output string.\n    - "Narrowed Text" (filtered down)\n    - "Removed Lines" (filtered out)\n- Various human steps can be automated (unmanned).\n     - Filter by date\n     - Remove invalid email addresses\n     - Remove invalid zip codes\n     - Extract URLs starting with "http:\/\/"\n     - Extract only jp domain URLs\n\nAppendix-en:\n- Basic regular expressions: Groups\n    - `(apple|orange)`\n        - Either "apple" or "orange"\n- Basic regular expressions: A character class\n    - `[xyz]`\n        - Any one of the enclosed characters, "x" "y" or "z"\n    - `[a-c]`\n        - Any one in the range "a" to "c"\n    - `[^xyz]`\n        - Any one that is neither "x" nor "y" nor "z"\n    - `\\d`\n        - Any digit \/ `[0-9]`\n    - `\\w`\n        - Any alphanumeric character \/ `[A-Za-z0-9_]`\n    - `\\t`\n        - A horizontal tab\n    - `.`\n        - Any single character except line terminators\n- Basic regular expressions: Assertions\n    - `^`\n        - Beginning\n    - `$`\n        - End\n    - `\\b`\n        - A word boundary\n    - `\\B`\n        - A non-word boundary\n- Basic regular expressions: Quantifiers\n    - `x*`\n        - The preceding item "x" 0 or more times\n    - `x+`\n        - The preceding item "x" 1 or more times\n    - `x?`\n        - The preceding item "x" 0 or 1 times\n    - `x{n}`\n        - "n" occurrences of the preceding item "x"\n    - `x{n,m}`\n        - at least "n" and at most "m" occurrences\n- RegExp Examples\n    - Japanese postal code in the middle of the line\n        - `(\\d{3}-\\d{4})|(\\d{7})`\n        - `([0-9]{3}-[0-9]{4})|([0-9]{7})`\n    - Comma + Gmail address\n        - `,[a-zA-Z0-9\\.\\+]+@(gmail\\.com|googlemail\\.com)`\n        - `,[a-zA-Z0-9.+]+@(gmail\\.com|googlemail\\.com)`\n    - Secure HTTP in the middle of the line\n        - `https:\\\/\\\/`\n        - `https:\/\/`\n    - ".com\/" or ".com" at the end of the line\n        - `\\.com\/?$`\n    - Date at the begging of the line\uff082022-12-15 to 2023-01-06\uff09\n        - `(^2022-12-1[5-9])|(^2022-12-[2-3])|(^2023-01-0[1-6])`\n\nNotes-ja:\n- \u6848\u4ef6\u304c\u3053\u306e\u81ea\u52d5\u5de5\u7a0b\u306b\u5230\u9054\u3057\u305f\u969b\u3001\u300c\u8907\u6570\u884c\u30c6\u30ad\u30b9\u30c8\u300d\u304c\u81ea\u52d5\u7684\u306b\u52a0\u5de5\u3055\u307e\u3059\u3002\n    - \u8907\u6570\u884c\u30c6\u30ad\u30b9\u30c8\u306e\u5404\u884c\u304c\u305d\u308c\u305e\u308c\u6307\u5b9a\u3057\u305f\u6b63\u898f\u8868\u73fe\u3067\u30c6\u30b9\u30c8\u3055\u308c\u3001\u6761\u4ef6\u306b\u30de\u30c3\u30c1\u3057\u305f\u884c\u3060\u3051\u304c\u51fa\u529b\u3055\u308c\u307e\u3059\u3002\n    - \u306a\u304a\u3001\u30d5\u30a3\u30eb\u30bf\u62bd\u51fa\u3055\u308c\u305f\u884c\u3060\u3051\u3067\u306a\u304f\u3001\u30d5\u30a3\u30eb\u30bf\u9664\u53bb\u3055\u308c\u305f\u884c\u3092\u683c\u7d0d\u3059\u308b\u3053\u3068\u3082\u53ef\u80fd\u3067\u3059\u3002\n- \u8a08\u7b97\u91cf\u304c\u591a\u3059\u304e\u308b\u5834\u5408\u3001\u9014\u4e2d\u7d42\u4e86\u3057\u307e\u3059\u3002\n    - \u884c\u6570\u304c\u591a\u3044\u30fb\u6b63\u898f\u8868\u73fe\u304c\u6975\u3081\u3066\u8907\u96d1\u306a\u3069\u300130\u79d2\u3092\u8d85\u3048\u308b\u3088\u3046\u306a\u51e6\u7406\u306f\u9014\u4e2d\u3067\u7d42\u4e86\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002\n- \u51fa\u529b\u6587\u5b57\u5217\u306e\u672b\u5c3e\u306b\u6539\u884c\u30b3\u30fc\u30c9\u306f\u633f\u5165\u3055\u308c\u307e\u305b\u3093\u3002\n    - "\u7d5e\u308a\u8fbc\u307e\u308c\u305f\u30c6\u30ad\u30b9\u30c8"\n    - "\u9664\u53bb\u3055\u308c\u305f\u884c"\n- \u69d8\u3005\u306a\u30d2\u30e5\u30fc\u30de\u30f3\u5de5\u7a0b\u3092\u81ea\u52d5\u5316\uff08\u7121\u4eba\u5316\uff09\u3067\u304d\u307e\u3059\u3002\n    - \u65e5\u4ed8\u3092\u7d5e\u308a\u8fbc\u3080\n    - \u4e0d\u6b63\u306a\u30e1\u30fc\u30eb\u30a2\u30c9\u30ec\u30b9\u3092\u9664\u53bb\u3059\u308b\n    - \u4e0d\u6b63\u306a\u90f5\u4fbf\u756a\u53f7\u3092\u9664\u53bb\u3059\u308b\n    - "http:\/\/" \u59cb\u307e\u308a\u306eURL\u3092\u62bd\u51fa\u3059\u308b\n    - jp\u30c9\u30e1\u30a4\u30f3\u306eURL\u3060\u3051\u3092\u62bd\u51fa\u3059\u308b\n\nAppendix-ja:\n- \u57fa\u672c\u7684\u306a\u6b63\u898f\u8868\u73fe\uff08\u30b0\u30eb\u30fc\u30d7\uff0fGroups\uff09\n    - `(apple|orange)`\n        - "apple" \u304b "orange" \u306e\u3044\u305a\u308c\u304b\u3000\uff0f\u3000Either "apple" or "orange"\n- \u57fa\u672c\u7684\u306a\u6b63\u898f\u8868\u73fe\uff08\u6587\u5b57\u30af\u30e9\u30b9\uff0fA character class\uff09\n    - `[xyz]`\n        - "x" \u304b "y" \u304b "z" \u306e \u4e00\u6587\u5b57\u3000\uff0f\u3000Any one of the enclosed characters, "x" "y" or "z"\n    - `[a-c]`\n        - "a" \u304b\u3089 "c" \u307e\u3067\u306e\u3044\u305a\u308c\u304b\u4e00\u6587\u5b57\u3000\uff0f\u3000Any one in the range "a" to "c"\n    - `[^xyz]`\n        - "x" \u3067\u3082 "y" \u3067\u3082 "z" \u3067\u3082\u306a\u3044\u4e00\u6587\u5b57\u3000\uff0f\u3000Any one that is neither "x" nor "y" nor "z"\n    - `\\d`\n        - \u6570\u5b57\u4e00\u6587\u5b57\u3000\uff0f\u3000Any digit\u3000\uff0f\u3000`[0-9]`\n    - `\\w`\n        - \u534a\u89d2\u82f1\u6570\u5b57\u4e00\u6587\u5b57\u3000\uff0f\u3000Any alphanumeric character\u3000\uff0f\u3000`[A-Za-z0-9_]`\n    - `\\t`\n        - \u6c34\u5e73\u30bf\u30d6\u3000\uff0f\u3000A horizontal tab\n    - `.`\n        - \u6539\u884c\u6587\u5b57\u3092\u9664\u304f\u3042\u3089\u3086\u308b\u4e00\u6587\u5b57\u3000\uff0f\u3000Any single character except line terminators\n- \u57fa\u672c\u7684\u306a\u6b63\u898f\u8868\u73fe\uff08\u30a2\u30b5\u30fc\u30b7\u30e7\u30f3\u8a00\u660e\uff0fAssertions\uff09\n    - `^`\n        - \u5148\u982d\u3000\uff0f\u3000Beginning\n    - `$`\n        - \u672b\u5c3e\u3000\uff0f\u3000End\n    - `\\b`\n        - \u533a\u5207\u308a\u3000\uff0f\u3000A word boundary\n    - `\\B`\n        - \u533a\u5207\u308a\u4ee5\u5916\u3000\uff0f\u3000A non-word boundary\n- \u57fa\u672c\u7684\u306a\u6b63\u898f\u8868\u73fe\uff08\u6570\u91cf\u8a5e\uff0fQuantifiers\uff09\n    - `x*`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u306e0\u56de\u4ee5\u4e0a\u306e\u7e70\u8fd4\u3000\uff0f\u3000The preceding item "x" 0 or more times\n    - `x+`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u306e1\u56de\u4ee5\u4e0a\u306e\u7e70\u8fd4\u3000\uff0f\u3000The preceding item "x" 1 or more times\n    - `x?`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u306e0\u56de\u304b1\u56de\u306e\u51fa\u73fe\u3000\uff0f\u3000The preceding item "x" 0 or 1 times\n    - `x{n}`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u306en\u56de\u306e\u51fa\u73fe\u3000\uff0f\u3000"n" occurrences of the preceding item "x"\n    - `x{n,m}`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u304cn\u304b\u3089m\u56de\u51fa\u73fe\u3000\uff0f\u3000at least "n" and at most "m" occurrences\n- \u6b63\u898f\u8868\u73fe \u8a2d\u5b9a\u4f8b Example\n    - \u9014\u4e2d\u306e\u65e5\u672c\u306e\u90f5\u4fbf\u756a\u53f7\n        - `(\\d{3}-\\d{4})|(\\d{7})`\n        - `([0-9]{3}-[0-9]{4})|([0-9]{7})`\n    - \u30ab\u30f3\u30de\uff0bGmail\u30a2\u30c9\u30ec\u30b9\n        - `,[a-zA-Z0-9\\.\\+]+@(gmail\\.com|googlemail\\.com)`\n        - `,[a-zA-Z0-9.+]+@(gmail\\.com|googlemail\\.com)`\n    - \u9014\u4e2d\u306e\u30bb\u30ad\u30e5\u30a2HTTP\n        - `https:\\\/\\\/`\n        - `https:\/\/`\n    - \u884c\u672b\u306e ".com\/" \u3082\u3057\u304f\u306f ".com"\n        - `\\.com\/?$`\n    - \u884c\u982d\u306e\u65e5\u4ed8\uff082022-12-15 to 2023-01-06\uff09\n        - `(^2022-12-1[5-9])|(^2022-12-[2-3])|(^2023-01-0[1-6])`\n\nTest Data for Debug:\ndate,email,zipcode,url\n2022-12-14,example@gmail.com,604-0835,https:\/\/questetra.com\/\n2022-12-14,suzuki@example.com,604-0835,https:\/\/QUESTETRA.COM\/\n2022-12-15,sato@example.com,604-0835,https:\/\/questetra.com\/\n2022-12-18,example@gmail.com,604-0835,https:\/\/support.questetra.com\/\n2023-01-06,example@googlemail.com,604-0835,HTTP:\/\/QUESTETRA.COM\/\n2023-01-06,suzuki@example.com,6040-835,https:\/\/questetra.com\/\n2023-01-06,SATO@example.com,6040835,https:\/\/questetra.com\/\n2023-01-07,EXAMPLE@GMAIL.COM,604-0835,http:\/\/support.questetra.com\/\n*\/\n\n<\/code><\/pre><\/div>\n<\/div><\/details><\/div>\n<\/div>\n\n\n\n
Download<\/span><\/h3>\n\n\n\n