{"id":141471,"date":"2023-01-25T13:56:59","date_gmt":"2023-01-25T04:56:59","guid":{"rendered":"https:\/\/support.questetra.com\/?p=141471"},"modified":"2023-01-30T14:55:32","modified_gmt":"2023-01-30T05:55:32","slug":"tsv-string-filter-by-regexp-2023","status":"publish","type":"post","link":"https:\/\/support.questetra.com\/en\/addons\/tsv-string-filter-by-regexp-2023\/","title":{"rendered":"TSV String, Filter by RegExp"},"content":{"rendered":"\n

TSV String, Filter by RegExp<\/strong><\/h4>\n\n\n\n

TSV \u6587\u5b57\u5217, \u6b63\u898f\u8868\u73fe\u30d5\u30a3\u30eb\u30bf<\/a><\/p>\n\n\n\n

Narrows TSV text to column matched rows only. A regular expression (RegExp) can be specified as the match condition, and the column value is matched for each row. It is also possible to store excluded rows (filtered rows).<\/p>\n\n\n\n

\"Auto<\/figure>\n\n\n\n
\n
Configs for this Auto Step<\/summary>
\n
\n
StrConfA1<\/dt>
A1: Set TSV Text *<\/span>#{EL}<\/sup><\/span><\/dd>\n
StrConfB0<\/dt>
B0: Set ID of COLUMN to be Matched (eg: “0”) *<\/span>#{EL}<\/sup><\/span><\/dd>\n
StrConfB1<\/dt>
B1: Set Matching Condition (REGEXP) for column value *<\/span>#{EL}<\/sup><\/span><\/dd>\n
BoolConfB2<\/dt>
B2: Case Sensitive or Case should be Ignored<\/dd>\n
SelectConfC1<\/dt>
C1: Select STRING that stores Narrowed Text (update)<\/dd>\n
SelectConfC2<\/dt>
C2: Select STRING that stores Removed Lines (update)<\/dd>\n\n<\/dl>\n<\/div><\/details><\/div>\n<\/div>\n\n\n\n
\n
Script (click to open)<\/summary>
\n
\/\/ GraalJS Script (engine type: 2)\n\n\/\/\/\/\/\/\/\/ START "main()" \/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\nmain();\nfunction main(){ \n\n\/\/\/\/ == Config Retrieving \/ \u5de5\u7a0b\u30b3\u30f3\u30d5\u30a3\u30b0\u306e\u53c2\u7167 ==\nconst strInput         = configs.get      ( "StrConfA1" );    \/\/\/ REQUIRED\n  if( strInput       === "" ){\n    throw new Error( "\\n AutomatedTask ConfigError:" +\n                     " Config {A1: String} is empty \\n" );\n  }\nconst strColMatchId    = configs.get      ( "StrConfB0" );    \/\/\/ REQUIRED\n  if( strColMatchId  === "" ){\n    throw new Error( "\\n AutomatedTask ConfigError:" +\n                     " Config {B0: String} is empty \\n" );\n  }\nconst strRegexp        = configs.get      ( "StrConfB1" );    \/\/\/ REQUIRED\n  if( strRegexp      === "" ){\n    throw new Error( "\\n AutomatedTask ConfigError:" +\n                     " Config {B1: String} is empty \\n" );\n  }\nconst boolIgnoreCase   = configs.getObject( "BoolConfB2" );   \/\/\/ TOGGLE\n  \/\/ https:\/\/questetra.zendesk.com\/hc\/en-us\/articles\/360024574471-R2300 "Boolean object"\nconst strPocketOutput  = configs.getObject( "SelectConfC1" ); \/\/ NotRequired\nconst strPocketRemoved = configs.getObject( "SelectConfC2" ); \/\/ NotRequired\n\n\n\/\/\/\/ == Data Retrieving \/ \u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u30c7\u30fc\u30bf\u306e\u53c2\u7167 ==\n\/\/ (Nothing. Retrieved via Expression Language in Config Retrieving)\n\n\n\/\/\/\/ == Calculating \/ \u6f14\u7b97 ==\nconst numColMatchId    = parseInt ( strColMatchId );\n\nconst arrInput         = strInput.split( '\\n' );\nconst regConstructor   = boolIgnoreCase ?\n                         new RegExp( strRegexp, 'i' ) : new RegExp( strRegexp );\n\/\/ engine.log( " AutomatedTask RegExp: " + regConstructor.toString() );\n\nlet   arrOutput    = [];\nlet   arrRemoved   = [];\n\nfor ( let i = 0; i < arrInput.length; i++ ) {\n  if ( regConstructor.test( arrInput[i].split( '\\t', (numColMatchId + 1) )?.[ numColMatchId ] ?? "" ) ){\n    \/\/ https:\/\/developer.mozilla.org\/en-US\/docs\/Web\/JavaScript\/Reference\/Operators\/Optional_chaining\n    \/\/ #combining_with_the_nullish_coalescing_operator (Null \u5408\u4f53\u6f14\u7b97\u5b50\u3068\u5171\u306b\u4f7f\u3046)\n    arrOutput.push ( arrInput[i] );\n  } else {\n    arrRemoved.push ( arrInput[i] );\n  }\n}\n\nlet strOutput  = arrOutput?.join( '\\n' ) ?? "";\nlet strRemoved = arrRemoved?.join( '\\n' ) ?? "";\n\/\/ https:\/\/developer.mozilla.org\/en-US\/docs\/Web\/JavaScript\/Reference\/Operators\/Optional_chaining\n\n\n\/\/\/\/ == Data Updating \/ \u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u30c7\u30fc\u30bf\u3078\u306e\u4ee3\u5165 ==\nif ( strPocketOutput !== null ) {\n  engine.setData ( strPocketOutput,  strOutput );\n}\nif ( strPocketRemoved !== null ) {\n  engine.setData ( strPocketRemoved, strRemoved );\n}\n\n} \/\/\/\/\/\/\/\/ END "main()" \/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\n\n\n\n\/*\nNotes:\n- When a process reaches this automated step, "TSV text" is automatically processed.\n    - The column in each line of TSV text is tested, and only lines matching the condition are output.\n    - Note that it is possible to store not only filtered-down lines, but also filtered-out lines.\n- If the amount of calculation is too large, the process will be terminated in the middle.\n    - A large number of Lines or complex RegExp that requires more than 30 secs will result in a termination.\n- No line feed code is inserted at the end of the output string.\n    - "Narrowed Text" (filtered down)\n    - "Removed Lines" (filtered out)\n- Various human steps can be automated (unmanned).\n    - Filter by date\n    - Remove invalid email addresses\n    - Remove invalid zip codes\n    - Extract URLs starting with "http:\/\/"\n    - Extract only jp domain URLs\n- Note that if the column ID is greater than the number of columns, an empty string is evaluated.\n    - This does not result in an error.\n    - If a regular expression is set to match the blank character, the test result will be true.\n\nAppendix-en:\n- Basic regular expressions: Groups\n    - `(apple|orange)`\n        - Either "apple" or "orange"\n- Basic regular expressions: A character class\n    - `[xyz]`\n        - Any one of the enclosed characters, "x" "y" or "z"\n    - `[a-c]`\n        - Any one in the range "a" to "c"\n    - `[^xyz]`\n        - Any one that is neither "x" nor "y" nor "z"\n    - `\\d`\n        - Any digit \/ `[0-9]`\n    - `\\w`\n        - Any alphanumeric character \/ `[A-Za-z0-9_]`\n    - `\\t`\n        - A horizontal tab\n    - `.`\n        - Any single character except line terminators\n- Basic regular expressions: Assertions\n    - `^`\n        - Beginning\n    - `$`\n        - End\n    - `\\b`\n        - A word boundary\n    - `\\B`\n        - A non-word boundary\n- Basic regular expressions: Quantifiers\n    - `x*`\n        - The preceding item "x" 0 or more times\n    - `x+`\n        - The preceding item "x" 1 or more times\n    - `x?`\n        - The preceding item "x" 0 or 1 times\n    - `x{n}`\n        - "n" occurrences of the preceding item "x"\n    - `x{n,m}`\n        - at least "n" and at most "m" occurrences\n- RegExp Examples\n    - Japanese postal code\n        - `^(\\d{3}-\\d{4})|(\\d{7})$`\n        - `^([0-9]{3}-[0-9]{4})|([0-9]{7})$`\n    - Gmail address\n        - `^[a-zA-Z0-9\\.\\+]+@(gmail\\.com|googlemail\\.com)$`\n        - `^[a-zA-Z0-9.+]+@(gmail\\.com|googlemail\\.com)$`\n    - Secure HTTP\n        - `^https:\\\/\\\/`\n        - `^https:\/\/`\n    - ".com\/" or ".com" at the end of the line\n        - `\\.com\/?$`\n    - Date (2022-12-15 to 2023-01-06)\n        - `(^2022-12-1[5-9]$)|(^2022-12-[2-3][0-9]$)|(^2023-01-0[1-6]$)`\n\nNotes-ja:\n- \u6848\u4ef6\u304c\u3053\u306e\u81ea\u52d5\u5de5\u7a0b\u306b\u5230\u9054\u3057\u305f\u969b\u3001\u300cTSV \u30c6\u30ad\u30b9\u30c8\u300d\u304c\u81ea\u52d5\u7684\u306b\u52a0\u5de5\u3055\u307e\u3059\u3002\n    - TSV \u30c6\u30ad\u30b9\u30c8\u5404\u884c\u306e\u30ab\u30e9\u30e0\u304c\u6b63\u898f\u8868\u73fe\u3067\u30c6\u30b9\u30c8\u3055\u308c\u3001\u6761\u4ef6\u306b\u30de\u30c3\u30c1\u3057\u305f\u884c\u3060\u3051\u304c\u51fa\u529b\u3055\u308c\u307e\u3059\u3002\n    - \u306a\u304a\u3001\u30d5\u30a3\u30eb\u30bf\u62bd\u51fa\u3055\u308c\u305f\u884c\u3060\u3051\u3067\u306a\u304f\u3001\u30d5\u30a3\u30eb\u30bf\u9664\u53bb\u3055\u308c\u305f\u884c\u3092\u683c\u7d0d\u3059\u308b\u3053\u3068\u3082\u53ef\u80fd\u3067\u3059\u3002\n- \u8a08\u7b97\u91cf\u304c\u591a\u3059\u304e\u308b\u5834\u5408\u3001\u9014\u4e2d\u7d42\u4e86\u3057\u307e\u3059\u3002\n    - \u884c\u6570\u304c\u591a\u3044\u30fb\u6b63\u898f\u8868\u73fe\u304c\u6975\u3081\u3066\u8907\u96d1\u306a\u3069\u300130\u79d2\u3092\u8d85\u3048\u308b\u3088\u3046\u306a\u51e6\u7406\u306f\u9014\u4e2d\u3067\u7d42\u4e86\u3059\u308b\u53ef\u80fd\u6027\u304c\u3042\u308a\u307e\u3059\u3002\n- \u51fa\u529b\u6587\u5b57\u5217\u306e\u672b\u5c3e\u306b\u6539\u884c\u30b3\u30fc\u30c9\u306f\u633f\u5165\u3055\u308c\u307e\u305b\u3093\u3002\n    - "\u7d5e\u308a\u8fbc\u307e\u308c\u305f\u30c6\u30ad\u30b9\u30c8"\n    - "\u9664\u53bb\u3055\u308c\u305f\u884c"\n- \u69d8\u3005\u306a\u30d2\u30e5\u30fc\u30de\u30f3\u5de5\u7a0b\u3092\u81ea\u52d5\u5316\uff08\u7121\u4eba\u5316\uff09\u3067\u304d\u307e\u3059\u3002\n    - \u65e5\u4ed8\u3092\u7d5e\u308a\u8fbc\u3080\n    - \u4e0d\u6b63\u306a\u30e1\u30fc\u30eb\u30a2\u30c9\u30ec\u30b9\u3092\u9664\u53bb\u3059\u308b\n    - \u4e0d\u6b63\u306a\u90f5\u4fbf\u756a\u53f7\u3092\u9664\u53bb\u3059\u308b\n    - "http:\/\/" \u59cb\u307e\u308a\u306eURL\u3092\u62bd\u51fa\u3059\u308b\n    - jp\u30c9\u30e1\u30a4\u30f3\u306eURL\u3060\u3051\u3092\u62bd\u51fa\u3059\u308b\n- \u306a\u304a\u3001\u30de\u30c3\u30c1\u5224\u5b9a\u30ab\u30e9\u30e0\u306eID\u304c\u30ab\u30e9\u30e0\u6570\u3088\u308a\u5927\u304d\u3044\u5834\u5408\u3001\u7a7a\u6587\u5b57 "" \u304c\u8a55\u4fa1\u3055\u308c\u307e\u3059\u3002\n    - \u30a8\u30e9\u30fc\u306b\u306f\u306a\u308a\u307e\u305b\u3093\u3002\n    - \u7a7a\u6587\u5b57\u306b\u30de\u30c3\u30c1\u3059\u308b\u6b63\u898f\u8868\u73fe\u304c\u8a2d\u5b9a\u3055\u308c\u3066\u3044\u308b\u5834\u5408\u3001\u30c6\u30b9\u30c8\u7d50\u679c\u306f\u771f\u3068\u306a\u308a\u307e\u3059\u3002\n\nAppendix-ja:\n- \u57fa\u672c\u7684\u306a\u6b63\u898f\u8868\u73fe\uff08\u30b0\u30eb\u30fc\u30d7\uff0fGroups\uff09\n    - `(apple|orange)`\n        - "apple" \u304b "orange" \u306e\u3044\u305a\u308c\u304b\u3000\uff0f\u3000Either "apple" or "orange"\n- \u57fa\u672c\u7684\u306a\u6b63\u898f\u8868\u73fe\uff08\u6587\u5b57\u30af\u30e9\u30b9\uff0fA character class\uff09\n    - `[xyz]`\n        - "x" \u304b "y" \u304b "z" \u306e \u4e00\u6587\u5b57\u3000\uff0f\u3000Any one of the enclosed characters, "x" "y" or "z"\n    - `[a-c]`\n        - "a" \u304b\u3089 "c" \u307e\u3067\u306e\u3044\u305a\u308c\u304b\u4e00\u6587\u5b57\u3000\uff0f\u3000Any one in the range "a" to "c"\n    - `[^xyz]`\n        - "x" \u3067\u3082 "y" \u3067\u3082 "z" \u3067\u3082\u306a\u3044\u4e00\u6587\u5b57\u3000\uff0f\u3000Any one that is neither "x" nor "y" nor "z"\n    - `\\d`\n        - \u6570\u5b57\u4e00\u6587\u5b57\u3000\uff0f\u3000Any digit\u3000\uff0f\u3000`[0-9]`\n    - `\\w`\n        - \u534a\u89d2\u82f1\u6570\u5b57\u4e00\u6587\u5b57\u3000\uff0f\u3000Any alphanumeric character\u3000\uff0f\u3000`[A-Za-z0-9_]`\n    - `\\t`\n        - \u6c34\u5e73\u30bf\u30d6\u3000\uff0f\u3000A horizontal tab\n    - `.`\n        - \u6539\u884c\u6587\u5b57\u3092\u9664\u304f\u3042\u3089\u3086\u308b\u4e00\u6587\u5b57\u3000\uff0f\u3000Any single character except line terminators\n- \u57fa\u672c\u7684\u306a\u6b63\u898f\u8868\u73fe\uff08\u30a2\u30b5\u30fc\u30b7\u30e7\u30f3\u8a00\u660e\uff0fAssertions\uff09\n    - `^`\n        - \u5148\u982d\u3000\uff0f\u3000Beginning\n    - `$`\n        - \u672b\u5c3e\u3000\uff0f\u3000End\n    - `\\b`\n        - \u533a\u5207\u308a\u3000\uff0f\u3000A word boundary\n    - `\\B`\n        - \u533a\u5207\u308a\u4ee5\u5916\u3000\uff0f\u3000A non-word boundary\n- \u57fa\u672c\u7684\u306a\u6b63\u898f\u8868\u73fe\uff08\u6570\u91cf\u8a5e\uff0fQuantifiers\uff09\n    - `x*`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u306e0\u56de\u4ee5\u4e0a\u306e\u7e70\u8fd4\u3000\uff0f\u3000The preceding item "x" 0 or more times\n    - `x+`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u306e1\u56de\u4ee5\u4e0a\u306e\u7e70\u8fd4\u3000\uff0f\u3000The preceding item "x" 1 or more times\n    - `x?`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u306e0\u56de\u304b1\u56de\u306e\u51fa\u73fe\u3000\uff0f\u3000The preceding item "x" 0 or 1 times\n    - `x{n}`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u306en\u56de\u306e\u51fa\u73fe\u3000\uff0f\u3000"n" occurrences of the preceding item "x"\n    - `x{n,m}`\n        - \u76f4\u524d\u30a2\u30a4\u30c6\u30e0 "x" \u304cn\u304b\u3089m\u56de\u51fa\u73fe\u3000\uff0f\u3000at least "n" and at most "m" occurrences\n- \u6b63\u898f\u8868\u73fe \u8a2d\u5b9a\u4f8b Example\n    - \u65e5\u672c\u306e\u90f5\u4fbf\u756a\u53f7\n        - `^(\\d{3}-\\d{4})|(\\d{7})$`\n        - `^([0-9]{3}-[0-9]{4})|([0-9]{7})$`\n    - Gmail\u30a2\u30c9\u30ec\u30b9\n        - `^[a-zA-Z0-9\\.\\+]+@(gmail\\.com|googlemail\\.com)$`\n        - `^[a-zA-Z0-9.+]+@(gmail\\.com|googlemail\\.com)$`\n    - \u30bb\u30ad\u30e5\u30a2HTTP\n        - `^https:\\\/\\\/`\n        - `^https:\/\/`\n    - \u884c\u672b\u306e ".com\/" \u3082\u3057\u304f\u306f ".com"\n        - `\\.com\/?$`\n    - \u65e5\u4ed8\uff082022-12-15 to 2023-01-06\uff09\n        - `(^2022-12-1[5-9]$)|(^2022-12-[2-3][0-9]$)|(^2023-01-0[1-6]$)`\n\nTest Data for Debug:\ndate\temail\tzipcode\turl\n2022-12-14\texample@gmail.com\t604-0835\thttps:\/\/questetra.com\/\n2022-12-14\tsuzuki@example.com\t604-0835\thttps:\/\/QUESTETRA.COM\/\n2022-12-15\tsato@example.com\t604-0835\thttps:\/\/questetra.com\/\n2022-12-18\texample@gmail.com\t604-0835\thttps:\/\/support.questetra.com\/\n2023-01-06\texample@googlemail.com\t604-0835\tHTTP:\/\/QUESTETRA.COM\/\n2023-01-06\tsuzuki@example.com\t6040-835\thttps:\/\/questetra.com\/\n2023-01-06\tSATO@example.com\t6040835\thttps:\/\/questetra.com\/\n2023-01-07\tEXAMPLE@GMAIL.COM\t604-0835\thttp:\/\/support.questetra.com\/\n*\/\n\n<\/code><\/pre><\/div>\n<\/div><\/details><\/div>\n<\/div>\n\n\n\n
Download<\/span><\/h3>\n\n\n\n