issuekey,title,description,storypoint TDQ-249,"SQL Server Single Sign On Support doesn't work in data profiler repository connections","In the data profiler perspective, you can't use the Single Sign on libraries to connect to SQL Server, even if the library is loaded. We've used the Single Sign On capabilities in the job designer and haven't had any issues running jobs, using the data viewer, etc; however, when you switch to the data profiler, the connection returns that the library isn't loaded, and to check the java.library.path system property - which has the values appropriate for the library. Everyone has installed the dll from the jtds project in their library paths.",3 TDQ-309,"Remove two columns in frequency tables","in the ""b01_column_basic.jrxml"" report, frequency tables must not have the following columns: ""INDICATOR OK"" and ""INDICATOR PERC OK"" See screenshot. TODO: remove these columns in all kind of frequency table.",8 TDQ-2018,"Connection analysis : information_schema","When you create an connection analysis on mysql, you can retrieve informations from all databases except information_schema where data are 0 or NaN. But i have tables and data in this schema",5 TDQ-2699,"multiple analysis indicators are ""grayed out"" and cannot be used","When attempting to analyze DB2 table columns, not all analysis indicators are available",3 TDQ-1816,"""View invalid rows"" menu does not display on a table analysis (with DQ Rule)","If the DQ Rule has a ""join condition"", it is impossible to view the ""invalid rows"" from the analysis results: the option is not displayed. See the screen captures.",8 TDQ-2350,"Hide MDM connection in the Data Explorer perspective","I have a MDM connection in my DQ repository and a Mysql connection. When I switch to the Data explorer perspective and try to open a ""new SQL Editor"", I got the exception shown in the screen capture. ""c"" is an MDM connection. We should hide MDM connection from the Data Explorer perspective.",3 TDQ-2045,"Reload database list on MDM connection doesn't work","""Reload database list"" action on MDM connection doesn't work.",20 TDQ-616,"list of patterns does not display folders","See bug:10936 It is working correctly in 4.0.0M3 but it's not working in 4.0.0.",3 TDQ-655,"Improve the error message when I declare the Data Profiler reporting DB","If I declare a DB into preferences on Data Profiler reporting I have an error with no message. (with no grant access on the user). Is it possible to add a better message than this picture ?",5 TDQ-1901,"Import Oracle synonyms in to Metadata","Hi, Request you to include the feature to import Synonyms from Oracle database along with Tables and views in to the Metadata Tree under DB Connections and then be able to create and run analysis on the Synonym. Thanks, Chandana Busetty",40 TDQ-785,"After Time correlation analysis running, my studio got stuck","create a new Time correlation analysis, use ""tbi"" database, ""customer"" table, ""birthday"" and ""date_accnt_opened"" column(which contains NULL value), run this analysis after that, while I want to do any other operation, the studio will be very slowly I'm not sure the reason, but mzhao told me, perhaps it's about the column which contains NULL value...",8 TDQ-854,"analysis run by right click, the summary section not right","open an analysis, and run it by right click -- ""Run"" the summary information not right for eg: the ""Number of Execution"" should +1 but it's not, if I run with the toolbar button in the editor area, it will +2 take a look at testlink case ...",3 TDQ-855,"after preview some data, will get some errors","right click on a table or a column, select ""preview"" the result was right, and seems nothing serious but at ""Error Log"" view will get this tack :: org.eclipse.swt.SWTException: Failed to execute runnable (org.eclipse.swt.SWTException: Widget is disposed) at org.eclipse.swt.SWT.error(SWT.java:3884) at org.eclipse.swt.SWT.error(SWT.java:3799) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:137) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:3468) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3115) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2405) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2369) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2221) at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:500) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:493) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.datacleansing.core.ui.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:194) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:368) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:559) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:514) at org.eclipse.equinox.launcher.Main.run(Main.java:1311) Caused by: org.eclipse.swt.SWTException: Widget is disposed at org.eclipse.swt.SWT.error(SWT.java:3884) at org.eclipse.swt.SWT.error(SWT.java:3799) at org.eclipse.swt.SWT.error(SWT.java:3770) at org.eclipse.swt.widgets.Widget.error(Widget.java:450) at org.eclipse.swt.widgets.Widget.checkWidget(Widget.java:388) at org.eclipse.swt.widgets.Tree.getSelection(Tree.java:1709) at org.eclipse.jface.viewers.TreeViewer.getSelection(TreeViewer.java:255) at org.eclipse.jface.viewers.TreeViewer.setSelection(TreeViewer.java:343) at org.eclipse.jface.viewers.AbstractTreeViewer.setSelectionToWidget(AbstractTreeViewer.java:2477) at org.eclipse.jface.viewers.AbstractTreeViewer.setSelectionToWidget(AbstractTreeViewer.java:2900) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1399) at org.eclipse.jface.viewers.TreeViewer.preservingSelection(TreeViewer.java:402) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1353) at org.eclipse.jface.viewers.StructuredViewer.refresh(StructuredViewer.java:1455) at org.eclipse.jface.viewers.ColumnViewer.refresh(ColumnViewer.java:537) at org.eclipse.jface.viewers.StructuredViewer.refresh(StructuredViewer.java:1414) at net.sourceforge.sqlexplorer.connections.ConnectionsView$5.run(Unknown Source) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) ... 22 more",3 TDQ-856,"connection analysis with mysql, view keys or indexes will get a NPE","create a connection analysis with mysql run this analysis and right click on a table, select ""view keys"" or ""view indexes"" will get this stack :: java.lang.NullPointerException at org.talend.dataprofiler.core.model.SqlExplorerBridge.findSqlExplorerTableNode(Unknown Source) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractFilterMetadataPage$5.widgetSelected(Unknown Source) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:228) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1176) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3493) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3112) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2405) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2369) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2221) at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:500) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:493) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.datacleansing.core.ui.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:194) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:368) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:559) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:514) at org.eclipse.equinox.launcher.Main.run(Main.java:1311)",3 TDQ-2217,"jvm terminated error when -Xmx2048m or -Xmx1024m","When starting TOP with -Xmx2048m or -Xmx1024m setting in TalendOpenProfiler-macosx-carbon.ini in TalendOpenProfiler-macosx-carbon.app package TOP terminates on startup with an error message ""jvm terminated"" (screendump of error message attached) -Xmx512m is the largest value that allows TOP to start.",2 TDQ-2391,"When there are more than 2000 tables within an entity, can't execute analsysis on those tables","This example comes from DB2, but the customer has 2464 tables in some of their subsystems within the database, it is impossible to profile these because the number of tables exceeds the 2000 table limit. Obviously this is major problem as their system legitimately has more than this limit. Is there a way we can either make this limitation configurable or that we can eliminate it all together?",13 TDQ-903,"Missing field(s) in generated PDF report","When generating PDF reports for relation check (column set comparison - template basic match) Talend do not print out analysis name (only name of report is displayed in top of report), which makes it hard to understand which analysis one is looking at. Secondly, for all types of reports, we are missing fields for ""Purpose"" and ""Description"". This makes it even harder to read the report since we miss explanatory fields. It would be a great idea to add these to the report templates by default so that all charts and numeric information is backed up by the free text fields.",5 TDQ-1980,"get changes in ""database compare"" editor","When I click on the ""copy all non-conflicting changes"" button in the database compare editor, I get the following exception and the database is not retrieved in the DQ repository view.",3 TDQ-962,"Add a confirmation in the preference when we change the database","In the preference page, when the user changes the reporting database and click on ""apply"" or ""ok"", if the database version is correct and there is nothing particular to do, nothing tells the user that it's ok. Please add a pop-up with the following text (to be externalized): ""Connection successful and Datamart well configured""",5 TDQ-1875,"Feature Request: allow disabling Rules in Analysis, but keep them in the list","Dear team, It would be nice to have a feature that would allow the user to disable a certain rules/indicator. I envision a operation next to the 'remove' icon in the analysis Settings window where the user can enable/disable the selected rule. That would help in running one particular rule (out of several rules) just for testing or investigation. Thanks.",20 TDQ-2104,"Support Vertica database","Add Vertica database support in TOP. Define the database language for Vertical (Or make it possible to allow users configure the customized database?)",20 TDQ-1230,"Add a column with an information message when a pattern isn't validated in tMultiPatternCheck","It could be useful to set an extra column (optional) in tMultiPatternCheck to provide functional messages when a pattern isn't validated. For the moment, when a line is rejected, we don't have further information about which pattern has invalidated the row. With such an option, it would enable users to better qualify their rejects, by enriching the reject flow with this additional information.",1 TDQ-1254,"change the connect configuration data, the data under connection will not change automatically.","1. create a dbconnection. 2. open the dbconnection editor, click ""Edit"", in the ""Database Connection"" dialog, change the ""server"" to another one which is available, and ""finish"". Result: 1. we can check in the editor, the connection information have changed. but the database information in the Repository is the original data, it has not refreshed as connecting to a new dbserver. (1)if we reload the dbconnection, the data under the dbconnection will changed, but if the new and the orginal server have a database whose name is similar, the new one will not replace the old one. (2) if we ""database compare', it will show the right result: the ""distant strecture"" is the new server data, and the local is the original data.",3 TDQ-3298,"respository with joblet ,when switch to talend profiler will display failure.","Create one job about tmysqlinput->logrow,then refactor to joblet named mysql,run this job. Then switch to the ""Talend profiler"",you will see under the db connection ,display the schema ,not the db.see the jpg. Continue to switch to Talend Integration ,throw some errors: java.lang.Exception: the url of connection parameter can not be null at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.loadViews(Unknown Source) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getViews(Unknown Source) at org.talend.dq.nodes.DBViewFolderRepNode.createRepositoryNodeViewFolderNode(Unknown Source) at org.talend.dq.nodes.DBViewFolderRepNode.getChildren(Unknown Source) at org.talend.dataprofiler.core.ui.views.provider.ResourceViewContentProvider.getChildren(Unknown Source) at org.eclipse.ui.model.BaseWorkbenchContentProvider.hasChildren(BaseWorkbenchContentProvider.java:91) at org.talend.dataprofiler.core.ui.views.provider.ResourceViewContentProvider.hasChildren(Unknown Source) at org.eclipse.ui.internal.navigator.extensions.SafeDelegateTreeContentProvider.hasChildren(SafeDelegateTreeContentProvider.java:110) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.callNormalHasChildren(NavigatorContentServiceContentProvider.java:428) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.access$4(NavigatorContentServiceContentProvider.java:423) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider$3.run(NavigatorContentServiceContentProvider.java:393) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.hasChildren(NavigatorContentServiceContentProvider.java:379) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.hasChildren(NavigatorContentServiceContentProvider.java:420) at org.eclipse.jface.viewers.AbstractTreeViewer.isExpandable(AbstractTreeViewer.java:2082) at org.eclipse.jface.viewers.TreeViewer.isExpandable(TreeViewer.java:588) at org.eclipse.jface.viewers.AbstractTreeViewer.isExpandable(AbstractTreeViewer.java:2112) at org.eclipse.jface.viewers.AbstractTreeViewer.updatePlus(AbstractTreeViewer.java:2794) at org.eclipse.jface.viewers.TreeViewer.updatePlus(TreeViewer.java:852) at org.eclipse.jface.viewers.AbstractTreeViewer.createTreeItem(AbstractTreeViewer.java:830) at org.eclipse.jface.viewers.AbstractTreeViewer$1.run(AbstractTreeViewer.java:804) at org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) at org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:778) at org.eclipse.jface.viewers.TreeViewer.createChildren(TreeViewer.java:644) at org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:749) at org.eclipse.jface.viewers.AbstractTreeViewer.handleTreeExpand(AbstractTreeViewer.java:1444) at org.eclipse.jface.viewers.TreeViewer.handleTreeExpand(TreeViewer.java:952) at org.eclipse.jface.viewers.AbstractTreeViewer$4.treeExpanded(AbstractTreeViewer.java:1455) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:132) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1282) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1267) at org.eclipse.swt.widgets.Tree.gtk_test_expand_row(Tree.java:2105) at org.eclipse.swt.widgets.Widget.windowProc(Widget.java:1775) at org.eclipse.swt.widgets.Display.windowProc(Display.java:4378) at org.eclipse.swt.internal.gtk.OS._gtk_main_do_event(Native Method) at org.eclipse.swt.internal.gtk.OS.gtk_main_do_event(OS.java:8163) at org.eclipse.swt.widgets.Display.eventProc(Display.java:1239) at org.eclipse.swt.internal.gtk.OS._g_main_context_iteration(Native Method) at org.eclipse.swt.internal.gtk.OS.g_main_context_iteration(OS.java:2224) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3169) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.datacleansing.core.ui.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407)",3 TDQ-1340,"sort regex pattern tXXXInvalidRow/ValidRow","when you choose regex pattern , list value not sorted",8 TDQ-1359,"OutOfMemoryError in tMatchGroup","See related discussion topic:14891",13 TDQ-1556,"Import connections from CSV on TDQ product can't retrieve table","Import connections from CSV on TDQ product can't retrieve table,but TIS can works.",8 TDQ-1576,"tFirstnameMatch returns no firstname when several matches exist","The component returns a ""standard"" firstname when only one firstname has matched. It's very inconvenient to use when the country and gender information do not exist because there will always be several matches.",3 TDQ-1584,"tGenKey block profiler does not work with tMDMInput","tGenKey block profiler does not work with tMDMInput",13 TDQ-3227,"Add the ability to lookup for dependencies for a given object in the repository - Repository objects cross-references","It could be really nice to have the ability to find dependencies for a given object in the TDQ repository, just like we can already do in the DI Studio. For instance, I'd like to be able to answer the question ""Give me the list of the analysis that use this rule"", ""Give me the list of reports that use this analysis"", and so on... Adding a ""find dependencies"" in the contextual menu, when right-clicking on an element of the repository could be useful. ",13 TDQ-3228,"Add an ""export items"" item in the contextual menu of the repository","As a DI user, I would expect to have the same behaviour between TIS and TDQ. For instance, I'd like to have an ""export items"" item in the contextual menu of the repository, to backup my TDQ repo. Unfortunately, this item doesn't exist, and I have to find the related icon in the upper toolbar. Not so user-friendly, and most of the DI users don't find this icon, as they're used to right-click > export items. Can you please unify the user-experience, and add the ""export items"" directly in the contextual menu of the DQ Repository ? This would help DI users that switch to TDQ to find the same behaviour in the Data Profiler perspective.",5 TDQ-3249,"Indicators and indicators category should be internationalized","The text appearing in the column Indicator selection window must be internationalized. In particular Strings in IndicatorEnum should be externalized. ",8 TDQ-3322,"List all contexts in the Detail view","When the focus is on an analysis editor, the Detail view shows the contexts used by the analysis connection (if any). When the focus is on a report editor, the Detail view shows the contexts used by all the analyses that compose the report. ",13 TDQ-3330,"cannot find the synonym in the index when typing the key word(like as ""was"")","It can't find the synonym in the index when I type the key word(just like ""was"" , ""is"",""are""). But when I add the ""*"" at the end(like as ""was*""), it can match. My component is tsynonymSearch My Studio is Talend MDM Studio(MPX 4.2.2)",1 TDQ-3389,"Enhance the connection pool when executing the analysis","The connection pool instance will be created each for an analysis currently. Make the connection pool be shared among all analyses.",40 TDQ-3470,"can not get the Job correctly by the drill down item for the pattern matching item in the result page ","1. create a column analysis, add pattern ""Email Address"" pattern which is under Libraries->Patterns->Regex->internet. 2. run the anlaysis, in the result page, right click the pattern in the Pattern_Matching table, select ""Generate Job"", on the pop-up menu select ""generate an ETL job to get only valid rows"", 3. can get an job, but the pop-up dialog won't disappear, get error the same issue for columnset analysis, please make sure all the similar function work well.",5 TDQ-3490,"Amend UDI definition to allow drill-down into result sets.","Per suggestion in the thread http://talendforge.org/forum/viewtopic.php?id=17584. Enable drill-downs for UDIs by amending the information captured with the ""Edit expression"" dialog as follows. Tweak the UDI ""Indicator Definition"" window along the lines of: 1) Move ""Indicator Category"" prior to the ""Indicator Definition"". The Indicator Category defines the columns expected in the result set. 2.1) Within the ""Edit Expression"" window, extra input fields should be available, one for each column expected per the ""Indicator Category"". 2.2) Each extra field would then contain the expression to be used for the given column 2.3) The existing expression field would then be used for just the SQL required to obtain the result set. 2.4) Probably need to have a separate (though optional) input field for a ""GROUP BY"" clause, which would be applied as a suffix to 2.3) 3) The current Open Profiler functionality would be achieved by it building the necessary SQL from the constituent elements in the window. It would need to wrap an outermost ""SELECT"" and ""FROM"" around the expression provided within 2.2) and use the ""group by"" clause field from 2.4). 4) The ""view rows"" capability would then be able to use the logic within 2.3) to retrieve the underlying data. Of course, it's is always simpler to conceptualise a solution than it is to code it! ",3 TDQ-3605,"uncheck the selected columns can not saved","1. create a column analysis, selected some columns,save 2 reopen the analysis, the columns are still there. try to uncheck the columns in ""colulmn selection"" dialog(both try to click the table folder or the each colulmn one by one), click ""ok""close the dialog. 3. check the analysis editor, the colulmns are still there(checked status). save and reopen, columns are still there 4. the same issue for content compare analysis. shoule make sure for column/columnset/contentCompare/Norminal correlation/Numerical correlation/time correlation/function dependency analysis work well for, both check and uncheck function work well in the column selection dialog, and work well for delete selected columns in the column editor by delete button(especially for deleting more than one column)",3 TDQ-3606,"can't match the right data when having the same or lower score of searching(tsynonymSearch, Lucene)","My data synonym can be matched correctly when I want to find his data standard in the component ""tsynonymSearch"". In fact, the data input is the same as the data synonym. But ,I have a lower score than others which have less synonym data. My studio is Talend MDM Studio (TIS TDQ Enterprise MPx)(4.2.2r63143) My system is Ubuntu 10.10 ",13 TDQ-3608,"Set A threshold to filter the match results in the tSynonymSearch component with low score ","can't match the right data when the data input includes the words like as ""la"",""de"",.... My data synonym(input) can't be matched correctly when the data input with the words like as ""la "", ""de"",... My studio is TIS TDQ Enterprise MPx 4.2.2 r63143 My system is ubuntu 10.10",1 TDQ-3617,"generate job to get patterns, run the generated job with error","right click on patterns --> regex in repository, select ""Generate jobs"" --> ""Get patterns"" option then will generate a job, run this job will get this error Exception in component tFindRegexlibExpressions_1 org.dom4j.DocumentException: Error on line 59 of document : The element type ""br"" must be terminated by the matching end-tag ""
"". Nested exception: The element type ""br"" must be terminated by the matching end-tag ""
"". org.dom4j.io.SAXReader.read(SAXReader.java:482) org.dom4j.io.SAXReader.read(SAXReader.java:343) a.getwebpatterns_1316576908987_0_1.GetWebPatterns_1316576908987.tFindRegexlibExpressions_1Process(GetWebPatterns_1316576908987.java:1189) ",8 TDQ-3625,"create a new report twice, the second time can not be successful","with the same analysis, to create a a new report twice, after the second time, you can not see the report successfully note: should make both the ""replace"" and ""not replace"" OK",5 TDQ-3642,"parser rule import, export issues.","tried to export parser rule item I didn't find ""export ..."" on rule item, but I can find a menu ""export for talend exchange"" on their parent node so I click on that menu, and it will generate a .csv file and a .zip file zip is empty and the csv file is only contains title column, doesn't contain rule item in it then I tried import function I import the exported empty .csv file, I think the correct result is pop up a dialog to tell user that, ""no valid rules in that file .."" and do nothing but the result now is, it will ""import"" the rule with empty label, empty content in the repository. another is about Talend Exchange I can get one rule under exchange -- ""test parser rule"" I tried to import this into local after import operation is finished, I can't get this rule in my local repository (even not in workspace, I checked my disk) and it will pop a dialog shows that 4 items import in the list, 1 is imported successfully, 3 are ""already exists "" error message seems I import once, it will do 4 times and I think if the item is exists, it shouldn't be an error message, a warning message is better I think.",2 TDQ-3676,"Ability to define the order of Analysis in a report","There does not appear to be a mechanism for ordering the Anaylsis used in a DQ report. I thought it was ordered alpha-numerically, but I have just seen an example where it goes 01-, 04-analysis_name, 02-analysis_name, 03-analysis_name. A mechanism to allow user defined ordering of the analysis on a report would be very useful.",8 TDQ-3684,"Register via Proxy doesn't work","Dear team, Registering from within a corporate network that uses Proxies for Internet connection does not work. I put all proxy information into the network settings, but it always does not recognize me and TOP asked to provide all user information for registration. The function also did not work in 4.2.2. I usually go around the issue by using my home network connection. Going back after a failed attempt, the network settings do not include any information (all what I entered before is gone).",3 TDQ-3688,"Profile freezes and never comes back","While creating DB connection in TDQ profiler, if ""export as context"" is clicked and try to save talend hangs and doesn't comeback. I think this might be due to the reason that context concept is not for DQ but if that is the case then it would be better to not have that option of ""export as context"" on DQ side. ",3 TDQ-3691,"Configuration wizard failed after tFixedFlowInput","The data column is empty in the configuration wizard dialog of tMatchGroup after tFixedFlowInput",3 TDQ-3692,"Order or results of Column analysis using UDI appears random","I have a UDI Freqency Analsyis which I use in a DQ Analysis. When I run the analysis in teh Studio, the results are shown in decending order or frequency. However, the same Analysis used in a report shows the results in random order. Please see attached examples",5 TDQ-3769,"synonym index tree item doesn't order items","in ""synonym index"" view open one index file, the items of the tree is not ordered",5 TDQ-3811,"Each time run ""exportitems"" use commandline ,many unexpect info popup","Each time run exportitems use commandline ,many unexpect info popup !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,688 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\address\Postal_code_or_Pin_code_of_India_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\internet\Website_URL_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\date\French_date_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\phone\FR_Phone_Number_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\SQL\internet\Email_Yahoo_0.1.pattern !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Indicators\System Indicators\Correlation\Multiple_Column_Frequency_Table_0.1.definition !ENTRY org.talend.platform.logging 1 0 2011-10-20 13:51:22.703 !MESSAGE 2011-10-20 13:51:22,703 INFO org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter - Exporting F:\build\V5.0.0RC1\Talend-All-r70511-V5.0.0RC1\commandline-workspace\TEST\TDQ_Libraries\Patterns\Regex\number\Integer_values_0.1.pattern ............................ ",5 TDQ-3840,"for column set analysis only the last run one can show the content.","1. create 3 report(a1,a2,a3) which just contains column set analysis. 2. generate report file a1,a2,a3 3. check the function of ""Reporting->Table analysis->column set analysis"" result: can retrieve a1, a2, a3 correct. try to check the content of the three file. only a3 which the last generate one show the content. 4. run report a1 in studio again, then check in dqportal, only a1 show content. should make it work well for mysql and oracle datamart on branch 4.2 and trunk.",8 TDQ-3903,"A not exists table is shown to user in portal of overview analysis report","start dq portal run a overview analysis report In result table list there is a not real exists table -- ""TOTAL"" take a look at screen shot ..",2 TDQ-3906,"output of tMatchGroupHadoop is optional","Currently, each tMatchGroupHadoop component will output the match result of the current pass. In effect, the output won't be necessary if its immediate follow up component is also a tMatchGroupHadoop. Add a checkbox in the properties panel of tMatchGroupHadoop called ""Keep data in hadoop"". When unchecked, the component works as it is currently working; that is: data are retrieved from hadoop hdfs and output in the job flow. When checked, the component leaves the data on hadoop hdfs. By default, the checkbox is unchecked. ",13 TDQ-3917,"Dq portal template design improvements","Login as tdq_user: Choose menu : Reporting->Column analysis->Simple statistics , we could see many kinds of reports (this 'kinds' means the classification of reports in dq portal), such as Frequency statistics/Pattern matching. Similarly, we could find Frequency report when pass 'Frequency statistics' menu (Pattern matching report also like this). I think the Frequency report should be the same no matter with which menu we passed(Simple statistics menu or Frequency statistics menu), so 'Simple statistics' report and 'Frequency statistics' report and 'Pattern matching' report should be the same template. And we could see the initial templates of report Simple statistics/Frequency statistics/Pattern matching , they use the same template (p01_column_basic.jrxml) , but now the templates are different , I think it's wrong. In this case, we need to fix one by one, very time consuming. And I think it's not the original designers ideas. So I think, if we can use the same template report, try to use the same. ",8 TDQ-3978,"Ctrl+S does not save the pattern editor","In Talend-Studio-r72167-V5.0.0NB, the shortcut Ctrl+S does not save the Pattern editor. I can only save with the ""save"" button. ",2 TDQ-3995,"Check and update standardization jobs in DQ demo project according to the latest changements",NULL,3 TDQ-4018,"start top on redhat, the welcome page is blank, when create files, the help inform in the wizard in blank.","1. start top on redhat os. 2. check the 'welcome page', it is blank 3. try to crate analysis file, the help information is also blank, and sometimes it will pop up a new file to show the help information. refer to pic.",3 TDQ-4036,"Review all the existing cheat sheets and list here the missing ones","There is not cheat sheet to create a file connection for instance. Please, list all the missing cheat sheets here (those should correspond to the creation menus of the DQ repository view). If you think about other cheat sheets, add them here too. We'll decide later which one will be implemented. ",8 TDQ-4037,"Improve ""Details view""","See attached screen capture.",13 TDQ-4039,"when colse the configuration wizard just save the origianl tab value, but not the current one","1. create a job with tMatchGroup component , can run the job correctly. 2. get the configuration wizard of the component. 3. click the 'duplicate rule ' icon, will get a new rule named 'Match Rule1' whose value is same as the 'Component' one. 4. select 'Match Rule1' tab, click 'refresh' to get the result, but not same with 'Component' (issue 1) 5. do some change in the 'Match Rule1' tab, then 'refresh' get result, click 'ok' to close the wizard. 6. check the property of tMatchGroup, it save the value of 'Component', but not the current one when you close the dialog(issue 2). ",8 TDQ-4054,"DQ Repository view UI improvements","The icons are not fully visible on Linux. The scrollbar should appear only when needed.",5 TDQ-4056,"Wrong label for summary statistics","The summary statistics table in the result tab of the column analysis should not display ""count"" but ""value"" instead.",1 TDQ-4067,"blank pattern test, make a different result about ""Tab"" between DB and java","pattern test result of ""blank text"" about ""Tab"" character, if choose DB connections to test, got non-match but if it is java, will got a match shall we make the results are unanimous ? (both ""match"" or ""non-match"")",5 TDQ-4108,"Unable to drill down on Teradata databases","This issue is similar to one raised on old bug tracker with id 0023101 . Unable to drilldown on Teradata database in DQ Repository . I'm able to drill down(and view the database structure) in Data Explorer view. The drill down is only working in TOP 4.1.3 but neither in TOP 4.2.3 nor in TOS DQ 5.0.0",3 TDQ-4116,"Welcome screen is different for local and remote connections","The Talend Data Quality exposes different Welcome screens for local and remote connections. The screen shots are attached. This task has very low priority, it doesn't impact on anything. I've created this task because it might be related to this task http://jira.talendforge.org/browse/TDQ-4087.",5 TDQ-4117,"TOP 4.2.3 - DB Connection is referencing wrong columns","I have a DB connection to a MYSQL DB that has multiple catalogs and multiple tables. When I look at the columns for a specific table (cif.customer) in TOP, the columns do not match what is in MYSQL Workbench. If I do a column reload, the columns do match what's in MYSQL Workbench. If I try to do a Columnset Column Analysis and point to the cif.customer table, the columns are not correct. ",5 TDQ-4133,"Permgen space exception in data explorer","I got a Permgen space exception after running a query to see the invalid rows of a DQ rule applied in a table analysis. (See the dqrule in the log) 27592102 [main] INFO org.talend.core.model.metadata.builder.util.MetadataConnectionUtils - Database Product Name: MySQL 27592138 [main] INFO org.talend.core.model.metadata.builder.util.MetadataConnectionUtils - Database Product Version: 5.1.36-log 27726641 [Thread-160] INFO org.talend.dq.analysis.AnalysisExecutor - Connection tojdbc:mysql://localhost:3306/tbi?noDatetimeStringSync=true 27727095 [Thread-160] INFO org.talend.cwm.management.connection.DatabaseContentRetriever - Database Product Name:MySQL 27727095 [Thread-160] INFO org.talend.cwm.management.connection.DatabaseContentRetriever - Database Product Version:5.1.36-log 27728284 [Thread-160] INFO org.talend.dq.analysis.TableAnalysisSqlExecutor - Computing indicator: Row Count 27728303 [Thread-160] INFO org.talend.dq.analysis.TableAnalysisSqlExecutor - Executing query: SELECT COUNT(*) FROM `tbi`.`customer` 27728424 [Thread-160] INFO org.talend.dq.analysis.TableAnalysisSqlExecutor - Computing indicator: rule 27728425 [Thread-160] INFO org.talend.dq.analysis.TableAnalysisSqlExecutor - Executing query: SELECT COUNT(*) FROM `tbi`.`customer` WHERE (email like '%@company%' or email like '%@%.com') 27728451 [Worker-128] INFO org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction - ""Analysis ""rule"" execution code: OK. Duration: 1.79 s. 27737110 [main] INFO org.talend.cwm.management.connection.DatabaseContentRetriever - Database Product Name:MySQL 27737123 [main] INFO org.talend.cwm.management.connection.DatabaseContentRetriever - Database Product Version:5.1.36-log Error while informing user about event loop exception: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:632) at java.lang.ClassLoader.defineClass(ClassLoader.java:616) at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.defineClass(DefaultClassLoader.java:188) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.defineClass(ClasspathManager.java:580) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findClassImpl(ClasspathManager.java:550) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClassImpl(ClasspathManager.java:481) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClass_LockClassLoader(ClasspathManager.java:469) at org.eclipse.osgi.baseadaptor.loader.ClasspathManager.findLocalClass(ClasspathManager.java:449) at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.findLocalClass(DefaultClassLoader.java:216) at org.eclipse.osgi.internal.loader.BundleLoader.findLocalClass(BundleLoader.java:393) at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:469) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:422) at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:410) at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(DefaultClassLoader.java:107) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) at net.sourceforge.squirrel_sql.fw.sql.SQLConnection.(SQLConnection.java:80) at net.sourceforge.sqlexplorer.dbproduct.SQLConnection.(SQLConnection.java:49) at net.sourceforge.sqlexplorer.dbproduct.ManagedDriver.getConnection(ManagedDriver.java:212) at net.sourceforge.sqlexplorer.dbproduct.User.createNewConnection(User.java:410) at net.sourceforge.sqlexplorer.dbproduct.User.getConnection(User.java:290) at net.sourceforge.sqlexplorer.dbproduct.Session.grabConnection(Session.java:131) at net.sourceforge.sqlexplorer.dbproduct.ConnectionJob.run(ConnectionJob.java:116) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Dialog open exception: java.lang.OutOfMemoryError: PermGen space ",13 TDQ-4159,"can't show the column filter and table filter Text when table include many columns","if a table include many columns, when open the ""Select Column Dialog"", can't show the column filter and table filter Text correctlly, see the screenshot a.jpg, the right show should be b.jpg",5 TDQ-4179,"user defined indicator cannot be duplicated","while I tried to duplicate a user defined indicator it pops me a dialog says: this '..' of indicator's type could not be duplicated",5 TDQ-4183,"Enable cascade rules in tRuleSurvivorship component","permit users to resolve the survivors by several steps.",13 TDQ-4189,"import items overwrite function about system indicator","In 4.2.x workspace, I got a column analysis with some system indicators these indicators only have one DB definition (for eg: only mysql) .. In 5.0.x workspace, I got another column analysis with the same indicators as in 4.2.x these indicators also have only one DB definition (for eg: only postgresql) import 4.2.x workspace into 5.0.x whatever I overwrite or not about these used indicators there is always one side can't work well ... overwrite: the analysis in 5.0.x can't work not: the analysis in 4.2.x can't work",28 TDQ-4193,"Create TUJ for TDQ-3273","Create a TUJ to test the changes done in TDQ-3273 See with Sizhao Liu if you need more information. ",2 TDQ-4234,"Store the report execution time","When we run a report several times and the analysis is not refreshed, then we loose the information about the time when the report has been executed. This results in some bugs in the generated reports (such as duplicated rows in overview analysis) TODO: 1. Store the metadata results in the report object. 2. Store these information in the fact tables of the datamart. 3. create a database migration task to add the columns. items 2 and 3 will be worked in related issues. ",5 TDQ-4268,"According to the suggestions of tech meeting TDQ-4194, clean up the un-disposed system resources.","- Use tools mentioned in the meeting (sleak etc.) to find the resources in DQ projects that are not disposed appropriately before. - Dispose them in the right way. ",8 TDQ-4313,"edit the system indicator's name may lead to some problems when do migration.","in our product, we can change the name of the system indicator, but this will lead to the same UUID after migration to a new workspace.",3 TDQ-4327,"Error happens when displaying the help contents in DQ studio","Open the help window in DQ studio, the contents of left panel was empty. Click the ""Index"" tab below, error occurs.",2 TDQ-4329,"Need to fix / review JUnits","Here's the list of failed JUnits actually on trunk / branch 5.0 related to DQ: org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetTypeSystem org.talend.cwm.db.connection.DBConnectTest.testRetrieveColumn org.talend.cwm.management.api.DbmsLanguageTest.testDbmsLanguage org.talend.cwm.management.api.DbmsLanguageTest.testDbmsLanguageString org.talend.cwm.management.api.DbmsLanguageTest.testDbmsLanguageStringIntInt org.talend.cwm.management.api.DbmsLanguageTest.testAnd org.talend.cwm.management.api.DbmsLanguageTest.testOr org.talend.cwm.management.api.DbmsLanguageTest.testBetween org.talend.cwm.management.api.DbmsLanguageTest.testNotEqual org.talend.cwm.management.api.DbmsLanguageTest.testEos org.talend.cwm.management.api.DbmsLanguageTest.testGetDbmsName org.talend.cwm.management.api.DbmsLanguageTest.testGetDefaultLanguage org.talend.cwm.management.api.DbmsLanguageTest.testToQualifiedName org.talend.cwm.management.api.DbmsLanguageTest.testGetZqlParser org.talend.cwm.management.api.DqRepositoryViewServiceTest.testGetTables org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetSchemas org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetTablesWithColumns org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetColumns org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetTablesWithoutColumns org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetViewsWithColumns org.talend.cwm.management.connection.DatabaseContentRetrieverTest.testGetDataType org.talend.dq.analysis.explore.PatternExplorerTest.testGetInvalidRowsStatement org.talend.dq.analysis.explore.PatternExplorerTest.testGetValidRowsStatement org.talend.dq.sql.converters.CwmZExpressionTest.testGetOperator org.talend.dq.sql.converters.CwmZExpressionTest.testSetOperandsColumnColumn org.talend.dq.sql.converters.CwmZExpressionTest.testGetColumn1 org.talend.dq.sql.converters.CwmZExpressionTest.testGetColumn2 org.talend.dq.sql.converters.CwmZExpressionTest.testGenerateZExpression org.talend.dq.sql.converters.CwmZExpressionTest.testGenerateExpressions org.talend.dataquality.matching.date.pattern.DatePatternRetrieverTest.testHandle org.talend.dataquality.standardization.index.test.IndexBuilderTest.testGetIndex org.talend.dataquality.standardization.index.test.IndexBuilderTest.testInitializeIndex org.talend.dataquality.standardization.index.SynonymIndexBuilderTest.deleteIndexFromFS org.talend.dataquality.standardization.main.test.BooleanQueryTest.testAnd org.talend.dataquality.standardization.main.test.HandLuceneImplTest.testCreateIndex org.talend.dataquality.standardization.main.test.HandLuceneImplTest.testGetSearchResultStringStringMapOfStringStringBoolean org.talend.dataquality.standardization.query.test.FirstNameStandardizeTest.testStandardizeStringString ",40 TDQ-4351,"fix problems with HandLuceneImplTest and FirstNameStandardizeTest","These tests are running as Junit tests in my environment. Do we need to run them as Plugin Junit tests?",2 TDQ-4377,"Messy Layout of Analysis Summary","The layout of the summary data could do with an overhaul. Title and Data text run together with spacing.",2 TDQ-4378,"Check indicators' UUIDs","The attached document describes the UUIDs as they were in April 2009. Check whether they have changed. ",8 TDQ-4393,"The second time logon DQ demo project , error message","Launch studio and import DQ demo project, the first time is ok switch project logon demo project again, get error at error log list(logon with this license:MDM_TDQ_EE_MPX_5users): org.eclipse.core.runtime.AssertionFailedException: null argument: at org.eclipse.core.runtime.Assert.isNotNull(Assert.java:85) at org.eclipse.core.runtime.Assert.isNotNull(Assert.java:73) at org.eclipse.core.internal.events.ResourceChangeListenerList.remove(ResourceChangeListenerList.java:146) at org.eclipse.core.internal.events.NotificationManager.removeListener(NotificationManager.java:305) at org.eclipse.core.internal.resources.Workspace.removeResourceChangeListener(Workspace.java:1934) at org.eclipse.wst.server.core.internal.ResourceManager.shutdownImpl(ResourceManager.java:367) at org.eclipse.wst.server.core.internal.ResourceManager.shutdown(ResourceManager.java:313) at org.eclipse.wst.server.core.internal.ServerPlugin.stop(ServerPlugin.java:360) at org.eclipse.osgi.framework.internal.core.BundleContextImpl$2.run(BundleContextImpl.java:843) at java.security.AccessController.doPrivileged(Native Method) at org.eclipse.osgi.framework.internal.core.BundleContextImpl.stop(BundleContextImpl.java:836) at org.eclipse.osgi.framework.internal.core.BundleHost.stopWorker(BundleHost.java:501) at org.eclipse.osgi.framework.internal.core.AbstractBundle.suspend(AbstractBundle.java:550) at org.eclipse.osgi.framework.internal.core.Framework.suspendBundle(Framework.java:1097) at org.eclipse.osgi.framework.internal.core.StartLevelManager.decFWSL(StartLevelManager.java:597) at org.eclipse.osgi.framework.internal.core.StartLevelManager.doSetStartLevel(StartLevelManager.java:257) at org.eclipse.osgi.framework.internal.core.StartLevelManager.shutdown(StartLevelManager.java:215) at org.eclipse.osgi.framework.internal.core.InternalSystemBundle.suspend(InternalSystemBundle.java:266) at org.eclipse.osgi.framework.internal.core.Framework.shutdown(Framework.java:690) at org.eclipse.osgi.framework.internal.core.Framework.close(Framework.java:588) at org.eclipse.core.runtime.adaptor.EclipseStarter.shutdown(EclipseStarter.java:415) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:198) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383)",8 TDQ-4433,"different migrate ways lead to defferent result for generating report migrate from 4.1.3 which contains overview analysis or column set analysis","way 1 (1). migrate report from 413 by logon window, select the ""root directory"" way choose the project want to migrate. (2). generate the report file which contains overview analysis or column set analysis, successfully. way 2. (1). migrate report from 413 by import button, select the ""root directory"" way choose the project want to migrate, and checked the system indicators(it is automatically checked). (2). generate the report file which contains overview analysis or column set analysis, successfully. way 3. (1). migrate report from 413 by import button, select the ""root directory"" way choose the project want to migrate, and un-checked the system indicators(it is automatically checked,should uncheck them manually). (2). generate the report file which contains overview analysis or column set analysis, failed. get errors way4. (1). export the report file in 413 as a zip file, doesn't export the indicators file. (2). import the exported file in step 1 (3). generate the report file, get errors. 2012-01-06 18:10:33,468 WARN org.talend.dq.persistence.handlertype.AbstractPersistenceHandler - Can't find the category of indicator 'null' ",13 TDQ-4437,"correct logic probleme in TUJ named Feature_TDQ_3568_tGoogleAddressRow",NULL,1 TDQ-4453,"export mdm connection don't include the .xsd folder","export mdm connection don't include the .xsd folder",8 TDQ-4513,"import the file have just exported failed.","1. create some files by tdq, export them. 2. try to import the items again, failed , refer to the pic. no errors. have attached the file have exported.",8 TDQ-4522,"switch page number in result page will cause studio crash for large data.","1. I have imported some files from 413(43 analysis, 22 report, 10 dbconnecton) 2. create an analysis which contains 100 columns and select all indicators for the analysis. 3. run the analysis and then switch to result page, after change page number , it seems when change 9 times, error will show. studio will crash. I don't know why can not reproduce this on top(no files imported from 413)",8 TDQ-4523,"Add ""Table analysis"" menu on the views in the overview analysis editor","There is currently a menu to do a table analysis on analyzed tables. Add the same menu on the analyzed views. ",8 TDQ-4526,"Messed up DQ repository view","I did several simple analyses and report on columns, tables, views, connections, catalogs... The DQ repository view ended up to a big mess. See attached screen capture. After I clicked on Refresh, it seems that everything returned to the expected layout. ",13 TDQ-4527,"Create a project to check the integrity of the DQ datamart","We need a DQ project that analyzes the DQ datamart and checks the quality of the content of the DQ datamart. This project existed in version 3.2.2. I have a 150Mo zip file. If we can't import it, then we need to create it from scratch. We'll have to maintain this project through all the future releases. In my opinion, this project should be used and maintained by the QA team. ",20 TDQ-4534,"after Import Patterns, the DQ Repository view do not refreshed automatically","after Import Patterns, the DQ Repository view do not refreshed, so could not find the import pattern, the user have to refresh himself",3 TDQ-4535,"columns in analysis gone after reloading the connection with changing filter in the connection wizard","sometimes reolad connection don't should lost information on the analysis.",5 TDQ-4539,"Patterns/indicators have the same label but in different folder can't be added into analysis","If the pattern or indicator has the same label, but they don't in the same folder cannot be added into analysis branch 5.0 and trunk, can't create the item that have the same label but the warning information seems not right please check that",5 TDQ-4544,"Do dispose for tmatchgroup configure wizard","Too many leaks on closing wizard dialog.",8 TDQ-4545,"Properly handle dependencies between report and jrxml files","Properly handle dependencies between report and jrxml files",13 TDQ-4550,"Inform about the database version","The information dialog must display the datamart version. The message should read: ""Your DQ datamart version is old: "" + + "". Do you want to upgrade it?""",3 TDQ-4553,"Rule Node could not Link to DQ RuleEditor","The reason is not returned the link helper descriptors for a given selection and content.",5 TDQ-4555,"Remove org.deved.antlride.ui from svn","Remove this plugin from source and find a way to patch it. note that only the plugin export package: org.deved.antlride.internal.ui.editor have been made public in order to reuse the editor in the parser Rule Test Editor.",3 TDQ-4558,"Connection in Report editor","The connection used by the report editor should be configurable as ""built-in"" or ""repository"". Add a combo list with these two values ""built-in"" and ""repository"". When the ""built-in"" mode is selected, the connection fields are editable (just like now). When the ""repository"" mode is selected, an existing connection in the repository can be chosen. - ""built-in"" mode: the button on the right side allows the user to export his connection to the repository. - ""repository"" mode: the button on the right side allows the user to select an existing connection. It opens a pop-up to select a connection with type ""MySQL"" or ""Oracle"" only. When this mode is chosen, the connection fields are read-only. * Note: When the repository mode is used, it's possible for the user to have a contextualized connection. Make sure that everything works when there is a context, and the report is exported as script or job. ",13 TDQ-4559,"Add ""switch context"" menu on file connection","There is no menu to switch the context on a file connection. Add this contextual menu on file connections (just like for the database connections). (Note: MDM connections don't handle contexts. So we won't do anything for these connections)",5 TDQ-4570,"Use the tMatchGroup configuration wizard also for the tMatchGroupHadoop","Use the same configuration wizard. ",13 TDQ-4584,"analysis with file connection run failed","column/columnset analysis run with file connection failed will throw this error:: java.lang.NullPointerException at java.util.Hashtable.put(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.checkConnIsUseful(RunAnalysisAction.java:317) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.run(RunAnalysisAction.java:217) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:452) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",5 TDQ-4594,"Change the link to the bugtracker in the bookmark list","Click on Help>Bookmarks. The link to Talend bugtracker must be changed to Jira: http://jira.talendforge.org ",1 TDQ-4599,"truncated string in pattern test view","The text is truncated in pattern test view. See screenshot. The text field should adapt to the input text (don't use a fixed size)",2 TDQ-4601,"Remove the pattern category from Talend Exchange","Remove the Talend Exchange ""Pattern"" category in the studio. Remove the category on the Talend Exchange website.",2 TDQ-4602,"Export babili translations into trunk of SVN",NULL,2 TDQ-4603,"try to import a file under Libraries->Exchange->Regex for the second time, will get errors.","1. logon a remote project 2. import the file under Libraries->Exchange->Regex. 3. after imported, check Libraries->Patterns->Regex, the file shows, 4. try to import the file which you have just imported again. result : (1) get an inform dialog which show information the file you have imported (2) get error (check it under ""Details"" tab) 5. try to imported other file under Libraries->Exchange->Regex, will get inform dailog, and errors. note: after import, when click on one node in the DQ repostory view, (for example: TDQ_Libraries/Exchange/Regex/Dutch Phone Number), can get the error dialog",13 TDQ-4604,"try to import 413 files on logon window ""Import existing projects as local""","1. on the logon window try to import a 413 project. 2. logon the project, check the analysis all show as ""TDQ Analysis"" , report show as ""TDQ Reports"" try to unfold the system indicators folder, can not unfold. 3. try to import the same 413 project, the indicators will be selected automatically, after imported successfully. check the system indicators , all show twice. both logonon window and import button should work well for the migration. ",8 TDQ-4607,"Rename the file under the ""Librarys\Sources Files\"", then open it, the display of the editor is incorrect","1. unfolder the ""Librarys\Sources Files\"" 2. rename the file ""TEST_TOP"", see the DQ Repository view, there is no change 3. then open it, the display of the editor is incorrect note: there is no error in the Error view",3 TDQ-4608,"Generate user define report when select columnset as report template selector has some error"," 1.Right click on folder DQ Repository->library->JRXML Template. 2.click ""Import Build-in Reports"". 3.Create a columnset analysis , 4.Create a report ,set the columnset analysis as analysis , and select .jrxml file b01_column_set_basic or b01_column_set_evolution as template type. you can refer to u_define1.png 4.Run this report.Generate file. It's error. you can refer to the u_define2.png and the error log in the attarch file ",5 TDQ-4609,"Add the display name of the items in the DQ datamart","Add a new column in all dimension table for the display name. See related issue TDQ-4313",20 TDQ-4612,"Sort data in the output of the tMatchGroupHadoop component","Add an option to sort the data in the advanced settings of the component (just like the tMachGroup) Sort the data using the hadoop framework. ",13 TDQ-4614,"Upgrade SpagoBI","- Download the SpagoBI which is the latest stable release. - Replace the related libraries and configuration file (backup the configuration before replacement). - Reconfigure the SpagoBI together with DQPortal configuration. - Handle database discrepancy (migration the database). - Launch the application and test the features. - List here the failed features and incompatible features if any.",20 TDQ-4615,"Prepare DQ Portal migration script","As a user of the DQ Portal in previous version, I will want to migrate my DQ portal to the new version in order to keep of of my customizations done in the previous version (reports added, menus, users, etc)",13 TDQ-4616,"Enable the upgrade from the installer",NULL,20 TDQ-4627,"Incorrect ""Java option"" tab for the ""frequency table"" indicator","This tab should not appear on the ""frequency table indicator"". It's specific to the pattern frequency table indicator. ",2 TDQ-4628,"Cannot create a DQ rule","got this NPE when i create a new DQ rule in the DQ Demo project java.lang.NullPointerException org.talend.dq.indicators.definitions.DefinitionHandler.getDefinitionById(DefinitionHandler.java:385) org.talend.dq.indicators.definitions.DefinitionHandler.getDQRuleDefaultIndicatorDefinition(DefinitionHandler.java:368) org.talend.dataprofiler.core.ui.wizard.dqrules.NewDQRulesWizard.getExpression(NewDQRulesWizard.java:105) org.talend.dataprofiler.core.ui.wizard.dqrules.NewDQRulesWizard.createAndSaveCWMFile(NewDQRulesWizard.java:82) org.talend.dataprofiler.core.ui.wizard.AbstractWizard.performFinish(AbstractWizard.java:65) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.dataprofiler.core.ui.action.actions.CreateDQRulesAction.run(CreateDQRulesAction.java:63) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:125) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",3 TDQ-4630,"Cannot save a functional dependency analysis","Create a functional dependency analysis in the DQ demo project. Save. Got this NPE: java.lang.NullPointerException org.talend.dq.indicators.definitions.DefinitionHandler.getDefinitionById(DefinitionHandler.java:385) org.talend.dq.indicators.definitions.DefinitionHandler.getFDRuleDefaultIndicatorDefinition(DefinitionHandler.java:372) org.talend.dataprofiler.core.ui.editor.analysis.ColumnDependencyMasterDetailsPage.saveAnalysis(ColumnDependencyMasterDetailsPage.java:260) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.doSave(AbstractAnalysisMetadataPage.java:153) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.doSave(AnalysisEditor.java:147) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.run(RunAnalysisAction.java:139) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:452) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:125) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",3 TDQ-4632,"[Distinct indicator on column which name contains parentheses] Analysis failed","[Distinct indicator on column which name contains parentheses] Analysis failed when column name contains parentheses like ""attribut (IRIS)""",5 TDQ-4644,"when pattern is defined on only a database, ""Generate an ETL job to handles rows"" function failed.","1. create a pattern which definition is only for oracle database. 2. create a column analysis about an oracle dbconnection. 3. add pattern to the analysis, analysis run well. 4. turn to analysis result page, right click the pattern in the result table ->generate job, in the pop up dialog, select ""Generate an ETL job to handles rows"" can not continue, refer to the pic attached(Generate an ETL job Error.bmp). ",3 TDQ-4645,"Add ""filter"" attribute in connection file, provide filter on right click context menu like column filter.","- Add a ""packageFilter"" as a tagged value for connection. - Save the value to this filter the first time connection created. (note that most of database, the parameter ""database"" can be used as filter) - Provide context menu on connection to be able to add/alter filter just like column filter. - Create migration task to fill in this filter for existing connections from older build.",5 TDQ-4646,"can not generate the AlterThresholdValidation job successfully.","1. crate an analysis, set some thresholds, and some data is out of the range you set. 2. create a report about the analysis, and generated successfully. 3. right click the report generate jobs->Alter threshold violations. the job can generate but get errors, can not run successfully either.",8 TDQ-4654,"Threshold violation don't appear for phone number indicators","I've set a threshold on the ""possible phone number"" indicator. This threshold is violated and the value of the indicator appears in red in the report. That's correct, but the INDICATOR_PERC_OK displays ""N/A"". It should display ""N"". See screenshot",5 TDQ-4655,"tRecordMatching returns all remaining rows in the ""non-matches"" flow","In the ""cif"" job, the ""matches"" flow contains 297 rows. In the ""cif_without_match, I removed the ""matches"" flow. All the 297 rows went to the ""non-matches"" flow !!",1 TDQ-4665,"with tBRMS component, ""Guvnor Package"" links are incorrect if browse POJO class from a snapshot folder","With tBRMS component, we need to browse a jar containing POJO classes from remote guvnor repository, in order to create JiBX binding for the XML output, as a runtime dependancy of the Job. We also need a remote URL to access the remote binary Knowledge Package. The component help us to retrieving this URL based on the webdav structure whe we browsed our POJO file. The problem is that the webdav structure of Guvnor is actually not coherent to the binary package path that we need. If the POJO file is selected from package folder (like trunk), the URL webdav is very near to that of binary package. we only need a concatenation and a small replacement (""/packages/""->""/package/""). But if the POJO file is selected from a snapshot folder (like a release of business rule set), The ""Guvnor Package"" field will be filled like ""/snapshots/org.talend.bank/snap123/LATEST"", which should be ""/packages/org.talend.bank/snap123"" instead. ",1 TDQ-4669,"change the strategy behavior","At the moment, if ""First"" is selected as strategy, and the lookup returns several Matches and several Possibles, the output will contain the first one of Matches, and the first one of Possible Matches. The ""Last"" and ""Best"" Strategies have the similar behaviors. These behaviors should be changed according to the objectif of the strategy in real life. A. ""First"" strategy aims to quickly find out a match who passes the threshould. The output should only contain the first match, or the first possible match in case there is no match. B. ""Last"" strategy is for special reason, for example, the records are merged from several sources and the last source among them is supposed to contain records with best quality. The behavior of this strategy should be similar to ""First"". C. ""Best"" strategy is used to find out the best match, or the best possible match when there is no match, there should be only one output record for a source record. Imagine that we have the following sequences of scores as a result of lookup, for which 0.7 and 0.3 are respectively the threshoulds of match and possible match: A) 0.4 0.6 0.9 1.0 0.8 0.5 0.1 With ""First"" strategy, the final result should be 0.9 With ""Last"" strategy, the final result should be 0.8 With ""Best"" strategy, the final result should be 1.0 remark: if the Matches connection is not activated, it only means the user don't want to know the matches. So even in this case, we should not output anything to the Possible connection. B) 0.4 0.6 0.5 0.1 With ""First"" strategy, the final result should be 0.4 With ""Last"" strategy, the final result should be 0.5 With ""Best"" strategy, the final result should be 0.6 ",8 TDQ-4672,"some system indicators will be unload after run duplicate","1.run the duplicate on some analysis 2.then create a new dq rule some system indicators will be unload, then there will throw NPE when create a new DQ Rule the system indicators which be unload are: on branch 5.0 demo project: 1. WeekFrequency 2. Catalog Overview 3. Connection Overview 4. Schema Overview 5. Phone Number Statistics 6. IQR 7. Mean 8. Range 9. Summary Statistics on trunk new project: 1. Catalog Overview 2. Connection Overview 3. Schema Overview 4. Phone Number Statistics 5. Simple Statistics 6. IQR 7. Mean 8. Range 9. Summary Statistics 10. Text Statistics",13 TDQ-4673,"The link to the installation guide in the Welcome page is dead","When you launch the TOS for DQ build, the ""installation guide"" link points to an empty page (see screenshots attached). Note that the ""valid"" wiki page that explains the installation process can be seen here: http://talendforge.org/wiki/doku.php?id=doc:installation_guide launch the top",1 TDQ-4674," little typo error in the fuctionality of nominal correlation analysis","just found this little bug while using Talend Open Studio for MDM while doing ""Nominal Correlation Analysis"" from the Profiling perspective... displays ""show in fullscreem"" instead of ""fullscreen"" have attached the image showing it... hope you guys fix it :) cheers...",2 TDQ-4675,"Should default select the used item in Pattern Select Dialog ","1.selecet a pattern for column analysis.then save this analysis. 2.reopen the Pattern Select Dialog,that item checkbox is not checked.",8 TDQ-4676,"Threshold for Pattern Match is not clear.","1.set the threshold(make it is out of range) for pattern. 2.run this column analysis. 3.the value color of column '#Match' '%Match' in result page is red. 4.the value color of column 'Not Match' in the realted report is red. I don't know that it is aviable for Match or Not Match.",3 TDQ-4688,"it is so slow when duplicate a DQRule in the demo project","judge the same name when duplicate a DQRule will call the method ""List org.talend.dq.helper.resourcehelper.ResourceFileMap.getAll()"" to get all type of ModelElements, it should be only get the DQRules",3 TDQ-4691,"""view row "" failed for MDM analysis ","1. create a mdm connection. 2. create a column analysis about this connection. 3. run analysis with java mode, try to view row , failed. for the columns which ""veiw row"" failed are not for all, please refer to the pic.",5 TDQ-4705,"can not re-open the project which just contains files migrate from 4.2.3.","1. open a new project and open. 2. import files by ""import button"" from 4.2.3, select ""root directory"" in the import dialog. 3. import finished, try to reopen the project. 4. if try to do migration by logon window, can not open the project on first time. Result: can not reopen it successfully. I have two 423 project, one can do this reopen successfully, but the another can not. error log added under Details tab.",5 TDQ-5074,"jdbc connection used in job,export the jdbc connection as context,click finish,the update choose no,there are errors",NULL,13 TDQ-4706,"import lower version project on the logon window, the ""Parser"" Folder lost.","1. open studio. 2. on the logon window select the ""import existing project(s) as local"" 3. select a lower version project(lower than 5.0--no parser folder) 4. open the new import project,check the repository. the the ""Parser"" Folder lost under ""Rules"".",5 TDQ-4710,"view invalid row incorrect on pattern matching indicator","The query generated by the ""view invalid rows"" or ""view valid rows"" menus is not correct when it's from the pattern matching indicator in a column analysis. Indicator query: SELECT COUNT(CASE WHEN `lname` REGEXP BINARY '^[A-Z]*$' THEN 1 END), COUNT(*) FROM `tbi`.`customer` Query generated to view valid rows: SELECT `lname` FROM `tbi`.`customer` WHERE `lname` REGEXP '^[A-Z]*$' The ""binary"" keyword is missing. note: analyzed database is mysql ",8 TDQ-4711,"Pattern on Talend Exchange called ""Email Address (with list of top-level domains)"" does not work with mysql","Import this pattern and use it on tbi.customer.email 100% of email are invalid. The imported pattern contains \ \ \ \. It should be \ \. What is the reason? Is the pattern on Exchange incorrect or is it the import function that changes the regex?",5 TDQ-4712,"demo jobs dedupe_jobs don't work","In the DQ demo project, there is a problem with the stewardship console access. The demo jobs should run without any problem when executed in order c0, c1, c2, c3. Actually, I've got errors in c2 sometimes and in c3 always because of the stewardship console. Exception in component tStewardshipTaskInput_1 com.sun.xml.internal.ws.client.ClientTransportException: The server sent HTTP status code 403: Forbidden com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.checkStatusCode(HttpTransportPipe.java:196) com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:168) com.sun.xml.internal.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:83) com.sun.xml.internal.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:105) com.sun.xml.internal.ws.api.pipe.Fiber.__doRun(Fiber.java:587) com.sun.xml.internal.ws.api.pipe.Fiber._doRun(Fiber.java:546) com.sun.xml.internal.ws.api.pipe.Fiber.doRun(Fiber.java:531) com.sun.xml.internal.ws.api.pipe.Fiber.runSync(Fiber.java:428) com.sun.xml.internal.ws.client.Stub.process(Stub.java:211) com.sun.xml.internal.ws.client.sei.SEIStub.doProcess(SEIStub.java:124) com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:98) [statistics] disconnected com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78) com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107) $Proxy30.searchTasks(Unknown Source) tdqeedemojava.c3_get_cleansed_records_from_dsc_0_1.c3_get_cleansed_records_from_DSC.tStewardshipTaskInput_1Process(c3_get_cleansed_records_from_DSC.java:2061) tdqeedemojava.c3_get_cleansed_records_from_dsc_0_1.c3_get_cleansed_records_from_DSC.runJobInTOS(c3_get_cleansed_records_from_DSC.java:2975) tdqeedemojava.c3_get_cleansed_records_from_dsc_0_1.c3_get_cleansed_records_from_DSC.main(c3_get_cleansed_records_from_DSC.java:2832)",1 TDQ-4713,"for the javaudi can not define the ""Number of Result Shown"", so will show large data in report","1. create a javaUDI and set its ""Category"" to ""User Defined Frequency"" 2. create a column analysis which used the javaUDI 3. check the result in the ""analysis Result page"", if the data in database is larger, the javaUDI show 10 items. 4. create a report file about the analysis, generate. check the genereated report file, for the columns which applied the javaUDI shows many items, we'd better can control the number of columns in the report file for the javaUDI ",5 TDQ-4714,"update aggregatedDefinitions in some definition files to avoid proxy","1.open the definition files(Connection Overview/Catalog Overview/Schema Overview/).check the aggregatedDefinitions. .eg. tag in the Schema Overview '' is incorrect.it should be like ' ' 2.open the category definition files(Simple Statistics/Phone Number Statistics/IQR/Mean/Range/Summary Statistics/Text Statistics),you could see some tags like ''. if get the aggregatedDefinitions from this definition.the object of Blank Count indicator will be a proxy,because its name in file system is Blank_Count_0.1.definition. we need to update the name in tag '' at somewhere. we could use the IndicatorDefinition.getAggregatedDefinitions() to debug so that judge if it is a proxy.",13 TDQ-4720,"Use of custom patterns in tPatternCheck causes issues after re-opening job","When using custom patterns in tPatternCheck it seems that the component is still looking/expecting a 'Pattern type' to be selected from the drop down list of Regex patterns in the repository. Unchecking 'custom pattern' then re-checking 'custom pattern' appears to clear the issue somehow. In addition, when re-opening a job which uses a custom pattern, the job will fail to compile with the following error in the tPatternCheck component: ""Unknown value in the list / Value set not supported by the component"" Unchecking and re-checking the 'custom pattern' seems again to clear the issue.",5 TDQ-4722,"Improve pattern selector for all components using regex","In current components, the pattern selector is a hard coded combo list in the XML component definition. By the contrary, user should be able to choose patterns from DQ library.",13 TDQ-4724,"Data Profiler cannot handle nvarchar types","A prospect is trying to perform Data Profiler analysis on a SQLServer table that has nvarchar columns and is getting nulls returned for the pattern analysis. Following is the email from the prospect. -After reinstalling the tool I was able to select the checkbox in the Pattern Analysis, text analysis and others that wasn´t enabled, so the result of the pattern analysis still only null values; I looked for another possible reason and I found that my data was varchar type, and the query built by the tool or the driver has some problems to handle this data type, here is the example. This is the query generated SELECT * FROM ""SERVICIO_GUIAS"".""dbo"".""BD_Captura_Calidad_31052011"" WHERE (""CALLE"" IS NOT NULL ) AND ( LTRIM(RTRIM( CASE WHEN ""CALLE"" IS NULL THEN 'NULL TALEND' ELSE ""CALLE"" END )) <> '' ) AND DATALENGTH(""CALLE"") = (SELECT MIN(LEN(""CALLE"")) FROM ""SERVICIO_GUIAS"".""dbo"".""BD_Captura_Calidad_31052011"" WHERE (""CALLE"" IS NOT NULL ) AND ( LTRIM(RTRIM( CASE WHEN ""CALLE"" IS NULL THEN 'NULL TALEND' ELSE ""CALLE"" END )) <> '' )) If My String is ""ANGEL"" USING VARCHAR DATALENGTH(""CALLE"") returns ""5"" LEN(""CALLE"") returns ""5"" USING NVARCHAR DATALENGTH(""CALLE"") returns ""10"" LEN(""CALLE"") returns ""5"" This makes that query has no results The action taken was change NVARCHAR data type for VARCHAR ",8 TDQ-4729,"while install portall with oracle, the database which installed portal before will disable to import ""3_ORA_import_blob_generic.dmp""","install portal with an oracle database as portal datamart if this database was installed before it will disable to import the dump file -- ""3_ORA_import_blob_generic.dmp"" and it says need to import it manually",40 TDQ-4732,"can not get tables for oracle dbconnection ","1. create an oracle dbconnection in top 2. unfold the ""Tables"" node in the dbconnection, get errors. so the tables in the dbconnection can not show. in tdq also get errors when unfold the connection, but the tables can show.",8 TDQ-4733,"temp folder can not be deleted",NULL,3 TDQ-4734,"Create pattern from pattern test view, doesn't get item in repository","in pattern test view, define the regular expression, click on ""Create Pattern"" button type in the pattern name, ""Next"" - ""Finish"" the new created pattern editor will open but I can't get it in repository checked workspace, the new generated item is in the root folder of ""Patterns""",3 TDQ-4738,"""Create a new connection"" menu on a connection catalog or schema, the second time will get error","create a connection expand this connection you will get some catalogs or schema right click on it, and click the context menu -- ""Create a new connection"" the first time is OK, but the second time it will pop up a dialog to inform you if replace the old one if replace it, it's OK if cancel or press the key ""ESC"" on the keyboard it will throw an error: java.lang.IllegalArgumentException: Label tbi_tbi is already in use at org.talend.core.repository.model.ProxyRepositoryFactory.checkIfHaveDuplicateName(ProxyRepositoryFactory.java:309) at org.talend.core.repository.model.ProxyRepositoryFactory.checkFileNameAndPath(ProxyRepositoryFactory.java:252) at org.talend.core.repository.model.ProxyRepositoryFactory.create(ProxyRepositoryFactory.java:1117) at org.talend.core.repository.model.ProxyRepositoryFactory.create(ProxyRepositoryFactory.java:1096) at org.talend.datacleansing.core.ui.actions.ExportConnectionToTOSAction.run(ExportConnectionToTOSAction.java:105) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",8 TDQ-4739,"Unify all export wizard for null choosing,that will not finish!","1.check all export wizard as parser rule or patterns 2.if that is selected,it is not be finished. 3.set finished button to disable.",3 TDQ-4740,"respository with joblet , switch to talend profiler,then expand connection will show a mistaken catalog node.","Create one job about tmysqlinput->logrow,then refactor to joblet named mysql,run this job. Then switch to the ""Talend profiler"",you will see under the db connection ,display the catalog ,.see the jpg.",2 TDQ-4747,"Get error when used overview template to generate a report","Used the embedded overview template 'report_03' to generate a report, I get an error and there is no document generated! !STACK 0 net.sf.jasperreports.engine.JRException: Error executing SQL statement for : report_03 at net.sf.jasperreports.engine.query.JRJdbcQueryExecuter.createDatasource(JRJdbcQueryExecuter.java:141) at net.sf.jasperreports.engine.fill.JRFillDataset.createQueryDatasource(JRFillDataset.java:671) at net.sf.jasperreports.engine.fill.JRFillDataset.initDatasource(JRFillDataset.java:591) at net.sf.jasperreports.engine.fill.JRBaseFiller.setParameters(JRBaseFiller.java:1212) at net.sf.jasperreports.engine.fill.JRBaseFiller.fill(JRBaseFiller.java:842) at net.sf.jasperreports.engine.fill.JRBaseFiller.fill(JRBaseFiller.java:791) at net.sf.jasperreports.engine.fill.JRFiller.fillReport(JRFiller.java:63) at net.sf.jasperreports.engine.JasperFillManager.fillReport(JasperFillManager.java:402) at org.talend.dataquality.reporting.JasperReportBuilder.createSubReport(Unknown Source) at org.talend.dataquality.reporting.JasperReportBuilder.run(Unknown Source) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generateReport(Unknown Source) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generateDoc(Unknown Source) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(Unknown Source) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(Unknown Source) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown column 'TDQ_OVERVIEW_INDVALUE.RUN_TIME' in 'where clause' at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at com.mysql.jdbc.Util.handleNewInstance(Util.java:403) at com.mysql.jdbc.Util.getInstance(Util.java:378) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1031) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:957) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3378) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3310) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1853) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1976) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2503) at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1737) at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1888) at net.sf.jasperreports.engine.query.JRJdbcQueryExecuter.createDatasource(JRJdbcQueryExecuter.java:135) ... 14 more",8 TDQ-4748,"""export items"" on tool bar, in some way will throw a NPE","in export wizard, there are two radio buttons ""Select root directory:"" ""Select archive file:"" the ""root directory"" button is the default check click on ""Browse"" button to choose a path to export then check radio button -- ""Select archive file:"" while check back to ""root directory"" click finish button to export items, but failed and throw an error: java.lang.NullPointerException at org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter.write(FileSystemExportWriter.java:165) at org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter.write(FileSystemExportWriter.java:138) at org.talend.dataprofiler.core.ui.imex.ExportWizard$1.run(ExportWizard.java:76) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) if give the ""archive file"" path do this operation -- check ""directory"" radio button then check back to ""archive file"" will get this java.lang.NullPointerException at org.talend.dataprofiler.core.ui.imex.model.ZipFileExportWriter.write(ZipFileExportWriter.java:67) at org.talend.dataprofiler.core.ui.imex.model.FileSystemExportWriter.write(FileSystemExportWriter.java:138) at org.talend.dataprofiler.core.ui.imex.ExportWizard$1.run(ExportWizard.java:76) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) ",5 TDQ-4752,"should we add the dependency for the analysis and systems indicators","1. create a column analysis, add simple indicators. 2. change some information for the simple indicators--name, database definition (especially add a new one). 3. try to export the analysis should we select the systems indicators automatically-- the system indicators has been added a database definition. if import the export ones to a new project, can not run the analysis successfully. for 5.0 one(for 5.1 is ok--the systems' name in analysis will not change): the if we change system indicators' name , then import the analysis which used the changed indicators to a new project, because of the indicators' name is the changed one in the analysis, so it can not find the corresponding one.",8 TDQ-4753,"remove a schema of connection in DI perspective, the dependency doesn't be deleted in DQ which is depends on this schema","create a connection in DQ perspective, it will load the all table schema create an analysis with this connection, select some columns or table to analyze turn to DI perspective, remove the table schema which is used by DQ back to DQ perspective, the columns or table are removed from analysis this is correct but checked in the file model, the dependency is still there",5 TDQ-4754,"run analysis get error with file connection","1. with the attachment file to create a file connection, and with the default settings. 2. use column ""Column0"" to create a analysis with row count indicator. 3. run , and get the followings java.lang.NumberFormatException: For input string: """" at java.lang.NumberFormatException.forInputString(Unknown Source) at java.lang.Integer.parseInt(Unknown Source) at java.lang.Integer.parseInt(Unknown Source) at org.talend.dq.indicators.DelimitedFileIndicatorEvaluator.executeSqlQuery(DelimitedFileIndicatorEvaluator.java:121) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:114) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:168) at org.talend.dq.analysis.DelimitedFileAnalysisExecutor.runAnalysis(DelimitedFileAnalysisExecutor.java:67) at org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:109) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:154) at org.talend.dataprofiler.core.ui.action.actions.AnalysisExecutorThread.run(AnalysisExecutorThread.java:86) at java.lang.Thread.run(Unknown Source) ",3 TDQ-4755,"Unnecessary page in the new time analysis wizard","When we create a time analysis by selecting a column in the dq repository view, there is an unnecessary page. See attached capture.",3 TDQ-4757,"command line initialize local workspace will create a ""TOP_DEFAULT_PRJ"" project","1. while I open command line window, it will throw an error java.io.IOException: Stream closed at java.io.BufferedInputStream.getInIfOpen(Unknown Source) at java.io.BufferedInputStream.read1(Unknown Source) at java.io.BufferedInputStream.read(Unknown Source) at java.io.FilterInputStream.read(Unknown Source) at jline.WindowsTerminal.loadLibrary(WindowsTerminal.java:297) at jline.WindowsTerminal.initializeTerminal(WindowsTerminal.java:240) at jline.Terminal.setupTerminal(Terminal.java:75) at jline.Terminal.getTerminal(Terminal.java:26) at jline.ConsoleReader.(ConsoleReader.java:191) at jline.ConsoleReader.(ConsoleReader.java:186) at jline.ConsoleReader.(ConsoleReader.java:175) at org.talend.commandline.client.util.ConsoleUtil.set(ConsoleUtil.java:33) at org.talend.commandline.CommandLineApplication.start(CommandLineApplication.java:83) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) 2. then I initialized local workspace, and it will create a ""TOP_DEFAULT_PRJ"" project (the application created it, I didn't) ERROR: Plug-in ""org.talend.datacleansing.core"" was unable to instantiate class ""org.talend.datacleansing.core.service.TD QItemService"". org.eclipse.core.runtime.CoreException: Plug-in ""org.talend.datacleansing.core"" was unable to instantiate class ""org.tal end.datacleansing.core.service.TDQItemService"". at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.throwException(RegistryStrategyOSGI.java:194) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:186) at org.eclipse.core.internal.registry.ExtensionRegistry.createExecutableExtension(ExtensionRegistry.java:904) at org.eclipse.core.internal.registry.ConfigurationElement.createExecutableExtension(ConfigurationElement.java:2 43) at org.eclipse.core.internal.registry.ConfigurationElementHandle.createExecutableExtension(ConfigurationElementH andle.java:55) at org.talend.core.GlobalServiceRegister.findService(GlobalServiceRegister.java:125) at org.talend.core.GlobalServiceRegister.isServiceRegistered(GlobalServiceRegister.java:81) at org.talend.commandline.util.ItemsHelper.(ItemsHelper.java:104) at org.talend.commandline.util.JobHandler.(JobHandler.java:81) at org.talend.commandline.command.CommandProcessor.(CommandProcessor.java:92) at org.talend.commandline.command.CommandProcessorSwitch.(CommandProcessorSwitch.java:44) at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:52) at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:33) at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) at java.lang.Thread.run(Unknown Source) Caused by: java.lang.NullPointerException at org.talend.datacleansing.core.service.TDQItemService.(TDQItemService.java:90) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance0(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:184) org.eclipse.core.runtime.CoreException: Plug-in ""org.talend.datacleansing.core"" was unable to instantiate class ""org.tal end.datacleansing.core.service.TDQItemService"". at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.throwException(RegistryStrategyOSGI.java:194) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:186) at org.eclipse.core.internal.registry.ExtensionRegistry.createExecutableExtension(ExtensionRegistry.java:904) at org.eclipse.core.internal.registry.ConfigurationElement.createExecutableExtension(ConfigurationElement.java:2 43) at org.eclipse.core.internal.registry.ConfigurationElementHandle.createExecutableExtension(ConfigurationElementH andle.java:55) at org.talend.core.GlobalServiceRegister.findService(GlobalServiceRegister.java:125) at org.talend.core.GlobalServiceRegister.isServiceRegistered(GlobalServiceRegister.java:81) at org.talend.commandline.util.ItemsHelper.(ItemsHelper.java:104) at org.talend.commandline.util.JobHandler.(JobHandler.java:81) at org.talend.commandline.command.CommandProcessor.(CommandProcessor.java:92) at org.talend.commandline.command.CommandProcessorSwitch.(CommandProcessorSwitch.java:44) at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:52) at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:33) at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) at java.lang.Thread.run(Unknown Source) Caused by: java.lang.NullPointerException at org.talend.datacleansing.core.service.TDQItemService.(TDQItemService.java:90) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance0(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:184) java.lang.NullPointerException at org.talend.datacleansing.core.service.TDQItemService.(TDQItemService.java:90) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance0(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.eclipse.core.internal.registry.osgi.RegistryStrategyOSGI.createExecutableExtension(RegistryStrategyOSGI.j ava:184) at org.eclipse.core.internal.registry.ExtensionRegistry.createExecutableExtension(ExtensionRegistry.java:904) at org.eclipse.core.internal.registry.ConfigurationElement.createExecutableExtension(ConfigurationElement.java:2 43) at org.eclipse.core.internal.registry.ConfigurationElementHandle.createExecutableExtension(ConfigurationElementH andle.java:55) at org.talend.core.GlobalServiceRegister.findService(GlobalServiceRegister.java:125) at org.talend.core.GlobalServiceRegister.isServiceRegistered(GlobalServiceRegister.java:81) at org.talend.commandline.util.ItemsHelper.(ItemsHelper.java:104) at org.talend.commandline.util.JobHandler.(JobHandler.java:81) at org.talend.commandline.command.CommandProcessor.(CommandProcessor.java:92) at org.talend.commandline.command.CommandProcessorSwitch.(CommandProcessorSwitch.java:44) at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:52) at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:33) at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) at java.lang.Thread.run(Unknown Source)",5 TDQ-4760,"Test existing mapping methods","3 approaches: - datamaster (Protégé plugin, license MPL) - Kaon2 - RDBToOnto Aim of this work item: A. Test datamaster on our tbi database. What's the result? B. Can the other methods be tested too? Answer the following questions: 1. Are these methods only useful to build ontologies from data? 2. can we reuse one of these approaches to map data with ontologies? 3. which one is best (pros and cons)? ",3 TDQ-4769,"Enable the use of hadoop 1.0 in tMatchGroupHadoop","Enable Hadoop 1.0 compatibility in the tMatchGRoupHadoop component.",8 TDQ-4770,"Use the same layout for analysis summary in the overview analysis editor as in the column analysis editor","See the current layout of the ""analysis summary "" section (see screen capture in TDQ-4377 ). Change the layout of this section so that it's similar to the ""Analysis summary"" section of the column analysis. See attached picture",1 TDQ-4771,"try to import a 401 file by logon window, the project will no show on the project list, logon other project, there is some error.","try to do migration for 401 project by logon window. but the project you have imported will show on the project list, as the bug summary described. should make sure both logon window and import button work well. ",13 TDQ-4772,"after the ""create Rule"" function in the parser rule test editor, the original parser rule will be null.","1. create a parser rule name 'aa' 2. add corresponding items. 3. click the ""Rule test"" icon, in the pop up editor, click ""create Rule"" icon, a new parser rule will be created, check -- reopen the original parser rule--'aa', the items of 'aa' all lose.",5 TDQ-4773,"After delete the report document, the node didn't refresh","when I delete the report the document, the document still exists in the repository, after refresh, it disappared, it also not exists in the Recycle Bin!",6 TDQ-4774,"Migrated report item from an ealier version(4.1.x--doesnot contain DB config in editor), the default DB config in editor is HSQL","migrate project from released 4.1.4 in 4.1.4, the report file doesn't contain DB config in it but our current build does if in 4.1.4 user config a Mysql or oracle as report DB after migrate to current build, report DB config in editor will be default with HSQL what if the user want mysql or oracle that which user deployed before ?",2 TDQ-4775,"Create org.talend.repository.antrlid.ui.nl","Create the nl fragment related to org.talend.repository.antrlid.ui and add it to the appropriate feature. ",2 TDQ-4781,"Do a nominal column correlation analyze with an empty column, it will throw error","as the summary said: if analyze a column which has no data, it will throw this error java.lang.NullPointerException at edu.uci.ics.jung.visualization.ISOMLayout.getISOMVertexData(ISOMLayout.java:222) at edu.uci.ics.jung.visualization.ISOMLayout.adjustVertex(ISOMLayout.java:183) at edu.uci.ics.jung.visualization.ISOMLayout.adjust(ISOMLayout.java:167) at edu.uci.ics.jung.visualization.ISOMLayout.advancePositions(ISOMLayout.java:128) at edu.uci.ics.jung.visualization.LayoutDecorator.advancePositions(LayoutDecorator.java:64) at edu.uci.ics.jung.visualization.DefaultVisualizationModel.prerelax(DefaultVisualizationModel.java:209) at edu.uci.ics.jung.visualization.DefaultVisualizationModel.setGraphLayout(DefaultVisualizationModel.java:137) at edu.uci.ics.jung.visualization.DefaultVisualizationModel.(DefaultVisualizationModel.java:82) at edu.uci.ics.jung.visualization.DefaultVisualizationModel.(DefaultVisualizationModel.java:66) at org.talend.dataprofiler.core.ui.chart.jung.JungGraphGenerator.generate(JungGraphGenerator.java:122) at org.talend.dataprofiler.core.ui.chart.jung.JungGraphGenerator.generate(JungGraphGenerator.java:109) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnCorrelationNominalAndIntervalMasterPage.createPreviewCharts(ColumnCorrelationNominalAndIntervalMasterPage.java:419) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnCorrelationNominalAndIntervalMasterPage.refresh(ColumnCorrelationNominalAndIntervalMasterPage.java:522) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.fireRuningItemChanged(AbstractAnalysisMetadataPage.java:189) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:286) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",3 TDQ-5073,"tmatchgroup right-click, choose configuration wizard,there is an error",NULL,5 TDQ-4783,"the detail view can not show the pk number correctly for adding a new pk column","1. create a dbconnection. 2. unfold a table which contains a pk, check the detail view it is correctly-such as the number is 2. 3. in the database, added a new column, and also set the column as pk. 4. reload the column list, recheck the pk number it change to 5, in fact it is has only 3 columns, refer to the pic.",5 TDQ-4784,"when saving an invalid column set analysis, the inform dailgo won't show(columns can not come from more than one table/view ).","1. create a column set analysis, select columns from more than one table/view. 2. try to save the analysis, only a refresh progress bar show and then disappear. 3. try to run the analysis, there will be a dialog pop-up to inform column can not comes from more than one table or view. in fact , when save the analysis, the inform dialog also should pop-up",3 TDQ-4791,"Improve reports look&feel","The current bar charts in the generated reports are not sexy enough. Try several options in order to get a better look&feel Then apply on all reports. ",8 TDQ-4794,"Use the look&feel in all reports in the studio",NULL,20 TDQ-4795,"In ""t(Oracle|MySQL)(Valid|Invalid)Rows"" components, output contents do not correspond to output schema","The generated SQL query begins with ""SELECT *"" instead of ""SELECT "", which makes it impossible to retrieve correct content according to output schema. (see code of generated job) If the order of columns does not correspond to that in the database, the output columns will be shifted.",5 TDQ-4804,"Use the look&feel in all reports in the DQ portal for Oracle",NULL,5 TDQ-4820,"Create a TUJ to check that the store on disk option of the tRecordMatching component gives the same results as the in memory option","Create a TUJ that validates TDQ-1513",2 TDQ-4822,"Propagate Table Alias in Schema when ""guess schema"" is activated","in the tOracleValidRows and the other similar components, the ""guess schema"" button generates the schema according to the DQ rule query (select DQ rule and click on ""guess query"" before). When the DQ rule has a join clause, aliases are used for table names. In this case, each database column should be qualified with the table alias. For instance, PRENOM is a column name, it should be changed to A.PRENOM where A is the table alias (it can be something else according to the DQ rule item). ",13 TDQ-4823,"Use DQ rules in all tXXX(In)validRows components","Implement the same feature as TDQ-4805 for the other components. ",8 TDQ-4828,"Add where clause for DQ rule in tOracle(In)ValidRows","When the regex validation is chosen, a where clause can be applied in order to filter the analyzed rows. When the dq rule validation is chosen, add the possibility to write a where clause in order to filter the analyzed rows. This where clause will be concatenated with the where clause of the DQ rule, but the negation of the DQ rule (invalid rows) only applies on the where clause of the DQ rule, not on the where clause that filters the data. ",2 TDQ-4829,"Generate a job to retrieve the rows that are valid or invalid against a DQ rule","In DQ rule analysis, allow the user to right-click on the indicator in the result page. This opens a menu with - retrieve invalid rows - retrieve valid rows Each menu will generate the job using a tXXX(In)validRow component and a file output (same as for the job generated from a pattern indicator). The component will be configured appropriately with the DQ rule and the data filter information. ",8 TDQ-4830,"SourceFile could not be duplicated.","java.lang.NullPointerException org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.getSelctionNode(DuplicateAction.java:229) org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.selectAndReveal(DuplicateAction.java:196) org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.run(DuplicateAction.java:128) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:77) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",8 TDQ-4831,"SourceFile and Jrxml could not be dropped for moving.","1.create a new folder in sourcefile folder or jrxml folder 2.select a file node in sourcefile folder or jrxml folder 3.drop it to your created folder. 4.that could not be drop in the folder and no error shows.",13 TDQ-4832,"Backport TDQ-4654 to dqPortal (Threshold violation don't appear for phone number indicators)",NULL,5 TDQ-4836,"the jrxml folder lost in the import and export dialog.","the jrxml folder lost in the import and export dialog. so after the TDQ-4703 function worked, can not export/import the report which use the jrxml file correctly.",8 TDQ-4845,"the node of ""Recycle bin"" lost after delete a generated document of report","the node of ""Recycle bin"" lost after delete a generated document of report",2 TDQ-4848,"Configuration Wizard of tMatchGroup is not displaying proper value","Configuration Wizard of tMatchGroup is not displaying proper value. It seems to depend on the type of component that are used before on the flow. (the job run without problems) ",8 TDQ-4849,"Failed to generate code with tRecordMatching if ""store on disk"" checked && blocking key column not in output schema","Console output: Execution failed : Failed to generate code. [org.eclipse.emf.codegen.jet.JETException: InvocationTargetException in tRecordMatching_TDQ4820_memory_vs_disk job]",3 TDQ-4853,"Getting NullPointerException when switching DB connections for Functional Dependency Analysis","I created a Functional Dependency Analysis using db connection ""A"". I saved it and ran it successfully. I changed the db connection to ""B"" which points to the same DB as connection ""A"". I clicked on the ""Determinant Columns:..."" and got no response. I tried to save it and it gave me a null pointer exception. I closed the analysis and tried to reopen it and got a null pointer exception. I found this in TOSDQ and Talend Platform Big Data Edition",5 TDQ-4854,"Report generating failed after the datamart is upgraded.","After migrating datamart from lower version by ""Check"" the connectivity database settings section of report page , I cannot generate the report. ",8 TDQ-4855,"the reload function seems have some problem with oracle.","1. create an oracle dbconnection, with user ""aa"", set the schema ""bb"". 2. check the dbconnection in repository, correct, it is ""bb"" schema. 3. open the dbconnection's editor, leave the schema parameter null. so all the schemas in the dbase should show. recheck the repository, only ""aa"" schema show , reopen the ""Database Connection"" wizard by clicking ""edit"". the schema parameter was set ""aa' -- which should be not set. when do the same operations for mysql, the function works well. but a redundant dialog pop-up. should not be. test on trunk 79203-5.1.0 and r79146-V5.0.3NB it works well",5 TDQ-4856,"Some aggregate href reffering to definition labels are not correct in definition file , update them as same as ""label"" in definition file.","The refactoring of TDQ-4714 caused some hrefs of aggregate tag not same to the ""label"" attribute of definition, update them.",2 TDQ-4860,"Create a TUJ for TDQ-4496","Create a TUJ based on the job attached in TDQ-4496",1 TDQ-4867,"Upgrade basic reports of the studio",NULL,20 TDQ-4870,"Run ""Import Build-in JRXML"", for columnset report, after doing export and then import, run the columnset report get error",NULL,13 TDQ-4871,"backport tRecordMatching TUJs to branch 5.0",NULL,1 TDQ-4872,"The upper box in the Rule tester view is labeled ""rule"" where it should be labeled something like ""string, data or text..."" ","In the Rule tester view in the profiling perspective of the Studio, the first box where to write the string of data you want to test against the user-defined rules and the system pre-defined rules is labeled ""rule"". See attached figure This is a bit misleading. I think this box should be labeled something like ""string or data""",2 TDQ-4884,"SQL Server 2008 via NTLM can't retrieve new schema","I created a new schema called ""ABC"" in SQL SERVER 2008 and create a new table called ""DemoABC"". But when i create metadata in TOS for DQ by DB type ""Microsoft Sql Server"" via NTLM, I can't find Schema ""ABC"" and Table ""DemoABC"". But if I create metadata in TOS for DQ by DB type ""Microsoft SQL SERVER 2005/2008"", I can get them. A topic in Talend Community will explain this issue in detail. http://www.talendforge.org/forum/viewtopic.php?pid=79844#p79844 ",13 TDQ-5722,"DB connection_Edit HyperSql Database connection, remove the default value ""ifexists=true"" from addional parameter can not save the connection.","Edit HyperSql Database connection, remove the default value ""ifexists=true"" from addional parameter can not save the connection. Base on case:Test Case ID TDIQA-5037",8 TDQ-4894,"Delete the built-in jrxml template into recycle, import built-in again seems nothing happened","delete the built-in jrxml templates into recycle bin keep them in recycle import built-in templates second time no information that tell me like ""there are some in recycle"" or some what .... it just looks like import built-in templates ""failed"" ",5 TDQ-4898,"No need to check connection of analysis when the analysis does not need to be refreshed","Create a column analysis on an Oracle connection Run the analysis. Stop the DBMS server Create a report with this analysis uncheck the checkbox called ""Refresh"" in order to avoid the computation of the analysis. Save the report run the report It shows an error message as in the attached picture. 1. The error message is incomplete: the name of the analysis is not displayed and the user cannot understand clearly the message. 2. There should be no connection check (connection of the analysis) when we don't need to execute the analysis. All the information are stored in the analysis. ",8 TDQ-4906,"Incorrect message when datamart database is not available","Create a report with a configuration of the datamart. Put a non existing IP for the database of the datamart in the report editor (see attached picture). Run the report. The studio will be frozen during several minutes, until the connection times out. Then there is a message to say that the database version is not correct. 1. it would be nice if we could avoid to freeze the studio during the database connection, and also lower the time out limit. 2. the message is not appropriate, change it according to the real error",3 TDQ-4910,"New Analysis Wizard help is not displayed correctly","The help displayed in the New Analysis wizard is not displayed correctly. See screenshot that shows truncation. ",5 TDQ-4913,"Create a Distinct count indicator which computes the SQL distinct count","Share this indicator on Talend Exchange. the expression is: SELECT COUNT(DISTINCT <%=__COLUMN_NAMES__%>) FROM <%=__TABLE_NAME__%> <%=__WHERE_CLAUSE__%>",5 TDQ-4914,"Enable use of reference projects in DQ Repository ","When using the DQ Profiling Perspective on a TAC project, the metadata in a reference project is not shared. This is also true of Analyses defined in the reference project are not avilable either. When we add a reference project to a DQ project, we should be able to see all items (connection, libraries, analysis...) from the reference project in the DQ repository view. Do we need to display the analysis and reports from the reference project? not sure.",13 TDQ-4916,"Profiler does not allow the creation of new Analyses","Running a column set profiling analysis against 12 million records, the system crashes with a java heap error. When I restart the studio, the analysis is renamed ""null 0.1"". I deleted and it assumed it correct name in the recycle bin. I deleted it from the recycle bin. From then on, I cannot create new analyses. I uninstalled and reinstalled, carried out the same operation to get the same result. ",5 TDQ-4922,"Failed to execute tLaunchDQReport componet to generate a report file","while I tried to generate a report file with tLaunchDQReport component I got this error in .log file org.eclipse.core.runtime.AssertionFailedException: null argument:The dialog should be created in UI thread org.eclipse.core.runtime.Assert.isNotNull(Assert.java:85) org.eclipse.jface.dialogs.IconAndMessageDialog.getSWTImage(IconAndMessageDialog.java:282) org.eclipse.jface.dialogs.IconAndMessageDialog.getErrorImage(IconAndMessageDialog.java:233) org.eclipse.jface.dialogs.MessageDialog.(MessageDialog.java:179) org.eclipse.jface.dialogs.MessageDialog.open(MessageDialog.java:360) org.eclipse.jface.dialogs.MessageDialog.openError(MessageDialog.java:431) org.talend.datacleansing.core.ui.ReportRunnerApplication.start(ReportRunnerApplication.java:78) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",8 TDQ-4926,"""Empty recycle bin"" can't do ""force to delete"" and select all the items in the ""Recycle Bin"" then right click ""delete"" ,can't delete the selected items","1.""Empty recycle bin"" can't do ""force to delete"" 2.Select all the items in the ""Recycle Bin"" then right click ""delete"" ,can't delete all the selected items ",23 TDQ-4929,"the genereated job can not run successfully by ""remove duplicate"" for columlns contains ""()""","1. create a column analysis which analyze a colum contains ""()"", such as ""name(test)"". 2. select the Simple Statistics indicators, run. 3. on result page, select ""unique count"" ,""distinct count"" or ""duplicate count"" can get a menu ""remove duplicates"". 4. the generated job can not run correctlly. no errors, just an inform pic notes : for the column which doesn't contains ""()"", can run well",11 TDQ-4931,"Avoid the use of Sun's classes","Replace sun.security.action.GetPropertyAction in DelimitedFileReader",8 TDQ-4935,"Export report script does not handle OS X","Mac OS X is now an officially supported platform, so the ""export report script"" command should also generate a batch script for OS X. In addition to RunReport.bat and RunReport.sh, add a RunReport.command file that calls the Studio executable like this: {noformat} /Talend-Studio-macosx-cocoa.app/Contents/MacOS/Talend-Studio-macosx-cocoa -nosplash -application org.talend.datacleansing.core.ui.ReportRunner RunReport.properties -consoleLog -data {noformat} .command files are recognized by the Mac Finder as shell scripts chmod +x is still necessary for the script to run.",5 TDQ-4936,"for the ""mean"" indicator under ""Summary statistics"" can not get same result sql and java engine for column no values.","1. create a column analysis, select an integer columns 2. select the summary statistics 3. run with sql and java engine can not get same result, because some rows is Null. we do ""mean"", sql doesn't count the Null ones, but java engine include it.",13 TDQ-4939,"when do migration from 401, some dbconnections name are same","1. create a dbconnection in di named ""a"" in 401 build . 2. turn to dq perspective, import the ""a"" dbconnection to dq. 3. do migration to 5.1(both import and logon window). 4. check the dbconnection in repository, there is two ""a"". check in navigator ,it is different ",5 TDQ-4942,"when try to change an analysis to an exist one, the inform dialog will pop up twice","1. create two analysis, named ""a"" and ""b' 2.try to change the analysis name ""b"" to ""a', the inform dialog will pop-up twice(""The item already exist,check if it's in Recycle Bin or another folder""). in my opinion we should only pop-up once.",2 TDQ-4943,"The error about """"dqrule"" miss dependency:Row Count"" when import DQ Rules dependency ","When import DQ Rules dependency ,the error about """"dqrule"" miss dependency:Row Count"" appeared.",13 TDQ-4944,"Connection error with DQ Portal and Mozilla Explorer","I am using Mozilla explorer: During the execution of connection testing of data sources in the dq portal I get the error message ""error during connection test"" When I use Internet explorer this message does not show up ",8 TDQ-4945,"try to create a column analysis by right click the view in the table analysis.","1. create a table about a view. 2. in the table anslysis, right click the view-> column analysis. 3. the wizard, pop up to create a new analysis , after you set the name of the new analysis, the ""Next"" becomes available, click it, the select columns dialog pop-up, in fact, the ""Next"" should be un-available, the new created columns comes from the view. now, the ""Next "" is available, and the new created analysis contains no columns, there is an error pop-up. errors in Details->Additional Information .",8 TDQ-4948,"try to delete an item by clicking the ""Delete"" on keyboard doesn't work","focus on an dq element on repository, press ""Delete"" on keyboard, no action. case:TDQQA-1329.",5 TDQ-4949,"the ""Enter"" on NUMERIC KEYPAD can not open the item's editor when focus is on an dq item.","focus on a dq item, press ""Enter"" on NUMERIC KEYPAD, can not open the editor, but the other ""Enter"" on keyboard can open. case: TDQQA-5273",5 TDQ-4950,"Missmatches with tStandardizeRow due to inconsistency between Lucene analyzer and ANTLR parser","Example: For the word , during indexing, StandardAnalyzer of Lucene consider it as one word to save in the index. However, during the search, ANTLR cut it into 2 tokens ""didn"" and ""t"", none of them can be found in the index. See also testProcessIndexForMultiWord() in IndexStandardizerTest, the word can not be found. One solution will be modifying the parser rule, so that it doesn't cut the word by apostrophe.",13 TDQ-4951,"Add an option in the ""Profiling"" preference page to not switch automatically between perspective","Currently, the studio switches from the DI perspective automatically to the DP perspective when a DP editor gets the focus. There used to be a pop-up to ask the user if he wants to switch or not. This pop-up does not exist anymore? Also, we must add an option in the preference page: a check box: ""automatically switch between perspective"" in the ""Profiling"" page. When checked the perspectives will switch automatically When unchecked, they won't. The default value is ""checked"" If we can restore the initial pop-up that asks the user what he wants, then this pop-up stores the user preference in the preference page. ",8 TDQ-4955,"Junit tests for 5.1M2 tasks","Complement the missing JUnit test for all 5.1M2 tasks.",40 TDQ-4956,"import the exported file to a project which has noe file have errors"," (1). open a new project, create a column analysis, select system indicators , analysis can run well. (2). change some information about the system indicators which be used by the analysis: one change name, one change description/purpose, one change definition. (3). export the analysis, have to select the system indicators. export as a zip file. (4)-1. put the zip file is in a path which contains a Chinese word, open another new project, try to import the analysis you just exported result: get warnings, and the systems indicators which name changed will also be imported, and the original still there.warnings and system indicators still be there",13 TDQ-4957,"import the export file to 5.1 project ","(1). open a new project, create a column analysis, select system indicators , analysis can run well. (2). change some information about the system indicators which be used by the analysis: one change name, one change description/purpose, one change definition. (3). export the analysis, have to select the system indicators. export as a zip file. (4)-1. open a new project, create a dbconnection named ""aa"", import the exported file in step 3. have found that the ""aa"" have been deleted, can refer to the log, we should not delete ""aa"" (4)-2 open a new project, create a dbconnection named ""aa"", create a column analysis named ""analysisaa"". import the exported file in step 3, errors show. recheck the reporsitory, the ""analysisaa"" disappear, dbconnection ""aa"" is ok. only the analysis in zip file imported, but no columns, why analysis in zip file can import-- the used indicators can not imported, why the original analysis in the project be deleted. if an item in repository is dependend by oter items, even if we checked ""overwrite"" the item can not be overwriten right? so the new one can not be imported. in step (4)-1 and (4)-2, in the import dialog, there is inform abount the ""aa"" dbconnection can not be overwrite(overwrite checked), in fact this dbconnection can be selected if overwrite check box is not checked. but now, it is not. in (4)-2 I have not test about the project contains report, but we also should make it well.",23 TDQ-4958,"in the sql editor click ""save as"" pop-up error, can not save it","1. in the repository right click a table-> preview Table , or you can right click on columns->Preview. 2. in the opened sql editor, select ""Save Editor as"". Result, no save dialog pop-up, but errors(attached on details tab) this only reproduce on tdq, not on top",8 TDQ-4959,"check the usage of method CorePlugin.refreshDQView()","call the method CorePlugin.refreshDQView() will refresh and redraw the DQRepositoryView, this will cost a long time sometimes, so we need to check the usage of it and replace it with the method CorePlugin.refreshDQView(Object) if possible, refresh single node instead of refresh the whole tree will get better performance",20 TDQ-4960,"the number behind the anlaysis and report folder can not refresh correctly.","create sud folder under ""Analysis"" named 'foldera', create sub folder under 'Report' try to test the number behind the folder can change correctly when the analysis/report created, duplicated, delete,restore Now find issue: (1) analysis on 425, when create analysis by wizard, in sub folder the root folder number won't refresh automatically. (2) 5.1.0 and 5.0.3 when delete an analysis to Recycle bin, the root folder number won't refresh automatically. (3) 5.1.0 and 5.0.3 report sub folder create, and delete report in sub folder, the root folder number won't refresh automatically. make sure all three version work well for the refresh both analysis and reprot.",8 TDQ-4962,"Support for HortonWorks Data Platform (HDP) in tMathGroupHadoop","See this link. http://talendforge.org/trac/talend/changeset/79910/tis_shared/trunk/org.talend.designer.components.tishadoopprovider/components/tHDFSDelete/tHDFSDelete_java.xml there should be only one line to add to the component. ",1 TDQ-4967,"for the ETL job for oracle valid rows also get invalid result.","issue 1 1. create an oracle analysis, add pattern on a column. 2. run the analysis, turn to ""Result Page"", right click on the pattern ->""Generate Job"". 3. on the pop-up dialog, select ""Generate an ETL job to handle valid rows"" the generate job can run successfully, check the then result: the output file are all invalid ones--it should be valid. for the ""Generate an ETL job to handle invalid rows"" and ""Generate an ETL job to handle rows"" works well up to now. issue 2: for mysql the ""Generate an ETL job to handle Invalid rows"", jogs can not run successfully. get errors:( 'gg@qw cc.om' is a value in mysql database. the pattern is ""Email Address"" for a varchar column) Exception in component tMySQLInvalidRows_1 java.sql.SQLException: Invalid value for getInt() - 'gg@qw cc.om' com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1075) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:929) com.mysql.jdbc.ResultSetImpl.getInt(ResultSetImpl.java:2725) test2.patterninvalidrows_1332152109312_0_1.PatternInvalidRows_1332152109312.tMySQLInvalidRows_1Process(PatternInvalidRows_1332152109312.java:626) [statistics] disconnected test2.patterninvalidrows_1332152109312_0_1.PatternInvalidRows_1332152109312.runJobInTOS(PatternInvalidRows_1332152109312.java:1104) test2.patterninvalidrows_1332152109312_0_1.PatternInvalidRows_1332152109312.main(PatternInvalidRows_1332152109312.java:972) ",13 TDQ-4968,"handle column names correctly for postgresql, mysql and oracle","pay attention to alias which should not be quoted",2 TDQ-4973,"after import patterns, the sub folder of Patterns have some problems","after import patterns, the sub folder of Patterns have some problems",13 TDQ-4974,"When Get Patterns ETL job ,the job can't run and the job run button can't be used","1.Right click on the Patterns/Regex folder in Repository. 2.Choose Generate Jobs menu. 3.Choose Get patterns menu. After to the Integration page ,can't run the job and the button ""Run job"" can't be used you can refer to the ""errorRunJob.png""",5 TDQ-4977,"DB connection and File connection have the same label, analysis got confused ..","create two connections DB connection -- A, and File connection -- A then create a column analysis select columns from DB connection to analyze save this model click on link ""select columns to analyze"" to change the analyzed columns the wizard will show me the file connection schema it should be DB connection's ..",11 TDQ-4978,"Create version 5.1.0M1 in Babili and populate it",NULL,2 TDQ-4979,"Create version 5.1.0M2 in Babili and populate it",NULL,2 TDQ-4980,"Create version 5.1.0RC1 in Babili and populate it",NULL,2 TDQ-4981,"Export babili translations into trunk of SVN",NULL,2 TDQ-4982,"Export babili translations into trunk of SVN",NULL,2 TDQ-4983,"Export babili translations into trunk of SVN",NULL,2 TDQ-4984,"Evolution reports does not work with customized indicators","At a POC at INRIA we created some customized indicators based on SQL queries. While creating reports ""evolutive"" on these indicators we had no evolutive data at the end. Only last value.",13 TDQ-4986,"All the failed tests on the test platform","Here's the list of failed JUnits actually on trunk: （from http://192.168.0.4:8080/job/18-Studio_JUnit_trunk/67/testReport/?） from the above link you can see the reason for error for DQ: org.talend.dataquality.standardization.main.test.BooleanQueryTest.testAnd junit.framework.TestSuite.org.talend.dataquality.standardization.query.test.FirstNameStandardizeTest org.talend.dataquality.matching.date.pattern.DatePatternRetrieverTest.testInitModel2Regex org.talend.dataquality.standardization.main.test.HandLuceneImplTest.testCreateIndex org.talend.dataquality.standardization.main.test.HandLuceneImplTest.testGetSearchResultStringStringMapOfStringStringBoolean the following error seems can be fixed by set the path string like ""data/TalendGivenNames_index"", can try to do Error Details directory '/home/build-admin/Products/V5.1.0NB_r80181/swt/V5.1.0NB/swt_510/SWT-r80181-V5.1.0NB/data/TalendGivenNames_index' does not exist for DI: test.common.ErrorMessageTestCase.testFailingToLoadTestCase org.talend.metalanguage.jobscript.test.Emf2JobscriptTest.testGenerate org.talend.metalanguage.jobscript.test.Jobscript2EmfTest.testGenerate org.talend.commons.utils.time.TimeMeasureTest.test org.talend.commons.utils.tracer.StatisticsTracerTest.testStatisticTracerAndTraceToFile ",3 TDQ-4989,"Add an option to escape special characters and key words for the queries in SynonymIndexSearcher","lucene query parser accepts a set of complex syntax such as * for wildcard match. if this kind of characters exist in the original string to search, the result will be influenced. here is a list of special characters from http://lucene.apache.org/core/old_versioned_docs/versions/3_0_1/queryparsersyntax.html + - && || ! ( ) { } [ ] ^ "" ~ * ? : \ this problem is mainly for tSynonymSearch, because we always search the entire string Ex: for lucene <9~17> means search <9> with 17.0 as the minimum similarity (which sould be between 0 and 1) lucene will throws an exception saying: {code} Cannot parse '9~17': Minimum similarity for a FuzzyQuery has to be between 0.0f and 1.0f ! {code} What we need to do here is sending <9\ ~17> to query parser instead of the original string <9~17>. With tStandardizeRow, we parse the string at first. most of the characters above as well as the strings containg them will be marked as UNDEFINED, which we will not search any more in the index. However, we still have a problem with some keywords: In tStandardizeRow, we incrementally match the words. That means if ""TOM"" matches, we continue to search ""TOM OR"", which will unfortunately violate the syntax of lucene query parser, because there is no right hand side of the keyword OR. {code} org.apache.lucene.queryParser.ParseException: Cannot parse 'TOM OR': Encountered """" at line 1, column 7. Was expecting one of: ... ""+"" ... ""-"" ... ""("" ... ""*"" ... ... ... ... ... ""["" ... ""{"" ... ... ... ""*"" ... {code} what we need to do here is to replace all the < OR> with < ""OR""> to tell lucene that the here is just another word to search. As the replacement action will consume some extra resources, we should add it as an option but not the default behavior.",8 TDQ-4990,"Add the BIRT engine and the Talend engine to the DQ Portal","include SpagoBIBirtReportEngine and SpagoBITalendEngine into the DQ Portal. See http://forge.ow2.org/project/showfiles.php?group_id=204",8 TDQ-4993,"Change all DQ Portal logo to 'open integration solution'","Replace DQ portal background image text and information dialog text with 'data integration solution'",3 TDQ-4994,"reopen column set analysis about fileDelimited file all items gone","reopen column set analysis about fileDelimited file all items gone",11 TDQ-4995,"Dashboard is empty from remote client browser","Login TDQ Portal with tdq_user, open 'KPI' and 'indicators' from menu 'dashboard', the page have no content when the login user is not in locally.",8 TDQ-4996,"Remove ""<"" brackets in the version hint message ",NULL,1 TDQ-4997,"no information about Exchange time out","try to unfold the Exchange folder, but my computer can not access the network, no time out information show, but a sub items, refer to the pic.",5 TDQ-4998,"Add a section ""Data Quality platform internal documentation"" in the ""Contents"" page","add a section ""Data Quality platform internal documentation"" in the ""content"" page at the same level as ""Talend User documentation"". This section contents like the index page. and makes the function like the eclipse(when you change page from the ""Index"" page to ""Contents"" page, automaticaly link to place to ""Contents"" page) another issue: in the wizard page(look at the screenshot help.PNG), when click the help button, no action",13 TDQ-4999,"In ""Synonym Index View"", all the search results disappear while folding one of them.",NULL,8 TDQ-5004,"the detail inform for ""type"" is not correct for jdbc mysql and odbc mysql","1. create a jdbc(odbc) mysql dbconnection 2. check the detail view about the connection. 3. for the ""type"" it shows as ""Generic JDBC(Generic ODBC)"", and no version values shows. for type it should show as ""MySQL"" from case TDQQA-1694",5 TDQ-5005,"drag some columns into functional dependecy analysis cannot execute","drag some columns into functional dependency analysis run it will get a NPE error:: only the DRAG operation can cause this bug java.lang.NullPointerException org.talend.core.model.metadata.builder.connection.util.ConnectionSwitch.doSwitch(Unknown Source) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.getAnalysisDataProvider(Unknown Source) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction.run(Unknown Source) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:452) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",5 TDQ-5019,"Junit org.talend.core.model.metadata.MetadataFillFactoryTest.fillTables","org.talend.core.model.metadata.MetadataFillFactoryTest.fillTables org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsViewConnectionCatalogString org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsViewConnectionSchemaString",13 TDQ-5020,"Junit org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetTablesConnectionCatalogStringBoolean","org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetTablesConnectionCatalogStringBoolean org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetTablesConnectionSchemaStringBoolean",2 TDQ-5021,"Junit org.talend.cwm.db.connection.ConnectionUtilsTest.testRetrieveColumn","org.talend.cwm.db.connection.ConnectionUtilsTest.testRetrieveColumn org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetViewsConnectionCatalogStringBoolean org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetViewsConnectionSchemaStringBoolean",2 TDQ-5022,"Junit org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionCatalogString","org.talend.cwm.dependencies.DependenciesHandler#getClintDependency(org.talend.core.model.properties.Property) org.talend.cwm.dependencies.DependenciesHandler#getClintDependency org.talend.cwm.dependencies.DependenciesHandler#getAnaDependency org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionCatalogString org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionSchemaString",3 TDQ-5023,"Junit org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetColumns",org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testGetColumns,8 TDQ-5024,"Junit org.talend.dq.analysis.explore.PatternExplorerTest.testGetInvalidRowsStatement","org.talend.dq.analysis.explore.PatternExplorerTest.testGetInvalidRowsStatement org.talend.dq.analysis.explore.PatternExplorerTest.testGetValidRowsStatement",13 TDQ-5025,"Junit org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionCatalogString","org.talend.cwm.dependencies.DependenciesHandler#getClintDependency(org.talend.core.model.properties.Property) org.talend.cwm.dependencies.DependenciesHandler#getClintDependency org.talend.cwm.dependencies.DependenciesHandler#getAnaDependency org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionCatalogString org.talend.core.model.metadata.builder.database.DqRepositoryViewServiceTest.testIsContainsTableConnectionSchemaString",13 TDQ-5026,"Junit org.talend.dataprofiler.core.tdq.migration.CreateParserRuleFolderTaskTest"," org.talend.dataprofiler.core.tdq.migration.CreateParserRuleFolderTaskTest ",5 TDQ-5027,"some issue about dqportal"," find some issue about dqportal: issue 1: (1). when try to generate a reprot by dqportal, select Header：yes (2). nothing generated. if select Header for 'no', work well. issue 2: for the desinger, create sheet1 dependes table1, preview well, create sheet2 depende on table2, try to preview get errors.refer to the pic attached(if the two sheet from a same table, work well). ",13 TDQ-5028,"TDQ portal with oracle as datamart cannot work well","install portal with oracle -- portal datamart and report datamart failed to visit any functions, throw a 404 error just can login ..",3 TDQ-5030,"Text statistics indicators do not support some of mssql data type","some of mssql data type like ""text"", ""ntext"" don't be supported by text statistics indicators",8 TDQ-5040,"labels of Analysis subcategory are improperly handled","(To be detailed) ViewerDataFactory class. {code} 44 for (AnalysisCategory subCategory : category.getSubCategories()) { 45 subCategories.add(new AnalysisTypeNode(subCategory.getLabel(), subCategory.getLabel(), typeNode)); 46 } {code} CategoryHandler {code} public static String getLabel(String categoryLabel) { String messageKey = Messages.getString(""AnalysisType."" + categoryLabel.replaceAll(""\\s*"", PluginConstant.EMPTY_STRING));//$NON-NLS-1$//$NON-NLS-2$ if (messageKey.startsWith(MessagesCore.KEY_NOT_FOUND_PREFIX) && messageKey.endsWith(MessagesCore.KEY_NOT_FOUND_SUFFIX)) { return categoryLabel; } return messageKey; } {code}",5 TDQ-5041,"Include analysis description in reports",NULL,5 TDQ-5042,"In generated query scripts (view rows in explorer), analysis descriptions are not commented correctly","for descriptions containing multiple lines, \-\- even when there are carriage returns",5 TDQ-5043,"In DQ repository, sort items by type (folders then analysis) in ascendant alphabetical order","see if anything reusable from DI repository",8 TDQ-5044,"the job generate by ""Generate Job->generate an ETL Job to handle rows"" have some issue","1. create a postgresql analysis with pattern. 2. on resulg page select the pattern ""Generate Job->Generate an ETL Job to handle rows"" 3. run the job all columns go to outPattern file, in fact some items are inPattern and some are out(issue 1). reopen the job, and click the ""Edit schema"" of the tPatternCheck component, and ""cancel"" the popup dialog. re-run the job, can not successfully(issue 2)--also for mysql and oracle. for issue 1: use the pattern Regex->number->Contains numbers",13 TDQ-5046,"Issues related ""Source Files"" folder in dq repository ",NULL,5 TDQ-5050," {code} Please refer to the javajet file: tHiveInput_begin.javajet.",2 TDQ-5069,"After user modified system indicator's label, it's hard for user to find them in indicator selection dialog","after I changed a system indicator's label, for eg: ""row count"" to ""rc"" in the indicator selection dialog, it's still ""row count"" shown to me ",5 TDQ-5070,"Encoding issue with saving generated sql query action","In windows system for western european users, the default charset of text editors in eclipse is cp1252. If we run an analysis whose description contains spécial characters such as ""é"", and then try to save the script, or if we create a sql source via the wizard. These characters will become rectangles. No configuration in the studio can solve this until now.",8 TDQ-5072,"give more information in the help page about the column set analysis","See DOCT-445",3 TDQ-5076,"Implement Benford's Law: Use by Accountants to detect possible cases of Fraud","Benford's law is used by accountants to detect possible instances of fraud based on the distribution of digits in numbers. http://en.wikipedia.org/wiki/Benford%27s_law It would be good to add this to the DQ Profiler. Target audiance would be Forensic Accounting teams such as KPMG, Accenture, PCW, ... http://testingbenfordslaw.com/ ",13 TDQ-5077,"Different filters separated by commas do not work in the Package Filter wizard for the DB connections","In the new ""Package Filter"" wizard created on database connections, setting one filter in the wizard works well (see the first capture). But when I tried using several filters separated by commas, I didn't have any results in the connection _ all sub-nodes have disappeared _ although the wizard says that I can use several filters (see the second capture). The second point I want to raise here is that you must type the complete name of the catalog/schema in the wizard when filtering your connection in order to have correct results. When I typed part of the catalog/schema name and clicked Finish all sub-nodes disappeared from the connection (see the third attached capture). My suggestion is either to have dynamic filtering, that is when you start typing your filter in the wizard, the corresponding catalog/schema display under the connection node without the need to type the complete name. If this is complicated technically, at least try to add a popup message that will open when the user type only part of the catalog name and click Finish to tell him/her that they must type the complete name. The last point to talk about here is that if users want to cancel the filter and list all catalogs/schemas in the connection, they need to delete the filter from the Package Filter field in the wizard and then click Finish again to list all catalog/schemas in the connection. Is it possible to add a button in the wizard, for example Remove Filter, that will remove the filter? This will be more obvious to the user. ",8 TDQ-5078,""">/<"" shouldn't be allowed in the name of business rule in the business rule creation wizard","When I tried to create a new business rule using the business rule creation wizard, I could use "">"" in the business rule name (see the first attached capture). But after defining the rule in the second step in the wizard and trying to click Finish, I got an error message(see the second attached capture). When I didn't use this special character in the rule name, I could create the business rule without any problem. The user shouldn't be able to use special characters in the first step in the wizard when setting the rule name.",8 TDQ-8404,"jibx binding classes are missing in generated jar package tBRMS on mac","This issue is found on mac, but not on windows. To verify on linux. It seems that the intermediate binding classes are not generated under the right folder, so that they are not included into the final jar. ",8 TDQ-5089,"IndexMigrator does not handle well subfolder of indexes","I have tried to migrate the synonym under svn. I have got the following exception: Migrating all indexes in folder <.> REGENERATE: /home/scorreia/devel/svn_checkouts/tdq/branches/branch-5_0/org.talend.dataquality.data.resources/data/synonym/idx_address/idx_address_abbreviation_label_FR/. Exception in thread ""main"" java.io.FileNotFoundException: ./.svn (Is a directory) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.(FileInputStream.java:138) at org.talend.dataquality.standardization.migration.IndexMigrator.copyFile(IndexMigrator.java:270) at org.talend.dataquality.standardization.migration.IndexMigrator.regenerate(IndexMigrator.java:206) at org.talend.dataquality.standardization.migration.IndexMigrator.run(IndexMigrator.java:138) at org.talend.dataquality.standardization.migration.IndexMigrator.main(IndexMigrator.java:304) ",1 TDQ-5090,"fix TUJ issue with tSynonym* components","tSynonymOutput_18428 and tSynonymSearch_18429 TUJ cannot be imported in a recent studio. fix these two TUJ. ",3 TDQ-5093,"Add an option in tSynonymSearch to do fuzzy search","Add an option in the properties of the component that enables fuzzy search. By default, keep the same behavior as before. ",8 TDQ-5097,"Failed to generate report file in command line","while I tried to generate a report via commandline, (executeReport -n label -p path) I got this error and no report file generated .. talend> java.lang.NullPointerException at org.talend.core.model.metadata.builder.connection.util.ConnectionSwitch.doSwitch(ConnectionSwitch.java:108) at org.talend.core.model.metadata.builder.database.JavaSqlFactory.getUsername(JavaSqlFactory.java:262) at org.talend.cwm.db.connection.ConnectionUtils.isConnectionAvailable(ConnectionUtils.java:286) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.validateReport(ReportDocGenerator.java:188) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:147) at org.talend.datacleansing.core.service.TDQReportService.executeReport(TDQReportService.java:63) at org.talend.commandline.command.CommandProcessor.executeReport(CommandProcessor.java:622) at org.talend.commandline.command.ExtensionCommandSwitch.caseExecuteReportCommand(ExtensionCommandSwitch.java:76 ) at org.talend.commandline.client.command.extension.AbstractExtensionCommandSwitch.doSwitch(AbstractExtensionComm andSwitch.java:35) at org.talend.commandline.command.CommandProcessorSwitch.caseExtensionCommand(CommandProcessorSwitch.java:161) at org.talend.commandline.client.util.CommandAbstractSwitch.doSwitch(CommandAbstractSwitch.java:70) at org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:52) at org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:33) at org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) at java.lang.Thread.run(Unknown Source)",5 TDQ-5101,"Import SQL file via import button, it show me that there is already one","import a former build workspace, such as 4.2.x in the import wizard, I tried to select sql files to import in my local repository, there is only one -- ""TEST_TOP"" but it show me both of them are conflict ..",5 TDQ-5104,"Replace easymock library usage by powermock","See discussion on http://sandbox-network.talend.com/groups/rd/docs/automated-tests-junit-plugins-tools-mocks",5 TDQ-5105,"the related dependence tag didn't update after rename an item","1.create a mysql connection named ""M"". 2.create a analysis named ""A"" and based on connection ""M"". 3.open ""A"" and rename to ""B"",then save it. 4.open the connection with ""Text Editor"". find the client tag did not update to name ""B"",it is still ""A"". so that this client dependcy of the connection is Proxy,may cause other issues. it seems that all items exist this problem,not only analysis-connection,I just test for report-analysis-connection. ",8 TDQ-5109,"when delete the generated reports, it is not convenience for the user","when I delete more than one generated reports, it is not convenience for me I must confirm one by one",8 TDQ-5110,"extract the summary area of the report as sub-report in the studio","- Extract the summary area of the report as sub-report in the studio - Investigate the customizer class loading problem in DQPortal app. - Modify parameters in DQ portal to adapt the JRXML,Test each of these jrxml on DQportal - Commit these jrxml to svn",20 TDQ-5116,"Remote project mode, read only user still can edit the editor","I logged on a remote project with a read only user but I still can modify the resources.",8 TDQ-5117,"can not preview the view which named ""columns"" for db2 dbconnection","I have a view file which named ""columns"", try to preview it on repository, get errors. for db2dbconnection. should also make preview table correct for special name. ",5 TDQ-5118,"the tables and view can not show correctly for db2zos connection.","1. create a db2zos dbconnection-- I just select db2zos type in the creation wizard, but connetion to a norminal db2 database. 2. try to check the tables and views. result: the tables and views not only show under its corresponding folders , but table also show under ""Views"" folder, and view also show under ""Tables"" folder. should not like this. no errors.",5 TDQ-5119,"the ""execution status"" should not display an error message when the analysis is not executed yet","There should be no message instead of the ""Failure: null"" message when the number of execution is 0. Or the number of executions should be > 0.",5 TDQ-5123,"the ""Table/View Selection"" dialog can not show the sub node of the dbconnection","1. create a table rule analysis 2. click the link ""select tables/views to analyze"" in the pop-up dialog can not show the sub node of the dbconnection.",8 TDQ-5127,"Drag a node under analysis or report to any other place will throw NPE","drag a node under a analysis model --- ""analyzed elements(..)"" into another folder drag a node under a report model --- ""Analyzes()"" or ""Generated Documents()"" into another folder will throw an error java.lang.NullPointerException at org.talend.repository.localprovider.model.LocalRepositoryFactory.moveFolder(LocalRepositoryFactory.java:1183) at org.talend.core.repository.model.ProxyRepositoryFactory.moveFolder(ProxyRepositoryFactory.java:462) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.computePath(RepositoryNodeDorpAdapterAssistant.java:566) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.moveFolderRepNode(RepositoryNodeDorpAdapterAssistant.java:424) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.computeRepNodeType(RepositoryNodeDorpAdapterAssistant.java:222) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.handleDrop(RepositoryNodeDorpAdapterAssistant.java:158) at org.eclipse.ui.navigator.CommonDropAdapter$1.run(CommonDropAdapter.java:194) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.navigator.CommonDropAdapter.performDrop(CommonDropAdapter.java:184) at org.eclipse.jface.viewers.ViewerDropAdapter.drop(ViewerDropAdapter.java:276) at org.eclipse.ui.part.PluginDropAdapter.drop(PluginDropAdapter.java:69) at org.eclipse.swt.dnd.DNDListener.handleEvent(DNDListener.java:90) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:774) at org.eclipse.swt.dnd.DropTarget.Drop(DropTarget.java:456) at org.eclipse.swt.dnd.DropTarget$3.method6(DropTarget.java:258) at org.eclipse.swt.internal.ole.win32.COMObject.callback6(COMObject.java:119) at org.eclipse.swt.internal.ole.win32.COM.DoDragDrop(Native Method) at org.eclipse.swt.dnd.DragSource.drag(DragSource.java:363) at org.eclipse.swt.dnd.DragSource.access$0(DragSource.java:289) at org.eclipse.swt.dnd.DragSource$1.handleEvent(DragSource.java:172) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",3 TDQ-5128,"Delete a generated document manually and then try to open it in studio will get an error","after execute the report file it will generate a document in my disk I delete this document manually, not via the studio the document node is still can be visible in studio while tried to open it, studio will throw error said: can not find file ... org.eclipse.core.internal.resources.ResourceException: Cannot create linked resource. Local location '(generated document path...)' does not exist. at org.eclipse.core.internal.resources.Resource.assertLinkRequirements(Resource.java:180) at org.eclipse.core.internal.resources.Resource.createLink(Resource.java:655) at org.eclipse.core.internal.resources.Resource.createLink(Resource.java:629) at org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction.duRun(OpenItemEditorAction.java:145) at org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction$1.run(OpenItemEditorAction.java:118) at org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:84) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:217) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:2592) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1740) at org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction.run(OpenItemEditorAction.java:125) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.jface.window.Window.runEventLoop(Window.java:825) at org.eclipse.jface.window.Window.open(Window.java:801) at org.eclipse.ui.internal.views.log.EventDetailsDialog.open(EventDetailsDialog.java:176) at org.eclipse.ui.internal.views.log.EventDetailsDialogAction.run(EventDetailsDialogAction.java:98) at org.eclipse.ui.internal.views.log.LogView$15.doubleClick(LogView.java:536) at org.eclipse.jface.viewers.StructuredViewer$1.run(StructuredViewer.java:824) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.internal.JFaceUtil$1.run(JFaceUtil.java:49) at org.eclipse.jface.util.SafeRunnable.run(SafeRunnable.java:175) at org.eclipse.jface.viewers.StructuredViewer.fireDoubleClick(StructuredViewer.java:822) at org.eclipse.jface.viewers.AbstractTreeViewer.handleDoubleSelect(AbstractTreeViewer.java:1421) at org.eclipse.jface.viewers.StructuredViewer$4.widgetDefaultSelected(StructuredViewer.java:1225) at org.eclipse.jface.util.OpenStrategy.fireDefaultSelectionEvent(OpenStrategy.java:238) at org.eclipse.jface.util.OpenStrategy.access$0(OpenStrategy.java:235) at org.eclipse.jface.util.OpenStrategy$1.handleEvent(OpenStrategy.java:296) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",3 TDQ-5129,"Junit for TDQ-4753 ","Write a Junit to test the changeset of http://talendforge.org/trac/top/changeset/81311",3 TDQ-5130,"the analysis about file connection can not open after ""edit schema""","file connection is not export as context 1. create an analysis about a file connection. 2. right click the file connection -> edit schema, in the pop-up dialog select the ""Guess Schema"", click ""ok"" 3. reopen the analysis, can not open get error. ",5 TDQ-5132,"the wizard of creation a fileDelimited connection can not work well on top","try to create a file connection on top, on the wizard of preview column can not finished. ok on tdq.",8 TDQ-5133,"switch perspective is slow","after create a big data connection then switch respective from TDQ to TOS is slowly",13 TDQ-5137,"select view on the business rule analysis is invalid.","select view on the business rule analysis is invalid.",3 TDQ-5138,"the selection for mdm connecton's columns is not correct.","1. create a mdm connection. 2. try to create a column/columnset analysis. 3. refer to the pic, if I select a sub node of Product on the right pane, such as Id, seems other nodes-> features(sizes, colors) and stores also selected (not correct) 4. click ok, check in the analysis editor, not 'ID' and 'name' but all the sub nodes of 'Sizes'('Size'),'Colors'('Color') and 'Store'('Store') please refer to the pic. it should select the nodes correctly. (1). if select a root node, should select all its sub nodes. (2). if select a sub node which has no sub node, should select itself only.",13 TDQ-5139,"the analysis result and drill down doesn't work well for mdm column analysis","1. create a mdm column analyis about 'Product' entity which contains ""id"" and ""name"" and ""family"" sub nodes. 2. have 3 records which id name family 1 product1 (not set) 2 product2 (not set) 3 product3 familyaa 3. select simple statistics indicators for the analysis for sql engine result: RowCount Null Distinct Unique Duplicate family 3 2 1 1 1 id 3 0 3 3 0 name 3 0 3 3 0 for java engine result : RowCount Null Distinct Unique Duplicate family 3 3 1 0 1 id 3 3 1 0 1 name 3 3 1 0 1 issue 1: different for sql and java engine. issue2 under java engine try to ""view row"" on result page, get error. we should have correct analyze result and can drill down correctly for ""view row"" and ""view values"" correctly.",8 TDQ-5140,"DQ Portal Install - holds hardcoded IP not machine name","When you run the DQ Portal install, even if you supply in ""Localhost"" for all machine details it actually saves to the repository the hardcoded machine IP. This means if the machine IP changes the DQ portal fails, this is bad pratice and should use the machine name so dns etc resolves. For now this can be worked around by removing the fixed IP address from tables: update SBI_VIEWPOINTS update SBI_REMEMBER_ME update SBI_LOV set LOV_PROVIDER update SBI_ENGINES replacing for exmaple: http://127.23.36.35:8580/SpagoBIBirtReportEngine/BirtReportServlet with http://localhost:8580/SpagoBIBirtReportEngine/BirtReportServlet",20 TDQ-5143,"Checking datamart will get error on Dev environment console","1.create a report and select a column analysis with simple indicators. 2.for the datamart,I select the default ""HSQL"". 3.click ""check"",will get a successfull infor dialog.It is ok. But get error on dev environment console(it has relation with Mysql?),and there is not error on studio log viewer.",8 TDQ-5144,"use installer install the DQPortal on oracle, there have some problems","use installer install the DQPortal on oracle, open 'KPI' and 'indicators' from menu 'dashboard', the page have no content and after a while will throw a TimeOut exception, if open 'KPI' and 'indicators' some times, after a while the web server will throw OutOfMemoryErr; if import the tdqportal database by hand will not have such problems there have three computer to reproduce this problem: 1. DQPortal install computer(install DQPortal on this computer): windows xp 2. Oracle database computer(the ""tdqportal"" and ""talend_dq"" database installed on this computer): windows xp 3. Client computer: Ubuntu 11.10 + Firefox 11.0, use this computer to access the DQPortal if access the DQPortal from a windows system by Firefox, it's ok",2 TDQ-5146,"find some issue about report file","find some issue about report: (1). for report about overview(connection/schema/catalog) analysis , the summary of report can not get the table/view filter (2). for ""Presentation Settings""(in report editor),set some value as ""Page Number"", Result:""Page 1 of2"", there should be a space between 'of' and '2' (3). for report about column analysis, if columns from a catalog, for schema's values show nothing, when columns from schema, catalog's value show 'N/A(TDQ)', we should unify it. also for other analysis's summary. (4). column set analyzed more than one column, the summary of report show only one column. should we show this, how about if set 100 columns in the column set? (5). for content compare basic lose the ""anaysis"" in summary of report compare to the evolution. (6). for functional analysis report-- evolution, can not seem the data aixs, just the time one. (7). for schema report, also set catalog's value as schema's value, should be not set or N/A(TDQ)---basic (8). No value on vertical axis of simple analysis chart with basic type. (9). SUMMARY OF REPORT:-->SUMMARY OF ANALYSIS:",13 TDQ-5149,"import the file under Exchange, no dialog pop-up to show the result.","1. try to import a file under Exchange, indicator,regex or sql. there is no dialog pop up to show the result, redo this function, there will be one. why the first time do this no inform.",5 TDQ-5151,"TalenD installation problem","When installing TalenD getting following (see attachment) errors thus the Talend is not installed. We need TalenD only for data cleansing purposes (data deduplication). ",8 TDQ-5154,"update DQ portal jrxml file with those in the DQ Portal web application","checkout http://talendforge.org/svn/dqportal/trunk/org.talend.dqportal.configuration/ Compare each jrxml file in reports/ ├── column │   ├── b01_column_basic.jrxml │   ├── b02_column_evolution.jrxml │   ├── p01_column_basic.jrxml │   ├── p02_column_evolution.jrxml │   ├── p03_column_basic_dq_rules.jrxml │   ├── p04_column_dq_rules_evolution.jrxml │   ├── README.txt │   └── report_01.jrxml ├── dashboard_report │   ├── pri01_potential_pk.jrxml │   ├── pro01_orphan.jrxml │   ├── pro02_tables_no_fk.jrxml │   └── pro03_tables_no_pk.jrxml ├── indicator_reference.ods ├── match │   ├── p05_match_basic.jrxml │   └── p06_match_evolution.jrxml └── overview ├── p03_overview_basic.jrxml ├── p04_overview_evolution.jrxml └── po04_index_collmn.jrxml with the current jrxml templates available in the DQ Portal web application. Replace the jrxml file of the svn folder by those coming from the DQ portal web application. Commit the changes. ",5 TDQ-5155,"Change the look&feel of all these reports and commit","We'll keep track of all changes by using svn for these reports. ",20 TDQ-5156,"Unify Oracle and MySQL reports queries","Compare the files on svn with the files from the Oracle configuration of the DQ portal. Change the queries so that they can be executed on both MySQL and Oracle. The jrxml files should be generic enough to be compatible with both databases. ",13 TDQ-5157,"update the MySQL DQ Portal configuration dump with the new jrxml files",NULL,5 TDQ-5158,"Use HSQL database for the DQ Portal configuration","- Use HSQL instead of MySQL or Oracle for the DQ Portal configuration (tdqportal database). - Remove the related configuration pages from the installer. - Remove the installer tasks related to the dumps of Oracle and MySQL. - Add an installer task for the configuration of the HSQL database.",13 TDQ-5180,"duplicate an overview analysis with table/view filters, the duplicated analysis don't contain table/view filters",NULL,5 TDQ-5181,"for the job generated by the pattern ""generate an ETL job to handle rows"" can not run successfully.","1. create a column/column set analysis about db2 connection. 2. add pattern to the analysis, run in java engine. 3. in result page, right click the pattern, get menu ""generate an ETL job to handle rows"" run the job failed. ",8 TDQ-5182,"for the report file can not show threshold correctly.","1. for report about column set analysis lose header, both basic and evolution. 2. for dq rule analysis when data out of threshold, lost some data show 3. for the frequency of indicator, when out of threshold, the color is not right, should be red. 4. the summary info should not display ""null""",8 TDQ-5183,"new line character issue with DQ rule component in windows","In window, the generated query usually contains several lines. see job item. {code} 2500 ))"""/> {code} The new line characters from DQ Rule are presented as "" ; ;"", which correspond to ""\r\n"". pb1: the ""\n"" character must be replaced by SPACE_SYMBOL, but not EMPTY_STRING. pb2: the ""\r"" character must be replaced at the same time as well as ""\n"". otherwise, it will be included in the generate job like the following and will cause compile error: {code} String dbquery_tMySQLValidRows_1 = ""SELECT `customer_id` FROM `tbi`.`customer` WHERE (( customer_id>2500 ))""; {code} ",2 TDQ-5184,"the backcolor is incorrect","look at the attachment screenshot about the dropdown list in image ""bg2.png"", can prefer to the dropdown list in image ""bg1.png""",1 TDQ-5185,"Delete analysis and report at the same time, the analysis is still under analysis node","create an analysis and report, report depends on analysis select these two items at the same time, delete them then can see the analysis and report in recycle bin but there is still one analysis under analyses node, take a look at the screen shot if do some operations on this analysis will get errors",5 TDQ-5186,"In seme way, don't check ""force delete"" still can delete the depended item","create an analysis and a report, the report depends on this analysis delete this analysis into recycle bin, keep report in repository select them at the same time and do delete operation first, it will pop up a dialog tell me that, there is dependency between these two items do NOT check the ""force delete"", click on ok button then it will pop up another dialog to ask me if I will delete the item forever click yes, it will delete the analysis and report goes into recycle bin...",5 TDQ-5187,"DQ datamart URL is wrong ","I have such a JDBC URL after installing the newest version DQ Portal jdbc:mysql://192.168.0.199:3306/talend_dq69227 Why? PS: Make sure that the management console of datasources must be take effect in DQ portal.",2 TDQ-5189,"use dynamic pattern list in tMultiPatternCheck","Currently regexes are hard coded. They must be retrieved from the DQ repository view. Use the list of patterns as it is done in tPatternCheck. Beware that the job must be able to run without accessing the patterns in the dq repository view (just like the tPatternCheck component). ",5 TDQ-5190,"issues for db2 zos connection.","1. create a db2 zos connection, the first time the schema will not show for which no tables and views(after reload will show all). 2. for the db2zos connection, there is one schema value is different to a db2 connection. the SYSIBM schema, for db2zos have tables and view, but for db2 connection there is no tables. issue 3 create a db2/db2zos connection with schema filter, schema show well, reload database list will show all the schemas. ",8 TDQ-5191,"column set analyzed report can not show all the column names","in the summary of analysis, should show all the column names like ""xxx,xxx,xxx"" note: both studio and dqportal need to modify",5 TDQ-5192,"when there are more than one analyses in a report, the page number display is incorrect","set report as the attchment screenshot and the error report as ""column-20120418-1413-00051.pdf""",8 TDQ-5199,"the table chart for oracle data and oracle datamart is not correctly in report","1. create a column anlaysis about oracle connection. 2. just select simple statistics. 3. try to generate with oracle datamart. check the result as pic attached. all the indicator show in one table chart. issue 2. now we set the result value above the chart, but sometimes the value can not show fully, as pic(if data is larger, even half of the data will be covered) issue 3. for the summary of a report, value for Catalog and Schema, why when use hsql and mysql, it is ok, when datamart is oracle, one of them will set as 'null' issue 4. in report why the ""pattern"" in table chart show as 'Regular Expression' issue 5. when i create an analysis with TextStatistics indicators, the dqportal of column basic can not find it. also should support the other type indicators",8 TDQ-5200,"Should remove client dependences in connection when all columns are deleted in analysis","1.crate a mysql connection 2.crate an anlysis based on this connection,select one or more colums,save this analysis. 3.delete all columns on this analysis editor,save it. 4.check the connection file,the tag 'client' about this analysis still exsit,should be removed. It seems that this connection in memory is ok(means the related dependences are removed),but fail to persistence. Recently，I have reported some bug about dependeces,might has same reason,please check.",13 TDQ-5205,"In result of tRuleSurvivorship component, each master record should also have a GID ",NULL,2 TDQ-5211,"Backport TDQ-4870 to branch 5.0","In branch 5.0, there is only one sub-report for column set report that need to be import/export.",2 TDQ-5212,"PostgreSQL compare between local and remote failed","while tried to compare a postgreSQL connection between local and remote in studio got a ""check connection failed:null"" error java.lang.reflect.InvocationTargetException at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.cwm.compare.ui.actions.PopComparisonUIAction.run(PopComparisonUIAction.java:77) at org.talend.cwm.compare.ui.actions.SubelementCompareAction.run(SubelementCompareAction.java:111) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.performCompareAction(CompareModelContentMergeViewer.java:334) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.access$1(CompareModelContentMergeViewer.java:306) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer$CompareMouseListener.mouseDoubleClick(CompareModelContentMergeViewer.java:291) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) Caused by: java.lang.NullPointerException at org.talend.cwm.compare.ui.actions.PopComparisonUIAction$1.run(PopComparisonUIAction.java:67) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 33 more Root exception: java.lang.NullPointerException at org.talend.cwm.compare.ui.actions.PopComparisonUIAction$1.run(PopComparisonUIAction.java:67) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.cwm.compare.ui.actions.PopComparisonUIAction.run(PopComparisonUIAction.java:77) at org.talend.cwm.compare.ui.actions.SubelementCompareAction.run(SubelementCompareAction.java:111) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.performCompareAction(CompareModelContentMergeViewer.java:334) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.access$1(CompareModelContentMergeViewer.java:306) at org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer$CompareMouseListener.mouseDoubleClick(CompareModelContentMergeViewer.java:291) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",8 TDQ-5213,"report about phone number indicator can not generated successfully.","1. create an analysis about phone number indicators. 2. try to generate a report about the analysis file with basic type, get error. evolution is ok now. ",5 TDQ-5215,"Create a User defined indicator that implements the Benford law","See TDQ-5076 Create a java UDI and add also SQL templates when possible. ",8 TDQ-5220,"Wrong warning shell","Set the parent shell for the warning dialog. ",3 TDQ-5222,"Fail to view value with distinct indicator in columnSet analysis ","1.create a column set analysis with two cloumns. 2.run this analysis. 3.turn to result page,drill down with ""View values"",can not get the query result,but an error dialog.",2 TDQ-5223,"Create version 5.1.0 in Babili and populate it",NULL,2 TDQ-5227,"Backport changeset of TDQ-2699 from trunk to branch 5.0 and 4.2",NULL,3 TDQ-5232,"some wizard of ""Match Data Job"" and ""Deduplicate Data Job"" are not correct in cheat sheet","1. try to create ""Match Data Job"" and ""Deduplicate Data Job"" follow the wizard of in cheat sheets 2. in the wizard when select ""Choose existing metadata from Repository"" the pop-up dialog can not show the existing metadata, but some other dialog. ",5 TDQ-5233,"support long varchar on DB2","Currently several indicators are not support on long varchar type on DB2 database. They should be supported as varchar type. See more on TDQ-2699 , contact qiongli to get more information. ",5 TDQ-5234,"Pattern processing should be coherent across pattern analysis, Pattern Test View and components","At the moment, Pattern analysis uses {code}Pattern.compile(""regex"").matcher(""input"").find(){code} But Pattern Test View and components use {code}Pattern.compile(""regex"").matcher(""input"").matches(){code} or {code}Pattern.matches(""regex"", ""input""){code} (the 2nd and the 3rd are equivalent) Following the discussion with scorreia, the first one is more flexible, because the other 2 methods try to match the entire string even there is no ""^"" ""$"" signs, which narrows the possibility to match parts of a string. Besides, in SQL mode of Pattern Test View, the databases apply regex like in the first way.",2 TDQ-5238,"Incorrect primary key information","The information about the PK is not correct. See screen capture. The ""primary keys"" field should list the columns used as key. ",5 TDQ-5240,"Business rule analysis doesn't get match/nonmatch chart, while add the rule by click the icon in analysis editor","while add the rule to a table analysis by click the icon in analysis editor doesn't get the chart of match/nonmatch",3 TDQ-5241,"run analysis get error for 'time' type of column","1. create a column analysis with time type of column 2. select all indicators can run well for this column. 3. after run get error.(see error in details tab) 4. for db2 column seems all the Advanced can not work well errors like below. (2012-04-26 11:27:53,953 ERROR org.talend.dq.analysis.ColumnAnalysisSqlExecutor - Query not executed for indicator: ""Week Low Frequency Table"" SQL query: SELECT YEAR(""COLUMNTIME"") , QUARTER(""COLUMNTIME"") , MONTH(""COLUMNTIME"") , WEEK(""COLUMNTIME""), COUNT(*) c FROM ""TALEND"".""FORTEST"" t GROUP BY YEAR(""COLUMNTIME"") , QUARTER(""COLUMNTIME"") , MONTH(""COLUMNTIME"") , WEEK(""COLUMNTIME"") ORDER BY c ASC FETCH FIRST 10 ROWS ONLY). we should control well for this.",8 TDQ-5242,"report doesn't show basic chart while it contains both basic and evolution type template","while a report contains both basic and evolution type template the generated report file only show the evolution template, doesn't show the basic type",8 TDQ-5245,"for some column analysis can not turn to result page correctly","1. create a column analysis about oracle dbconnection. 2. select three columns-- date, varchar,number. 3. select all the indicators for the three columns. run get error for the last log item, no pic show. turn to result page, get same errors, no any pic show. note??you can also reproduce it by seect 15 column, and select all the indicators, run,?delete one column in the first editor page, turn to second page, also get error(refer to second error in Details tab) most of time can not reproduce(reproduced, do some more testing, re-open studio, can not get error). I think we'd better check it as error log. Thanks",13 TDQ-5246,"for mdm connection can not show the column name on the ""Select patter to filter the data of table""","1. create a column set analysis about mdm connection. 2. add a pattern to one column. 3. run, turn to result page, click the Data->Filter Data , in the pop-up dialog, can not see the column name. refer to the pic.",3 TDQ-5247,"add pattern to the column lead to the indicator on the column disappear.","1. create a column analysis. 2. add some indicators to the column. 3. try to add pattern to the column by click the ""add pattern"" icon. result indicators(both sys and UDI) for this column disappear. note if I drag pattern will not cause this. ",1 TDQ-5248,"the report(evolution) result seems not correct for those migrate from lower version","1. create some report file and generate with mysql datamart on 5.0.2(project name is 'test02') 2. migrate both report file and datamart to 5.1.0 (the new project name is 'test510') 3. re-generate the report file with evolution type. result just one point show. in my opinion this is not correct.",13 TDQ-5249,"Tell user which analyes are impacted.","Tell users which analyses are impacted when relaoding.",8 TDQ-5250,"When I cancel the delete action, the report should be back to the original position. ","NOTE: ""Fail to delete forever dependencies"" is not necessary, remove it.",5 TDQ-5251,"remove shadow in charts","Since the upgrade of the jfreechart library, shadows appeared in the bar charts. Please, remove these shadows as they make the results harder to read. See attached picture",5 TDQ-5252,"Remove scrollbars when not necessary","The scrollbars should not appears when there not several lines. See picture. ",2 TDQ-5253,"Selection lost in UDI selection window","Create a column analysis, add a UDI reopen the UDI selection window: The previously selected UDI is not selected anymore!",2 TDQ-5254,"The links in welcome page of Talend open studio for DQ version failed to be functional.","The links are not work, e.g: * Installation guide * Talend Open Studio for Data Quality user guide It seems that the ""target"" attribute in Installation guide This one fails: Installation guide ",3 TDQ-5255,"The HTML XML EXCEL and RTF format are not satisfactory for the new look and feel.","Apply all to both studio and dqportal application.",8 TDQ-5256,"Migration lose the Norminal and Time correlation analysis","Try to do the migration by import button. For 423 and 502 will lose the Norminal and Time correlation analysis.",8 TDQ-5257,"redundant folder after migrating 413 source file","Try to do the migration by import button. for the source file from 413 show some redundant folder",5 TDQ-5258,"Analysis in a folder cannnot be opened after migration","Try to do the migration by import button. - Create an analysis which profiling file connection. - Create a new foler named ""file connection"" in analysis root folder. - Put this analysis in to the new foler. - Migrate it. - The analysis is out of folder and can not open Note: migration from 413, for another versions ok.",8 TDQ-5259,"Migrate file from 401, just can show some of analysis and none report show","Try to do the migration by import button. Migrate file from 401, just can show some of analysis and none report show, and show a redundant folder for UDI, refer to pic (on TDQ-5221). ",13 TDQ-5260,"for the file from 413, the mdm connection lost, all the analysis can not open","Try to do migration by logon window. for the file from 413, the mdm connection lost, all the analysis can not open.",8 TDQ-5276,"for dqportal there is some issue need to fix","1. the header of ""Pat_matching evolution"" and ""Simple stats evolution"" should be ""Table.column"", lose "".column"" 2. for column set (both basic and evolution), the background color of ""Summary of Analysis"" is different to others. 3. for ""Redundancy analysis""->basic and evolution even if I choose 'no' for header, it still show in result. 4. for ""potential primary keys"": the ""Potential Primary keys"" title should be near with ""summary of analysis"" 5. the Orpan tables: the summary of analysis shows catalog/schema, below inform show not only about the certain catalog/schema. should change this. 6. for title Tables without pK/Fk: just show ""TABLES WITHOUT"", lose 'PK/FK' the information show ""CATALOG.SCHEMA:"" we'd better leave a big space with ""summary of analysis""(for FK template no this inform) 7. for ""Column size analysis"", the header and other inform are not same width. 8. the oracle datamart dqportal tested for example on 24/4, some of template can not show the result, but I change system time to 25th/4, can all show correctly. why? ",5 TDQ-5279,"for the view row/values on Unique count is not correct for int type about fileConnection ","1. create a file connection. 2. create a column analysis about the connection. 3. try to view row/values for 'Unique count' on a int type column--try this with the Unique and Distinct result is different columns. can get result, but the result number is different with unique count, but same with distinct count. ",8 TDQ-5280,"Issues found when i save BRMS metadata from component to repository","The issues are mainly about the text handling for URLs, class/module names etc. for example: In the component configuration, quotes are removed for ""org.talend.bank.LoanSimulator"" after saving metadata, so the generated code contains ""rg.talend.bank.LoanSimulato.class"" ",13 TDQ-5285,"select a connection which has been physical deleted from the connection list on the analysis editor, throw NPE","java.lang.NullPointerException at org.talend.dataprofiler.core.ui.action.actions.ChangeConnectionAction.(ChangeConnectionAction.java:99) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.callChangeConnectionAction(AbstractPagePart.java:240) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.access$0(AbstractPagePart.java:238) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart$1.widgetSelected(AbstractPagePart.java:223) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1282) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1267) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1061) at org.eclipse.nebula.widgets.tablecombo.TableCombo.tableEvent(TableCombo.java:1339) at org.eclipse.nebula.widgets.tablecombo.TableCombo.access$4(TableCombo.java:1306) at org.eclipse.nebula.widgets.tablecombo.TableCombo$1.handleEvent(TableCombo.java:179) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",8 TDQ-5286,"""Run"" button disabled when launch a report ","1.Create a mysql db 2.Create a column analysis 3.Create a report and select this analysis Right click this report, choose Generate Jobs.Choose Launch a report menu. 4.After turn to the job page ,click the button""Run"",but this button disabled .can refer to the ""rundisable.png"";",5 TDQ-5287,"Fix Java regex problem","The java regex of the ""Contains numbers"" pattern should read '\d' instead of '^\*\d+\D\*$'",5 TDQ-5288,"change the connection of Functional Dependency Analysis on Postgresql, throw NPE","java.lang.NullPointerException at org.talend.dataprofiler.core.ui.editor.analysis.ColumnDependencyMasterDetailsPage.validator(ColumnDependencyMasterDetailsPage.java:359) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnDependencyMasterDetailsPage.canSave(ColumnDependencyMasterDetailsPage.java:206) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.doSave(AbstractAnalysisMetadataPage.java:150) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.callChangeConnectionAction(AbstractPagePart.java:274) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.access$0(AbstractPagePart.java:238) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart$1.widgetSelected(AbstractPagePart.java:223) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1282) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1267) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1061) at org.eclipse.nebula.widgets.tablecombo.TableCombo.tableEvent(TableCombo.java:1339) at org.eclipse.nebula.widgets.tablecombo.TableCombo.access$4(TableCombo.java:1306) at org.eclipse.nebula.widgets.tablecombo.TableCombo$1.handleEvent(TableCombo.java:179) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) org.eclipse.swt.SWTException: Failed to execute runnable (org.eclipse.core.runtime.AssertionFailedException: null argument:) at org.eclipse.swt.SWT.error(SWT.java:4083) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:137) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:3515) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3164) at org.eclipse.jface.operation.ModalContext$ModalContextThread.block(ModalContext.java:173) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:388) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:38) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.callChangeConnectionAction(AbstractPagePart.java:258) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart.access$0(AbstractPagePart.java:238) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart$1.widgetSelected(AbstractPagePart.java:223) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1282) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1267) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1061) at org.eclipse.nebula.widgets.tablecombo.TableCombo.tableEvent(TableCombo.java:1339) at org.eclipse.nebula.widgets.tablecombo.TableCombo.access$4(TableCombo.java:1306) at org.eclipse.nebula.widgets.tablecombo.TableCombo$1.handleEvent(TableCombo.java:179) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: org.eclipse.core.runtime.AssertionFailedException: null argument: at org.eclipse.core.runtime.Assert.isNotNull(Assert.java:85) at org.eclipse.core.runtime.Assert.isNotNull(Assert.java:73) at org.eclipse.jface.viewers.StructuredViewer.assertElementsNotNull(StructuredViewer.java:595) at org.eclipse.jface.viewers.StructuredViewer.getRawChildren(StructuredViewer.java:990) at org.eclipse.jface.viewers.ColumnViewer.getRawChildren(ColumnViewer.java:703) at org.eclipse.jface.viewers.AbstractTableViewer.getRawChildren(AbstractTableViewer.java:1087) at org.eclipse.jface.viewers.StructuredViewer.getFilteredChildren(StructuredViewer.java:896) at org.eclipse.jface.viewers.StructuredViewer.getSortedChildren(StructuredViewer.java:1046) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefreshAll(AbstractTableViewer.java:701) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefresh(AbstractTableViewer.java:649) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefresh(AbstractTableViewer.java:636) at org.eclipse.jface.viewers.AbstractTableViewer$2.run(AbstractTableViewer.java:592) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1422) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1383) at org.eclipse.jface.viewers.AbstractTableViewer.inputChanged(AbstractTableViewer.java:590) at org.eclipse.jface.viewers.ContentViewer.setInput(ContentViewer.java:274) at org.eclipse.jface.viewers.StructuredViewer.setInput(StructuredViewer.java:1664) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnCompareTreeViewer.updateModelViewer(AnalysisColumnCompareTreeViewer.java:734) at org.talend.dataprofiler.core.ui.editor.composite.AbstractPagePart$2$1.run(AbstractPagePart.java:250) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) ... 44 more ",5 TDQ-5297,"open a window where the user can select the report he'd like to mass edit the datamart settings","The problem comes from TDQ-4774 , it may be problematic for users having a lot of reports when he/she wants to edit the datamart settings. In the preference page, add a button, when this button is clicked, opening a window where the user can select the report he'd like to mass edit the datamart settings.",13 TDQ-5298,"remove dependency org.talend.repository.mdm from org.talend.dataprofiler.core","On feature TDQ-1887 , this plugin is required. But now we won't need it any more. remove it from the dependency list and from feature.",2 TDQ-5299,"Enable the ""Create connection"" menu in TOS for DQ","The ""Create connection"" from a Catalog/schema item is currently only available in the Entreprise edition. Enable this menu in TOS for DQ too. ",3 TDQ-5314,"Remove the unecessary de-duplicate analysis creation wizard ","When the count of #Match is greater than the row count in DQ rule analysis, there is a context menu: ""simple analysis with join condition columns"", click it, there will be wizard to create an analysis. TODO: - Text ""simple analysis with join condition columns"" should be ""analyze duplicates"" - Wizard is not necessary, just creating an analysis with row count and duplicate count indicator completely.",13 TDQ-5315,"Add this link to studio bookmark","Add this link to studio bookmark: http://jira.talendforge.org/secure/IssueNavigator.jspa?mode=hide&requestId=12278",1 TDQ-5316,"Missing table size chart in overview report","The chart giving the repartition of the table sizes is missing in the new overview report. See attached picture or TDQ-3397 user story: for user, from the pie chart, can see the main tables(first 5 tables) which have more rows, and the other tables with a ""Others"" to do a description ",8 TDQ-5319,"report file can not generate succesfully which have set logo","1. create a report file set logon generate the report file, can not successfully get inform if the pic for the logo is in a path which contains chinese, will also get error",5 TDQ-5320,"Error running a report with phone number indicators","Create an analysis with all phone number statistics and java engine Create a report with a mysql storage. Execute the report. -> it fails: java.lang.NullPointerException at net.sf.jasperreports.engine.JRAbstractExporter.setJasperPrint(JRAbstractExporter.java:799) at net.sf.jasperreports.engine.JRAbstractExporter.setInput(JRAbstractExporter.java:867) at net.sf.jasperreports.engine.export.JRPdfExporter.exportReport(JRPdfExporter.java:260) at org.talend.dataquality.reporting.JasperReportBuilder.run(JasperReportBuilder.java:277) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generateReport(ReportDocGenerator.java:523) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generateDoc(ReportDocGenerator.java:257) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:164) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:117) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) ",2 TDQ-5321,"Several menus don't work in QBE","In the DQ Portal, go into QBE and run a query. Click on the save button. -> catalina.out it.eng.spagobi.engines.qbe.services.core.ServiceExceptionAction.logError: KO it.eng.spagobi.engines.qbe.services.core.ServiceExceptionAction.logError: The error root cause is: KO it.eng.spagobi.engines.qbe.services.core.ServiceExceptionAction.logError: The error root cause stack trace is: it.eng.spagobi.engines.qbe.services.core.ServiceExceptionAction.logError: The error full stack trace is: it.eng.spagobi.utilities.engines.SpagoBIEngineServiceException: KO at it.eng.spagobi.engines.qbe.services.core.catalogue.SaveAnalysisStateAction.service(SaveAnalysisStateAction.java:94) at it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) at it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) at it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:488) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at it.eng.spagobi.utilities.filters.SpagoBIAccessFilter.doFilter(SpagoBIAccessFilter.java:200) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at it.eng.spagobi.utilities.filters.EngineCheckSessionFilter.doFilter(EngineCheckSessionFilter.java:86) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) at java.lang.Thread.run(Thread.java:679) ",8 TDQ-5327,"Rename ""Po05 Column wrang size.jrmxl"" to ""Po05 Column size.jrxml""","Rename the report: (""wrang"" is not an English word. Remove it) See pic.",2 TDQ-5328,"No column size analysis is never available in DQ portal","Execute textual analyses in the studio (text indicators). Go in the dq portal and try to execute the ""column size analysis"" report. The list is always empty. There is no way to do a column size analysis. See pic. ",3 TDQ-5329,"Eclipse File association does not work anymore with the content of the DQ repository view","I used to go in the preference page and add a file association so that all *.pdf files are open with okular (linux pdf viewer). Now, when I do that, it is not taken into account. The double click on a generated pdf report is opened with another tool. (Note: the file association still work with jrxml file)",13 TDQ-5330,"Configuration wizard of tMatchGroup does not work if it is used after tRecordMatching","cf attached job",13 TDQ-5334,"migrate the file from one svn server to another with Repository manager can not logon the new project successfully","1. create a remote project with server 1(svn and tac both on server1) 2. try to use Repository manager(1.1.0) to migrate the file to server 2(same tac version). 3. I just migrate dbconnections, analysis and indicator and patterns. try to logon the project on server 2. the Libraries can not initialized successfully. check the svn folder just indicator and pattern show refer to pic attached.",13 TDQ-5341,"import pattern from exchange, the folder is incorrect","import a pattern in exchange, for eg: FR Phone Number (parenthesis allowed) the folder will be ... take a look at the screen shot.",8 TDQ-5342,"Change the Display of the user defined jrxml path in the report editor","The display of the path should not be the full relative path. It should be the same display as in the repository view. See pic",8 TDQ-5343,"for try to add a more table to table analysis, the original rule for the table lost","1. create a table rule analysis, add a table and a rule. 2. try to add another table to the table analysis by click the link ""Select table/views to analyze"" result: the second table added, but the rule have been added for the first table lose.",8 TDQ-5346,"file connection with context, set the first line as columns name -- failed to find the value of which one is set to be header","create a file connection with context if set the first line as the columns name, while run analysis, failed to convert data java.lang.NumberFormatException: For input string: ""context.a2_Header"" at java.lang.NumberFormatException.forInputString(Unknown Source) at java.lang.Integer.parseInt(Unknown Source) at java.lang.Integer.parseInt(Unknown Source) at org.talend.dq.indicators.DelimitedFileIndicatorEvaluator.executeSqlQuery(DelimitedFileIndicatorEvaluator.java:121) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:121) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:181) at org.talend.dq.analysis.DelimitedFileAnalysisExecutor.runAnalysis(DelimitedFileAnalysisExecutor.java:67) at org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:111) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:154) at org.talend.dataprofiler.core.ui.action.actions.AnalysisExecutorThread.run(AnalysisExecutorThread.java:86) at java.lang.Thread.run(Unknown Source) ",5 TDQ-5356,"when export/import an report file which depend on JRXML template can not show the dependency inforcorrectly.","1. try to export/import report file. 2. uncheck the jrxml file which the report file depend on. check the inform information, it is not correct. should show the jrxml template name.",5 TDQ-5357,"""Frequency Table"" indicator is same to ""Year Frequency Table"" when applying on ""Time"" type?","For the DB2 columns which has ""Time"" data type, the ""Frequency Table"" indicator is same to ""Year Frequency Table"" when applying on ""Time"" type, that's wrong.",8 TDQ-5359,"do empty recycle bin under DI get error when db depend by analysis","1. create dbconnection, file connection, mdm connection. 2. create column analysis about these connections. 3. delete dbconnection to Recycle bin. 4. turn to DI perspective, try to delete the dbconnection by right click it, work well-- get inform dbconnection is depended . try to ""Empty recycle bin"", only one inform (The selected element(s) will be deleted forever (cannot be retrieved). Continue anyway?), click yes get error; there should be inform information : some items is depended by others, can not deleted. issue 2: re-do step 3 and 4, for file and mdm connection, connections will be deleted forever, analysis unavailable for issue 2 also reproduce on branch 4.2 and 5.0",13 TDQ-5361,"reload column list function will multiply the columns number","1. select a table unfold to columns, check the column show correctly. 2. reload column list, the number will be twice. 3. redo reload the number will be 3 times of the original ones. 4. create a column analysis by right click the table the rows will be 3 times in the analysis.",3 TDQ-5362,"column/column set analysis editor can not be shown correctly after switching the context of file connection","1. create a column/column set analysis about file connection which has been export as context. 2. do ""switch context"" for the file connection, select a different schema file to check the switch function. but nothing changed in the Repository. should we do some reload when switching? then, I have to right click ""Metadata""->edit schema to get the changes. 4. try to open column and column set analysis both get error. for column analysis can not shot the editor correctly. refer to pic, for column set in the editor show ""Could not open the editor: An unexpected exception was thrown."" because the schema have change to different, so analysis can be lost their items but should be open correctly. if change to a same schema file, the analysis should work well, right(I didn't test it on this bug)? ",13 TDQ-5368,"Dependency handling has some problem when import by button","issue 1: 1).import some items by button. 2).there is error message about missing dependcy(see detail with pic1),but the related analysis of report ""columnJTxml"" is in the tree,it is ""column"" analysis. issue2: 1).uncheck a reprot ""column"".(see detail with pic2,pic3) 2).the related analysis ""column"" and the related connection ""oracle"" are unchecked.so that, has a another error message about missing ""oracle"" connection.",13 TDQ-5369,"preview a table in sybase connection, will throw an error","In repository, right click on a table and do preview operation will get this error org.eclipse.swt.SWTException: Failed to execute runnable (java.lang.IllegalArgumentException: Index out of bounds) at org.eclipse.swt.SWT.error(SWT.java:4083) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:137) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) Caused by: java.lang.IllegalArgumentException: Index out of bounds at org.eclipse.swt.SWT.error(SWT.java:4064) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.SWT.error(SWT.java:3969) at org.eclipse.swt.custom.StyledText.getOffsetAtLine(StyledText.java:4357) at net.sourceforge.sqlexplorer.plugin.editors.SQLEditor.setCursorPosition(SQLEditor.java:1017) at net.sourceforge.sqlexplorer.sqlpanel.AbstractSQLExecution$1.run(AbstractSQLExecution.java:255) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) ... 22 more ",8 TDQ-5370,"some indicators are disabled for ""text"" data type in Mysql","1.create an anlysis with ""text"" data type of Mysql. 2.some indicators are grayed.(.e.g,just Row Indcator is enable for simple statistic indicator) ",8 TDQ-5376,"open about 60 analysis, get no more handles error.","have about 60 analysis, and open one by one, keep them open, at last get error, refer to the attached log.",13 TDQ-5381,"unrecognized median indicator definition","See attached picture.",8 TDQ-5382,"Export babili translations into trunk of SVN",NULL,2 TDQ-5384,"Rule name of tRuleSurvivorship are restricted","tRuleSurvivorship generates drools resources into DI repository, the file name is the same as that of the rule and the type is TDQFileItem. If i create a rule named ""1_FirstRule"", it worked before, but now it is not valid any more according to the file name regex during the creation. ",13 TDQ-5386,"select mysql ,orale and hsql as report db, generate report file is disabled","Message:2012-05-17 10:48:13,359 ERROR org.talend.dq.persistence.DatabasePersistence - org.hibernate.exception.SQLGrammarException: Cannot open connection Exception Stack Trace:org.hibernate.exception.GenericJDBCException: Cannot open connection at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103) at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91) at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43) at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29) at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:420) at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:144) at org.hibernate.jdbc.JDBCContext.connection(JDBCContext.java:119) at org.hibernate.transaction.JDBCTransaction.begin(JDBCTransaction.java:57) at org.hibernate.impl.SessionImpl.beginTransaction(SessionImpl.java:1326) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.hibernate.context.ThreadLocalSessionContext$TransactionProtectionWrapper.invoke(ThreadLocalSessionContext.java:301) at $Proxy29.beginTransaction(Unknown Source) at org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:120) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.historizeData(ReportDocGenerator.java:310) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:159) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:117) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.sql.SQLException: Listener refused the connection with the following error: ORA-12505, TNS:listener does not currently know of SID given in connect descriptor The Connection descriptor used by the client was: 192.168.30.87:1521:rootroot at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:261) at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:387) at oracle.jdbc.driver.PhysicalConnection.(PhysicalConnection.java:441) at oracle.jdbc.driver.T4CConnection.(T4CConnection.java:165) at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35) at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:801) at java.sql.DriverManager.getConnection(Unknown Source) at java.sql.DriverManager.getConnection(Unknown Source) at org.hibernate.connection.DriverManagerConnectionProvider.getConnection(DriverManagerConnectionProvider.java:110) at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:417) ... 15 more",2 TDQ-5387,"unselected columns be added to the analysis when use Column Selection Dialog to select columns",NULL,5 TDQ-5388,"when use the wizard to create analysis, the created one should be the ""saved"" status","when use the three menus(look at the screenshot) to create analysis, the created one should be saved status(use the other menus created is saved status)",5 TDQ-5389,"Test source file cheat sheet failed","Message:The action could not be run because an instance of the class 'org.talend.dataprofiler.core.sql.AddSqlFileAction' could not be created. Exception Stack Trace: java.lang.IllegalAccessException: Class org.eclipse.ui.internal.cheatsheets.ActionRunner can not access a member of class org.talend.dataprofiler.core.sql.AddSqlFileAction with modifiers ""private"" at sun.reflect.Reflection.ensureMemberAccess(Unknown Source) at java.lang.Class.newInstance0(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.eclipse.ui.internal.cheatsheets.ActionRunner.runAction(ActionRunner.java:50) at org.eclipse.ui.internal.cheatsheets.data.Action.execute(Action.java:100) at org.eclipse.ui.internal.cheatsheets.views.CoreItem.runExecutable(CoreItem.java:506) at org.eclipse.ui.internal.cheatsheets.views.CoreItem.runExecutable(CoreItem.java:501) at org.eclipse.ui.internal.cheatsheets.views.CheatSheetViewer.runPerformExecutable(CheatSheetViewer.java:1046) at org.eclipse.ui.internal.cheatsheets.views.CoreItem$1.linkActivated(CoreItem.java:89) at org.eclipse.ui.forms.widgets.AbstractHyperlink.handleActivate(AbstractHyperlink.java:233) at org.eclipse.ui.forms.widgets.ImageHyperlink.handleActivate(ImageHyperlink.java:199) at org.eclipse.ui.forms.widgets.AbstractHyperlink.handleMouseUp(AbstractHyperlink.java:327) at org.eclipse.ui.forms.widgets.AbstractHyperlink.access$2(AbstractHyperlink.java:311) at org.eclipse.ui.forms.widgets.AbstractHyperlink$4.handleEvent(AbstractHyperlink.java:125) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.swtbot.eclipse.core.UITestApplication.start(UITestApplication.java:54) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",5 TDQ-5391,"duplicate a jrxml file, throw exceptions","java.lang.NullPointerException at org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.getSelctionNode(DuplicateAction.java:241) at org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.selectAndReveal(DuplicateAction.java:205) at org.talend.dataprofiler.core.ui.action.actions.DuplicateAction.run(DuplicateAction.java:137) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:126) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",5 TDQ-5392,"Implement the rename, move functions on jrxml files and the folders which under ""JRXML Template""","right click on the folders which under ""JRXML Template"", show the ""Rename""/""Delete"" menus right click on the jrxml files which under ""JRXML Template"", show the ""Rename""/""Delete"" menus Actions to implement: 1. delete files/folders: list the reports which use the jrxml files: 1) cancel; 2) delete the jrxml files only AND update reports with the basic jrxml configuration 3) delete the jrxml files and reports which use them 2. rename, move and drag files/folder: list the reports which use the jrxml files: 1) cancel; 2) yes, update the reports which use them",5 TDQ-5393,"the result of report are different between studio and dq portal","err_a Summary Statistics in studio, but Simple Statistics in dqportal err_b Phone Number Statistics in studio，but Simple Statistics in dqportal err_c Text Statistics in studio，but Simple Statistics in dqportal，some Indicator Values are different with the values in Studio",20 TDQ-5394,"Impossible to delete an empty folder in DQ perspective from recycle bin.","Impossible to delete an empty folder in DQ perspective from recycle bin. Tried only on SVN, not sure it's also on local... Note that i didn't try with items inside the folder...",8 TDQ-5395,"[SVN Repository] Errors when rename a folder which have at least subfolder inside","Errors when rename a folder which have at least subfolder inside. Tried this when modifying the basic repository rename folder functions from TDI-21200. But finally when rename a folder this code is not even called it seems. => As explained in the steps, it can make the view totally be empty",13 TDQ-5396,"DQ Report Generator Uses 32 bit Engine even in 64 Bit Studio","A job that is created for a DQ report generates a tLaunchDQReports component with a default value of Talend-Studio-win32-x86.exe even for a 64 bit Studio. When run Studio says it cannot find the jni dll because it is the wrong version, 32 bit rather than 64 bit. Workaround: manually change the value to the correct 64 bit engine.",2 TDQ-5397,"Data viewer in TOS profiler export of valid/invalid rows fails for Chinese characters","• Data viewer and export of valid/invalid rows doesn't work for Chinese characters. The quality check works (for example if I specify that Country = '??' as the clause, it gives me the right % of valid/invalid, but when I export the rows to view them, it's garbage.) I've tried the following connection strings with no luck: jdbc:jtds:sqlserver://localhost:1433/TestDB;characterEncoding=utf-8 jdbc:jtds:sqlserver://localhost:1433/TestDB;characterEncoding=utf8 ",2 TDQ-5405,"Unnecessary page in the new time analysis wizard (branch 4.2)","Issue cloned from TDQ-4755 for branch 4.2",3 TDQ-5406,"config oracle database for the report, if don't input the schema of the oracle, check it is ok, when run the report will get exceptions","org.hibernate.exception.SQLGrammarException: could not execute query at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:67) at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43) at org.hibernate.loader.Loader.doList(Loader.java:2147) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2028) at org.hibernate.loader.Loader.list(Loader.java:2023) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:393) at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338) at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172) at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121) at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79) at org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.getCachedTdqAnalysis(AbstractPersistenceHandler.java:182) at org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.persist(AbstractPersistenceHandler.java:144) at org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:121) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.historizeData(ReportDocGenerator.java:310) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:159) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:117) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.sql.SQLException: ORA-00903: invalid table name at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112) at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:331) at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:288) at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:745) at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:219) at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:813) at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1049) at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:854) at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1154) at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3370) at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3415) at org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:186) at org.hibernate.loader.Loader.getResultSet(Loader.java:1668) at org.hibernate.loader.Loader.doQuery(Loader.java:662) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224) at org.hibernate.loader.Loader.doList(Loader.java:2144) ... 14 more ",5 TDQ-5407,"About Installer in the Ubuntu 10 64bit can't show DQ rules and Potential PK report .",NULL,8 TDQ-5408,"DB version is missing in Details View for all kinds of databases",NULL,3 TDQ-5409,"Resize indicator text field","The text indicators' label is truncated in the generated report. See screen capture.",8 TDQ-5425,"Resolve all failed tests on 5.0",NULL,3 TDQ-5429,"Border of connection selection comb widget is too thick","See the attached screenshot.",5 TDQ-5430,"for mssql all the catalogs get the same schemas when doesn't set the database filter","1. create a mssql connection (in the wizard select ""Microsoft SQL Server"") 2. check the schema under each catalog. all show same schemas, in fact I create different ones under each. ",13 TDQ-5431,"Wrong label: ""Foramt Frqe""","See the pic in attachment.",2 TDQ-5435,"when I edit a source file, the save status is not changed",NULL,13 TDQ-5436,"got exceptions when empty the recycle bin","java.lang.IllegalArgumentException: Path must include project and resource name: / at org.eclipse.core.runtime.Assert.isLegal(Assert.java:63) at org.eclipse.core.internal.resources.Workspace.newResource(Workspace.java:1801) at org.eclipse.core.internal.resources.Container.getFile(Container.java:207) at org.talend.dq.helper.PropertyHelper.getItemFile(PropertyHelper.java:385) at org.talend.dq.helper.DQDeleteHelper.deleteRelations(DQDeleteHelper.java:50) at org.talend.dataprofiler.core.ui.action.actions.DQEmptyRecycleBinAction.doRun(DQEmptyRecycleBinAction.java:148) at org.talend.repository.ui.actions.AContextualAction$2.run(AContextualAction.java:562) at org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:84) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:217) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:2643) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1767) at org.talend.repository.ui.actions.AContextualAction.run(AContextualAction.java:567) at org.talend.dataprofiler.core.ui.action.actions.DQEmptyRecycleBinAction.run(DQEmptyRecycleBinAction.java:94) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",8 TDQ-5437,"DQ report: Pattern matching chart is empty","See the attachment screenshot. I also uploaded the analyses and report. for another issue, when set threshold for percentage, and out of threshold, can not show the percentage data. refer to the pic.",5 TDQ-5438,"DQ report only one column shown to me when I have 4 in column_set report","See the screenshot",5 TDQ-5440,"Help page content does not change according to the indicator selection","in the indicator selection window. ",8 TDQ-5441,"for some dqportal template can not restrieve data which just insert to the datamart","1. I just install the dqportal with a new configure and datamart. 2. insert data to the datamart, 3. start up dqportal to view data by the template for some just can retrieve the report name, try to visit the detail content in the file,nothing show. just change the Os time to later, then all can get content. for template have this issue: 1. simple evolution can not show(all simple basic is ok), 2. function dependency basic and evolution can not show. 3. dqrule evolution. 4. column set basic and evolution 5. Redundancy basic and evolution 6. overview analysis-> basic and evolution besides column set basic the can only show the last one executed. what about branch, no build test now, if have, please also make it work well.",5 TDQ-5445,"Reduce memory consumption of tRuleSurvivorship runtime",NULL,5 TDQ-5446,"Check datamart without saving the report won't check the correct datamart","- Take a new studio. - Create a connection, an analysis and a report (don't run the report). - The datamart in the report is set to HSQL by default. - Change the configuration to MysqL or Oracle (don't save the report editor) - click on ""Check"" in order to check the connection It will check and create the HSQL datamart, but not the mysql datamart. That's not correct, it should check the values set by the user. ",8 TDQ-5447,"DQ Portal [Fatal Error] :2:1: Content is not allowed in prolog",NULL,13 TDQ-5448,"System Indicators and UDI indicators are mixed in the generated report","Create a column analysis with the BenfordLaw_sql indicator. Create a report and run it. The generated report mixes the indicators. It should not. See previous reports (in 5.0). Attached: the project items and the generated pdf.",8 TDQ-5449,"Item lock issues in DQ profiler ",NULL,20 TDQ-5450,"disable ""Unlock element"" menu when corresponding editor is open as in DI repository",NULL,8 TDQ-5453,"sql source file does not exist after I click on save action","I did a preview on a table then I click on the save button of the sql editor. The first time, the editor is saved with the name ""SourceFile"" Repeat the operation, and save the editor. A pop-up says that the filename already exists and suggests a new file name. Click ok, then you got an empty editor (see screen captures). Actually, the new file should be kept opened in the editor just like when you do ""save as..."" in any application! More over, the files are not saved!",2 TDQ-5454,"No cheat sheet open when I start TOS DQ","When I start TOS DQ and close the welcome page with the close button (not with the ""Start"" in the web page), then the cheat sheets view is open but it is empty. ",8 TDQ-5455,"Look and feel improvements for DQ reports of functional dependancy analysis","see attached screenshot",5 TDQ-5458,"Ignore default report generation folders as well as the symbolic links to avoid svn error","DQ reports are generated into a default folder next to the report definition file, when the generation path is not specified. My project is remote, after generation of reports, I clicked at the ""Visualize"" button, and have got the following SVN exception: {code} 9697297 [Worker-63] INFO org.talend.dataprofiler.core.tdq.action.ReportDocGenerator - Report ""compare"" generated. org.talend.commons.exception.PersistenceException: org.tigris.subversion.javahl.ClientException: svn: '/opt/Talend-Studio-r84018-V5.1.1NB/workspace/DQ/TDQ_Data Profiling/Reports/.compare_0' is not a working copy org.talend.repository.svnprovider.SvnEclipseHandler.add(SvnEclipseHandler.java:396) org.talend.repository.svnprovider.SvnResourceChangeListener.visit(SvnResourceChangeListener.java:78) org.eclipse.core.internal.events.ResourceDelta.accept(ResourceDelta.java:68) org.eclipse.core.internal.events.ResourceDelta.accept(ResourceDelta.java:79) org.eclipse.core.internal.events.ResourceDelta.accept(ResourceDelta.java:79) org.eclipse.core.internal.events.ResourceDelta.accept(ResourceDelta.java:48) org.talend.repository.svnprovider.SvnResourceChangeListener.resourceChanged(SvnResourceChangeListener.java:40) org.eclipse.core.internal.events.NotificationManager$2.run(NotificationManager.java:291) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.core.internal.events.NotificationManager.notify(NotificationManager.java:285) {code} where ""compare"" is the name of my report, and "".compare_0"" is the default folder for reports. The svn:ignore property should be added to this kind of folders to avoid this exception.",8 TDQ-5466,"for the remove duplicate job can not run correctly for db2connection","1. create a column analysis 2. select simple statistics,run 3. on result page, right click ""distinct/duplicate/unique"" indicator, get ""remove duplicate"" the job generated, but run failed, check the output component, no data set. refer to pic.",8 TDQ-5467,"if the column/Table view filter doesn't filter the column/table used by function analysis, function anlaysis can not be used ","1. create a dbconnection 2. create a function analysis about Tablea, column1, column2. 3. right click ""Tablea"" under the dbconnceion->column filter,in the pop up dialog set ""column3"" as ""column filter"" value. 4. try to open the function analysis, can not ",5 TDQ-5468,"drag a source file, the file lost it's content",NULL,8 TDQ-5470,"update related TUJ following the changes in TDQ-5205",NULL,1 TDQ-5479,"Create a JUDI for email validation","Create a JUDI to check emails (see code samples at http://www.rgagnon.com/javadetails/java-0452.html )",8 TDQ-5482,"add overwrite confirmation for save action with ""apply for all files"" checkbox",NULL,13 TDQ-5485,"Add an option to enable fuzzy search for tStandardizeRow component",NULL,20 TDQ-5488,"when import a zip file, get two errors","1. import the zip file in TDQ-5437 2. in the dialog, select ""Overwrite exsiting items"" checkbox there are 2 issues: issue 1: when open analysis, the diaplay is error(see screenshot) issue 2: the pattern/indicator tree display is incorrect I think(see screenshot)",8 TDQ-5489,"NPE while opening analyzed elements on CE version","NPE throws out,see my attachment {noformat}java.lang.NullPointerException at org.talend.cwm.helper.SubItemHelper.isDeleted(Unknown Source) at org.talend.core.repository.model.ProxyRepositoryFactory.getStatus(Unknown Source) at org.talend.dataprofiler.core.ui.views.provider.DQRepositoryViewLabelProvider.getImage(Unknown Source) at org.eclipse.ui.internal.navigator.extensions.SafeDelegateCommonLabelProvider.getImage(SafeDelegateCommonLabelProvider.java:106) at org.eclipse.ui.internal.navigator.NavigatorContentServiceLabelProvider.findImage(NavigatorContentServiceLabelProvider.java:197) at org.eclipse.ui.internal.navigator.NavigatorContentServiceLabelProvider.getColumnImage(NavigatorContentServiceLabelProvider.java:105) at org.eclipse.ui.internal.navigator.NavigatorContentServiceLabelProvider.getImage(NavigatorContentServiceLabelProvider.java:98) at org.eclipse.ui.internal.navigator.NavigatorDecoratingLabelProvider$StyledLabelProviderAdapter.getImage(NavigatorDecoratingLabelProvider.java:60) at org.eclipse.jface.viewers.DelegatingStyledCellLabelProvider.getImage(DelegatingStyledCellLabelProvider.java:184) at org.eclipse.jface.viewers.DecoratingStyledCellLabelProvider.getImage(DecoratingStyledCellLabelProvider.java:167) at org.eclipse.ui.navigator.CommonNavigatorManager.updateStatusBar(CommonNavigatorManager.java:308) at org.eclipse.ui.navigator.CommonNavigatorManager$1.selectionChanged(CommonNavigatorManager.java:74) at org.eclipse.jface.viewers.StructuredViewer$3.run(StructuredViewer.java:867) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.internal.JFaceUtil$1.run(JFaceUtil.java:49) at org.eclipse.jface.util.SafeRunnable.run(SafeRunnable.java:175) at org.eclipse.jface.viewers.StructuredViewer.firePostSelectionChanged(StructuredViewer.java:865) at org.eclipse.jface.viewers.StructuredViewer.handlePostSelect(StructuredViewer.java:1205) at org.eclipse.ui.navigator.CommonViewer.handlePostSelect(CommonViewer.java:470) at org.eclipse.jface.viewers.StructuredViewer$5.widgetSelected(StructuredViewer.java:1230) at org.eclipse.jface.util.OpenStrategy.firePostSelectionEvent(OpenStrategy.java:251) at org.eclipse.jface.util.OpenStrategy.access$5(OpenStrategy.java:245) at org.eclipse.jface.util.OpenStrategy$3.run(OpenStrategy.java:419) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) {noformat}",5 TDQ-5500,"After edit the user define indicator, should automatically update the related analysis","1. create a analysis, and add a UDI (e.g: user define match) 2. edit the sql of the UDI 3. run the analysis, remain used the old sql of UDI note: should make all the 4 type of UDI work well",8 TDQ-5501,"evolution result for pattern is not correct.","1. create a report file which depends on a column analysis which used pattern. 2. generate the report file with basic type. 3. generate the report file with evolution type check the evolution result: the pattern show as pic, but I doesn't change the data in my database.",13 TDQ-5502,"the Link with editor works failed for user defined indicators","I created user defined indicators Then, I selected the ""link with editor"" button. It does not link anything. Even when I focus on the editor.",8 TDQ-5503,"column analysis can not run well about sqlserlvler dbconnection with java engine","1. try to run colulmn/column set analysis about sqlserver dbconnection with java engine failed. error under Details tab",13 TDQ-5516,"do migration for 503 get some redudant indicators.","1. try to import 423 file by import button (select root directory) 2. after migration finished, (1) all my analysis in folder, now the folders missing, so analysis unavailable for which belong to folders original (2) indicator show as pic why, (3) udi lost, my created pattern also disappear, (4) UDI and pattern in my analysis show as ""unknow indicator""",5 TDQ-5520,"The Data Profile export process does not export the analysis","I have exported some analysis from TOS DQ 5.0.2 and tried to import them into TOS DQ 5.1 and they do not import correctly. All of the related items do import, but not the analysis. See the attached document.",8 TDQ-5529,"import items from 4.1.3 to 4.2.4, miss analysis and report","open TDQEE 4.2.4 and import the ""413MIGRATIONORALCE.zip"" into it, in the import dialog, don't show the analysis and report, see screenshot ""aaa1.png"" click ""finish"" to import other items found there have error message in the log file, see "".log""",8 TDQ-5530,"Wrong icon and text in the warning dialog when doing a nominal value analysis","Do a right click on two columns of a file delimited connection and select ""Column > nominal value analysis"". One of the column is of type ""nominal"" (text, varchar, ...) and the other column is of type ""interval"" (int, double...) See attached screen capture. The icon and text should have the same look&feel as in the DQ repository view. (Note that there is no problem by doing the same actions on database columns)",5 TDQ-5531,"Time Analysis generated from contextual menu is not correct.","The generated analysis' type is Column Analysis. The selected column is not shown in the configuration page. ",8 TDQ-5534,"Generated ""View table"" query does not work with SQL Server 2008","see attached screenshot, the error message reads ""Invalid object name 'root_db.dbo.Table_ABC'"" in English. It was actually not a problem of identifier quotes, but the name of the schema ""dbo"", which should be ""ABC"" (a user schema) in my case. Therefore, this issue must be related to JTDS driver and maybe recent changes in TDQ-4884.",8 TDQ-5537,"Path wrong when drag a pattern to a subfolder","When I drag a pattern in to a subfolder under Patter/Regex, It can set the path in the property file correctly, but if I drag a pattern folder, each pattern property file will set a wrong path -- ignore the pattern root folder. Example: Drag a folder Code/codePattern.pattern into a subfolder Talend, the path of codePattern changed from Regex/Code to Talend/Code, but it should be Regex/Talend/Code",13 TDQ-5555,"Move the indicator category section before the indicator definition section",NULL,1 TDQ-5558,"some issues about rename a folder under Patterns/Regex","issue 1: right click on a folder under Patterns/Regex and click ""Rename Folder"", show a dialog, but the folder name is empty, it should be the current name of the folder issue 2: when you input a new name for the folder and click ok, it will cost a long time(more than one minute) to finish the rename folder action, and the more pattern files which the folder include the more time will be cost the folder under Patterns/SQL have the same issues drag&drop folders have the same issues other folders need to be checked also",8 TDQ-5562,"Backport: from trunk to branch 5.0 for the commits on TDQ-5104",NULL,13 TDQ-5568,"import a zip file from 413 version, when delete/remove a source file, get error","issue1: when delete a source file, see the navigate view, the .sql file still there issue2: when move a source file to another folder, see the navigate view, the .sql file is not moved. and open the source file will get error",8 TDQ-5570,"Export and import a tStandardizeRow job with routines into a differently named project, fail to run it without regenerating the routine file.","The reason is that the name of the generated routine includes the original project name, but the new project uses the current project name to generate job code. TODO: remove the project name part from both the routine generation and its usage in the component.",2 TDQ-5572,"use the menu to create analysis, but after finished, the created analysis is not shown in the DQ Repository view","use the menus to create analysis(look at the screenshot), but after the created analysis is not shown in the DQ Repository view, should refresh note: seems use the other menu, also can reproduce this, we should make all of them can work well",3 TDQ-5577,"save failed about edit a system indicator","1.Unfold the ""Libraries/Indicators/System"" in the DQ Repository view 2.Double-click on ""Simple Statistics/Distinct Count"" indicator 3.Change the text in the description field, save and close 4.reopen the same indicator in the third step ,save failed. you can refer to the screenshot ""saveFailed.png"" of attachment",8 TDQ-5579,"Wrong popup: ""Adaptive Server Enterprise | Syabase Adaptive Server IQ is repeated"" when saving the ind def editor","Wrong popup: ""Adaptive Server Enterprise | Syabase Adaptive Server IQ is repeated"" when saving the ind def editor after modify the ""description"" field.",5 TDQ-5581,"dependency will lost after click delete label on the analysisColumnTree and don't save it.","dependency will lost after click delete label on the analysisColumnTree and don't save it.",5 TDQ-5589,"Check all DQ repository actions with a remote connection","Pay attention to lock status (local lock + remote lock) of repository nodes when 2 or more users are connected. Check also whether the files are properly updated on svn server. Note: svn logs can be activated by adding ""--talendDebug"" option into ""Program arguments"". ",8 TDQ-5592,"delete a folder which contain a locked file need a message to explain the result","tell the user why the delete operation is invalid.",5 TDQ-5601,"""reload column"" failed after the connection is export",NULL,8 TDQ-5602,"I cannot select text statistics indicators any more after import my project ""TEST2""","Open the analysis ""column analysis summary st"" to reproduce. The project ""TEST2"" can be download from this link: http://jira.talendforge.org/secure/attachment/45132/TEST2.zip",8 TDQ-5606,"tGenKey's ""View Key Profile"" seems to be limited to ~20k rows","It looks like there's a hard limit to the ""View Key Profile"" option of tGenKey component, limiting the amount of rows to process to something like 20k. Even though there's a textbox to set a custom limit, it looks like it doesn't work in 5.0.2.",8 TDQ-5611,"Create a TUJ for TDQ-4950",NULL,2 TDQ-5612,"Long response delay for some operations in DQ repository via remote connection","such as ""rename folder name"" action",2 TDQ-5613,"When rename a folder containing a locked analysis, the analysis disappears","The rename action is composed by 3 actions: 1. create folder with new name 2. copy contents to new folder 3. delete folder with old name the copy step is blocked by the lock, but the delete step is still processed. That's why we will get an empty folder with new name.",3 TDQ-5614,"add a dialog to tell user that ""the folder containing locked items cannot be moved""",NULL,1 TDQ-5616,"when genereate a job by drill down of phone number indicator ,get errors.","1. create a column analysis 2. select phone number indicators 3. run,on result page drill down on the phone number indicator expect valid/invalid region code count. select ""Generate a standardization phone number job"" get errors, but the job can run successfully.",13 TDQ-5627,"File connection with context, if revert context and export again run analysis can not get data","a file connection with context edit the connection, revert the context and export the context again run the analysis cannot get result ",8 TDQ-5629,"Overview report not available in DQ Portal","I generate a report in the studio. It's ok in the studio. But I cannot find it in the DQ portal. See attached talend_dq dump. See attached items. ",8 TDQ-5630,"Analyzed columns limit doesn't work, while create analysis by right click columns in repository","set the analyzed columns limit value -- like: 3 expand a created connection select some columns in repository more than the set value -- like: 4 then the analysis with 4 columns created and worked, this should not be. and another one as now the columns in analysis has pages, default is 5 per page if set the limit value as 6 or bigger than 6 then can drag columns into analysis editor with no limit",8 TDQ-5632,"fix the test classes that run as application","it seems that the following classes are not junit test classes: DBViewer RunDBConnect DataPatternMatchingTest AnalysisCreationTest ConnectionAnalysisCreationTest MoveProviderTest MultiColAnalysisCreationTest MultiNominalColAnalysisTest PatternTest MyFirstTest MyFullDemo ConnectionIndicEvalMain IndicatorEvaluationMain LoadSerialData BubbleChartTest MultiColAnalysisCreationTest",13 TDQ-5634,"Upgrade Drools to the lastest stable version (Step 1)","More and more users pass to Java7. However, Drools 5.2 (currently integrated in our products) is not fully compatible with it.",2 TDQ-5637,"Remove duplicated MessagesCore classes","use DefaultMessagesImpl instead in each plugin, and let them extend ""org.talend.commons.i18n.MessageCore"" Duplications of MessagesCore class are found in the following plugins: org.talend.dataprofiler.core org.talend.dataquality org.talend.cwm.management org.talend.datacleansing.core org.talend.dataquality.matching org.talend.dataquality.reporting org.talend.dataquality.standardization",8 TDQ-5641,"Import of metadata from previous version crashes 5.1.1 Profiler","I newly installed Talend Big Data Edition for MDM release 5.1.1. After importing metadata (flat files and database connections) my profiler crashed ",8 TDQ-5645,"Column analysis does not pick the right pattern to apply with Oracle DB","In one of my pattern indicator, I have a regex in Default type and a different regex in Oracle type. When I use this indicator to profile a column in my Oracle DB, the one in Oracle type is not always applied. It seems the regex to apply depends on the order of the list. If the Default regex is placed before the one for Oracle, then the Default one is applied.",8 TDQ-5646,"Icons are missing in conflict dialog when I connect to remote repository.","When I connect to a remote repository, if there are svn conflicts, icons are missing for all DQ items, and some texts are not translated. see screenshot",8 TDQ-5650,"no error message when regex is invalid in the Pattern test view (Java engine)","regex is '^(0033|\\\\+\\\\(?33\\\\)?|0)[ ]?[1-689]([-. ]?[0-9]{2}){4}$' Try to input ""06 63 36 96 36"" and click on test nothing happens. An exception appears in the error log. See below. This exception should be displayed to the user so that he can know that his regex is invalid. java.util.regex.PatternSyntaxException: Unknown inline modifier near index 18 ^(0033|\\\\+\\\\(?33\\\\)?|0)[ ]?[1-689]([-. ]?[0-9]{2}){4}$ ^ at java.util.regex.Pattern.error(Pattern.java:1713) at java.util.regex.Pattern.group0(Pattern.java:2519) at java.util.regex.Pattern.sequence(Pattern.java:1806) at java.util.regex.Pattern.expr(Pattern.java:1752) at java.util.regex.Pattern.group0(Pattern.java:2530) at java.util.regex.Pattern.sequence(Pattern.java:1806) at java.util.regex.Pattern.expr(Pattern.java:1752) at java.util.regex.Pattern.compile(Pattern.java:1460) at java.util.regex.Pattern.(Pattern.java:1133) at java.util.regex.Pattern.compile(Pattern.java:823) at org.talend.dataprofiler.core.ui.views.PatternTestView.testRegularText(PatternTestView.java:447) at org.talend.dataprofiler.core.ui.views.PatternTestView.access$0(PatternTestView.java:440) at org.talend.dataprofiler.core.ui.views.PatternTestView$8.widgetSelected(PatternTestView.java:382) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:129) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",1 TDQ-5651,"Cannot save a pattern ","I have imported a pattern from Talend Exchange. I have tested it and then modified it in the pattern editor. When I click on save, I got the attached awful message and no error log message!",8 TDQ-5653,"Export babili translations into 5.0 branch",NULL,2 TDQ-5655,"Export babili translations into 5.1 branch",NULL,2 TDQ-5656,"Export babili translations into trunk of SVN",NULL,2 TDQ-5663,"report is different with analysis result.","report is different with analysis result.",8 TDQ-5664,"The menu ""Cheat Sheets..."" can't be found in the help's submenu",NULL,8 TDQ-5665,"check the report generation with exported script when the analysis is locked by another studio",NULL,1 TDQ-5668,"The display of connection URL string in connection editor is not correct in context mode","It should be the context string instead of real jdbc connection url, see the attachment screenshot. Another problem is that the URL and driver class name in item file didn't store as context pattern but as real string for the the normal databases, however, for generic JDBC connection, it's correct. ",8 TDQ-5676,"Create junits for BaseConnectionContextHelper","First, make sure that this class is used. Then create a junit.",1 TDQ-5688,"From the DQ repository tree view, cann't add a task to a column in a DB connection and to an item in an analysis","Before release 5.1, the user could add a task to a column in a database connection under the Metadata node in the DQ repository tree view if he right-click the column and select ""add task"". In release 5.1, the add task option is removed from the contextual menu (see attached capture) The ""add task"" option is also removed from the contextual menu of a column in an analysis in the DQ repository tree view (see attached capture).",5 TDQ-5690,"Ensure the quality of the DQ datamart","Phase 1. Use DQ analyses in order to ensure that the DQ datamart does not contain any data of bad quality. Two projects are required: 1. the first project will populate the datamart with all kinds of analyses (these analyses should apply on the TBI test database) 2. the second project will profile the datamart and apply several thresholds and rules in order to ensure the quality of the data stored in the datamart. These two projects already existed in version 3.2.2. Whenever a data of bad quality appears in the datamart, that means that there is a bug in the code. In phase 1, these 2 projects must be upgraded to the last version: 5.1.1. Phase 2: implement new constraints analyses on the datamart in order to check new indicators and new analyses that did not exist in 3.2. This phase is to be defined more precisely later. Phase 3: Process automation. In order to automate the process, the reports should be executed every day (via the tLaunchDqReport component or the exported script) and an email should be sent as soon as a problem of quality appears. If the component is used, then the job could become a TUJ. This phase is to be defined more precisely later. ",8 TDQ-5693,"Fix an error ""FileNotFoundException"" and Code refactoring","create a sql file, and modify its content create a folder, then move the file into folder will throw a file not found error: java.io.FileNotFoundException: Source 'E:\versions\TOS_DQ-r86341-V5.0.3NB\workspace\TOP_DEFAULT_PRJ\TDQ_Libraries\Source Files\SourceFile1_0.1.sql' does not exist at org.apache.commons.io.FileUtils.copyFile(FileUtils.java:636) at org.apache.commons.io.FileUtils.copyFileToDirectory(FileUtils.java:586) at org.apache.commons.io.FileUtils.copyFileToDirectory(FileUtils.java:557) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.moveSourceFileRepNode(Unknown Source) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.computeRepNodeType(Unknown Source) at org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.handleDrop(Unknown Source) at org.eclipse.ui.navigator.CommonDropAdapter$1.run(CommonDropAdapter.java:194) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.navigator.CommonDropAdapter.performDrop(CommonDropAdapter.java:184) at org.eclipse.jface.viewers.ViewerDropAdapter.drop(ViewerDropAdapter.java:276) at org.eclipse.ui.part.PluginDropAdapter.drop(PluginDropAdapter.java:69) at org.eclipse.swt.dnd.DNDListener.handleEvent(DNDListener.java:90) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:774) at org.eclipse.swt.dnd.DropTarget.Drop(DropTarget.java:456) at org.eclipse.swt.dnd.DropTarget$3.method6(DropTarget.java:258) at org.eclipse.swt.internal.ole.win32.COMObject.callback6(COMObject.java:119) at org.eclipse.swt.internal.ole.win32.COM.DoDragDrop(Native Method) at org.eclipse.swt.dnd.DragSource.drag(DragSource.java:363) at org.eclipse.swt.dnd.DragSource.access$0(DragSource.java:289) at org.eclipse.swt.dnd.DragSource$1.handleEvent(DragSource.java:172) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",13 TDQ-5694,"for mdm analysis in java engine can not get the row count, null count successfully for record which contains null value.","1. create a column analysis about mdm connection. 2. run with java engine check the result for row count and null count, can not get the rows for which values is NULL. for example, there is an entity has 4 records--a,a, b and NULL, so the 'row count' is 3, and 'null count' is 0, and distinct is 2, in fact should be 4,1 and 3. note: for distinct, both sql and java should change. ",13 TDQ-5695,"duplicate value for mdm column analysis in java engine always get '0'.","1. create a column analysis about mdm connection 2. run in java engine. 3. check the result, the duplicate value always get '0'. pay attention to the NULL count. ",8 TDQ-5700,"Disable or hide the ""unlock"" menu when the editor is open","when the editor is open, we must not be able to unlock it. Or we should close it. Remove the menu when the editor is open. ",8 TDQ-5703,"Create TUJ for TDQ-3606",NULL,2 TDQ-5712,"when do force delete, the force delete items still in repository need to refresh manually(analysis-report, udi-analysis, pattern-analysis).","just as the summary , when the force deleted items' node still need to refresh pay attention to items in sub folder(analysis and report will show the count number).",8 TDQ-5715,"Code refactoring 2: the save method of sql source file & jrxml tempate - Do it only on trunk (5.2)","Currently, the save method of sql source file is implemented in sql explorer plugin. It is not handled by Talend API. This is not good because the property the file item are not considered, when we need to store some information (version etc.) along with save action of file item into property, it's difficult. About the save method of jrxml template, I am not ware of how it works but it should have same problem to sql source file. To do that, in FileItemWriter class, create a save method. In this method , handle file item saving logic in which the property should be considered. ",13 TDQ-5739,"Fix DatePatternRetrieverTest error","This test fails on the testing platform. ",3 TDQ-5801,"can not create mssql dbconnection correctly by wizard 'Miscrosoft SQL Server 2005/2008'","try to create a dbconnection by the wizard 'Miscrosoft SQL Server 2005/2008', set the connect information correctly, then click ""check"". get error. on top work well.",20 TDQ-5747,"Create a test suite","Create a test suite only for DQ project, this suite will include all the DQ junits. ",5 TDQ-5750,"File connection not refreshed","When you change the name of a FileDelimited connection, the connection list is not updated automatically in an opened analysis form. You have to close it and re-open. ",8 TDQ-5756,"create TUJs with Oracle and Postgresql database for TDQ-4795 ","in the schema definition, the analyzed column should have an alias and an original DB column. we have already tMysqlValidRows_11645 for MySQL database, so need similar ones for Oracle and Postgresql. identifier quotes should be considered too.",2 TDQ-5761,"Clean up DqRepositoryViewServiceTest","1. This class contains a lot of commented methods. Why? If the reason is that the methods are not used anymore, then remove the methods from the junit class and also from the tested class. If the reason is that the test failed, then fix the code. 2. remove all the try/catch clause. If an exception occurs, the test will fail and we'll be able to read the exception stack trace. That's enough. ",3 TDQ-5762,"ConnectionUtilsTest has no assertion. It does not test anything",NULL,2 TDQ-5763,"Review code in DependenciesHandlerTest","A lot of code can be removed in DependenciesHandlerTest.testGetClintDependencyProperty() and the test still passes. Please, review the code. Do we really need to mock objects in this test? Do we really need all these lines? (evidently no) Please, if the code is long, add comments to explain what the test is about. ",2 TDQ-5767,"convert AnalysisCreationTest into a test class","This class is a main class. It was not designed to be a junit. Now, it must become a real junit. ",5 TDQ-5769,"convert ConnectionAnalysisCreationTest into a test class","This class is a main class. It was not designed to be a junit. Now, it must become a real junit. ",8 TDQ-5770,"Create a junit about moving resources","MoveProviderTest is useless now. Delete this class. Instead, create a Junit class that will test the move of an item. (Or does it already exist?)",8 TDQ-5771,"convert MultiColAnalysisCreationTest into a test class","This class is a main class. It was not designed to be a junit. Now, it must become a real junit. ",5 TDQ-5772,"convert MultiNominalColAnalysisTest into a test class","This class is a main class. It was not designed to be a junit. Now, it must become a real junit. ",5 TDQ-5773,"Delete PatternTest and create some tests related to the jdbc urls if none exists",NULL,1 TDQ-5774,"Implement DbmsLanguageFactoryTest methods",NULL,8 TDQ-5775,"Review DQDeleteHelperTest","1. One method has no assertion. It's useless. Please fix that. 2. Confirm that we really need to mock all these objects.",2 TDQ-5777,"implement empty methods in TableViewComparisonLevelTest",NULL,8 TDQ-5778,"implement methods in ReportSubFolderRepNodeTest",NULL,3 TDQ-5779,"Replace ReportDocGeneratorTest by a meaningful test",NULL,5 TDQ-5780,"Review CreateParserRuleFolderTaskTest. This test is empty",NULL,1 TDQ-5781,"remove try/catch clauses in WorkspaceResourceHelperTest",NULL,1 TDQ-5782,"No assertion in RefactMdmMetadataTaskTest. Fix it. ",NULL,1 TDQ-5783,"No assertion in SplitSysIndicatorTaskTest. Fix it.",NULL,1 TDQ-5785,"remove try/catch clause in CreateDuplicatesAnalysisActionTest",NULL,1 TDQ-5786,"implement ColumnMasterDetailsPageTest",NULL,5 TDQ-5787,"Clean up AnalysisColumnTreeViewerTest (remove warnings)",NULL,1 TDQ-5788,"Clean up WorkbenchUtilsTest (too many lines commented)",NULL,1 TDQ-5790,"Add assertion about the returned values in EcosystemServiceTest ",NULL,1 TDQ-5791,"convert JasperTest into a real junit class",NULL,8 TDQ-5792,"Convert MyTest and SynonymTest to a junit or delete it",NULL,3 TDQ-5793,"implement empty methods in DqStringHandlingTest",NULL,3 TDQ-5799,"oracle can not get tables","create an oracle dbconnection, can not get table, ok on top but can not on tdq",8 TDQ-5803,"run DQ Rule Evolution in DQPortal, got an empty page","[http-8580-5] 09 Jul 2012 16:51:59,330 ERROR org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction:506 - could not read or init a hi value com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Table 'tdqportal.hibernate_sequences' doesn't exist com.mysql.jdbc.SQLError.createSQLException(SQLError.java:936) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2985) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723) com.mysql.jdbc.Connection.execSQL(Connection.java:3283) com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1332) com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1467) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction(TableGenerator.java:483) org.hibernate.engine.TransactionHelper$1Work.doWork(TransactionHelper.java:61) org.hibernate.engine.transaction.Isolater$JdbcDelegate.delegateWork(Isolater.java:249) org.hibernate.engine.transaction.Isolater.doIsolatedWork(Isolater.java:70) org.hibernate.engine.TransactionHelper.doWorkInNewTransaction(TransactionHelper.java:74) org.hibernate.id.enhanced.TableGenerator$1.getNextValue(TableGenerator.java:466) org.hibernate.id.enhanced.OptimizerFactory$NoopOptimizer.generate(OptimizerFactory.java:194) org.hibernate.id.enhanced.TableGenerator.generate(TableGenerator.java:463) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:121) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:210) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:56) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:195) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:50) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:93) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:713) org.hibernate.impl.SessionImpl.save(SessionImpl.java:701) org.hibernate.impl.SessionImpl.save(SessionImpl.java:697) it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit(DbAuditImpl.java:73) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:148) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:249) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.createAuditId(ExecutionInstance.java:918) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.addSystemParametersForExternalEngines(ExecutionInstance.java:1094) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.getExecutionUrl(ExecutionInstance.java:1019) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.handleNormalExecution(GetUrlForExecutionAction.java:285) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.doService(GetUrlForExecutionAction.java:79) it.eng.spagobi.commons.services.AbstractSpagoBIAction.service(AbstractSpagoBIAction.java:74) it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:423) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.ProfileFilter.doFilter(ProfileFilter.java:107) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.SpagoBICoreCheckSessionFilter.doFilter(SpagoBICoreCheckSessionFilter.java:86) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) java.lang.Thread.run(Thread.java:662) [http-8580-5] 09 Jul 2012 16:51:59,330 ERROR org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction:506 - could not read or init a hi value com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Table 'tdqportal.hibernate_sequences' doesn't exist com.mysql.jdbc.SQLError.createSQLException(SQLError.java:936) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2985) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723) com.mysql.jdbc.Connection.execSQL(Connection.java:3283) com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1332) com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1467) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction(TableGenerator.java:483) org.hibernate.engine.TransactionHelper$1Work.doWork(TransactionHelper.java:61) org.hibernate.engine.transaction.Isolater$JdbcDelegate.delegateWork(Isolater.java:249) org.hibernate.engine.transaction.Isolater.doIsolatedWork(Isolater.java:70) org.hibernate.engine.TransactionHelper.doWorkInNewTransaction(TransactionHelper.java:74) org.hibernate.id.enhanced.TableGenerator$1.getNextValue(TableGenerator.java:466) org.hibernate.id.enhanced.OptimizerFactory$NoopOptimizer.generate(OptimizerFactory.java:194) org.hibernate.id.enhanced.TableGenerator.generate(TableGenerator.java:463) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:121) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:210) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:56) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:195) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:50) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:93) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:713) org.hibernate.impl.SessionImpl.save(SessionImpl.java:701) org.hibernate.impl.SessionImpl.save(SessionImpl.java:697) it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit(DbAuditImpl.java:73) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:148) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:249) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.createAuditId(ExecutionInstance.java:918) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.addSystemParametersForExternalEngines(ExecutionInstance.java:1094) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.getExecutionUrl(ExecutionInstance.java:1019) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.handleNormalExecution(GetUrlForExecutionAction.java:285) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.doService(GetUrlForExecutionAction.java:79) it.eng.spagobi.commons.services.AbstractSpagoBIAction.service(AbstractSpagoBIAction.java:74) it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:423) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.ProfileFilter.doFilter(ProfileFilter.java:107) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.SpagoBICoreCheckSessionFilter.doFilter(SpagoBICoreCheckSessionFilter.java:86) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) java.lang.Thread.run(Thread.java:662) [http-8580-5] 09 Jul 2012 16:51:59,333 ERROR org.hibernate.util.JDBCExceptionReporter.logExceptions:234 - Table 'tdqportal.hibernate_sequences' doesn't exist [http-8580-5] 09 Jul 2012 16:51:59,333 ERROR org.hibernate.util.JDBCExceptionReporter.logExceptions:234 - Table 'tdqportal.hibernate_sequences' doesn't exist [http-8580-5] 09 Jul 2012 16:51:59,334 ERROR it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit:77 - org.hibernate.exception.SQLGrammarException: could not get or update next value [http-8580-5] 09 Jul 2012 16:51:59,335 ERROR it.eng.spagobi.monitoring.dao.AuditManager.insertAudit:251 - Error doing audit insertion it.eng.spago.error.EMFUserError: severity [ERROR] description [Generic Error] it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit(DbAuditImpl.java:80) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:148) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:249) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.createAuditId(ExecutionInstance.java:918) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.addSystemParametersForExternalEngines(ExecutionInstance.java:1094) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.getExecutionUrl(ExecutionInstance.java:1019) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.handleNormalExecution(GetUrlForExecutionAction.java:285) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.doService(GetUrlForExecutionAction.java:79) it.eng.spagobi.commons.services.AbstractSpagoBIAction.service(AbstractSpagoBIAction.java:74) it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:423) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.ProfileFilter.doFilter(ProfileFilter.java:107) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.SpagoBICoreCheckSessionFilter.doFilter(SpagoBICoreCheckSessionFilter.java:86) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) java.lang.Thread.run(Thread.java:662) [http-8580-2] 09 Jul 2012 16:52:18,393 ERROR org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction:506 - could not read or init a hi value com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Table 'tdqportal.hibernate_sequences' doesn't exist com.mysql.jdbc.SQLError.createSQLException(SQLError.java:936) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2985) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723) com.mysql.jdbc.Connection.execSQL(Connection.java:3283) com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1332) com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1467) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96) org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction(TableGenerator.java:483) org.hibernate.engine.TransactionHelper$1Work.doWork(TransactionHelper.java:61) org.hibernate.engine.transaction.Isolater$JdbcDelegate.delegateWork(Isolater.java:249) org.hibernate.engine.transaction.Isolater.doIsolatedWork(Isolater.java:70) org.hibernate.engine.TransactionHelper.doWorkInNewTransaction(TransactionHelper.java:74) org.hibernate.id.enhanced.TableGenerator$1.getNextValue(TableGenerator.java:466) org.hibernate.id.enhanced.OptimizerFactory$NoopOptimizer.generate(OptimizerFactory.java:194) org.hibernate.id.enhanced.TableGenerator.generate(TableGenerator.java:463) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:121) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:210) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:56) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:195) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:50) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:93) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:713) org.hibernate.impl.SessionImpl.save(SessionImpl.java:701) org.hibernate.impl.SessionImpl.save(SessionImpl.java:697) it.eng.spagobi.monitoring.dao.DbAuditImpl.insertAudit(DbAuditImpl.java:73) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:148) it.eng.spagobi.monitoring.dao.AuditManager.insertAudit(AuditManager.java:249) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.createAuditId(ExecutionInstance.java:918) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.addSystemParametersForExternalEngines(ExecutionInstance.java:1094) it.eng.spagobi.analiticalmodel.document.handlers.ExecutionInstance.getExecutionUrl(ExecutionInstance.java:1019) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.handleNormalExecution(GetUrlForExecutionAction.java:285) it.eng.spagobi.analiticalmodel.execution.service.GetUrlForExecutionAction.doService(GetUrlForExecutionAction.java:79) it.eng.spagobi.commons.services.AbstractSpagoBIAction.service(AbstractSpagoBIAction.java:74) it.eng.spago.dispatching.action.ActionCoordinator.invokeServiceBusiness(ActionCoordinator.java:209) it.eng.spago.dispatching.action.ActionCoordinator.service(ActionCoordinator.java:158) it.eng.spago.dispatching.httpchannel.AdapterHTTP.service(AdapterHTTP.java:423) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.ProfileFilter.doFilter(ProfileFilter.java:107) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) it.eng.spagobi.commons.filters.SpagoBICoreCheckSessionFilter.doFilter(SpagoBICoreCheckSessionFilter.java:86) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) java.lang.Thread.run(Thread.java:662) [http-8580-2] 09 Jul 2012 16:52:18,393 ERROR org.hibernate.id.enhanced.TableGenerator.doWorkInCurrentTransaction:506 - could not read or init a hi value com.mysql.jdbc.exceptions.MySQLSyntaxErrorException: Table 'tdqportal.hibernate_sequences' doesn't e...",5 TDQ-5817,"Add google fingerprint keyer to tGenKey",NULL,8 TDQ-5818,"Add q-gram keyer to tGenKey",NULL,8 TDQ-5820,"From issue: TDQ-5801 provide a wizard to help migrating all connections at once","What we will do only in 5.2 is to provide a wizard to help migrating all connections at once",13 TDQ-5823,"add Apache ColognePhonetic to tGenKey",http://commons.apache.org/codec/apidocs/org/apache/commons/codec/language/ColognePhonetic.html,8 TDQ-5824,"tGenKey improvements","Add several algorithms to the tGenKey component",8 TDQ-5825,"Assign old ""dev done"" issue to QA","See filter http://jira.talendforge.org/secure/IssueNavigator.jspa?mode=hide&requestId=12993",8 TDQ-5826,"Close QA done issues",https://jira.talendforge.org/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+TDQ+and+status+%3D+%22QA+done%22+ORDER+BY+createdDate+asc,5 TDQ-5837,"Fix column name issue described in TDQ-4929","Nicolas Rousseau added a comment - 11/Jul/12 8:56 PM I review the junits on this today, and find some problem related to this bug. This one should be ok normally: CoreRuntimePlugin.getInstance().getDesignerCoreService().getDesignerCorePreferenceStore() .setValue(IRepositoryPrefConstants.ALLOW_SPECIFIC_CHARACTERS_FOR_SCHEMA_COLUMNS, false); columnName = MetadataToolHelper.validateColumnName(""MyColumn_你好"", 0); assertEquals(""MyColumn___"", columnName); But with the this change commited, it's not. ",1 TDQ-5847,"Genarated reports are lost after I rename the report",NULL,13 TDQ-5848,"Queries are not working on Sybase ","When I try to run a auery in the explorer perspective on a sybase database, I havethe following error. ",8 TDQ-5849,"Pattern test Result for PostgreSQL database connection shows ""matches"" about the wrong url"," 1. create a postgreSQL connection 2. open pattern editor -- "" Website_URL"" (Patterns-->Regex-->internet) 3. add postgreSQL definition, (you can copy a MySQL definition) 4. click on test button to test if it works well The issue : When I input the wrong url ""www.baidu"" the test result shows matches, refer to the ""wrong.png"" When I input the right url ""www.baidu.com"" ,the test result still shows matches refer to the ""right.png""",5 TDQ-5850,"should not check connection when select a DBConnecion","1.start/restart a studio(there some DBConnection are in the worksapce). 2.select a connection(make the connection connect fail before starting the studio). 3.it will check the connection,and throw exception: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.NullPointerException org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.getConnection(ExtractMetaDataUtils.java:567) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.getConnection(MetadataConnectionUtils.java:1153) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.getClassDriver(MetadataConnectionUtils.java:624) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:198) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:295) org.talend.core.model.metadata.builder.database.JavaSqlFactory.createConnection(JavaSqlFactory.java:148) org.talend.cwm.management.api.SoftwareSystemManager.getSoftwareSystem(SoftwareSystemManager.java:66) org.talend.dataprofiler.core.ui.views.RespositoryDetailView.createDataProviderDetail(RespositoryDetailView.java:641) org.talend.dataprofiler.core.ui.views.RespositoryDetailView.selectionChanged(RespositoryDetailView.java:265) it's seems caused by detail view.I think we should not check the connection at this time.",8 TDQ-5851,"column set analysis cannot run while file connection with context","column set analysis cannot run if a file connection has context",8 TDQ-5853,"Connection incorrectly retrieved in Data Explorer with SQL Server Windows authentication ","I create a SQL Server connection with a Windows authentication. It works for analysis, I can run them. But when I try to use the data explorer perspective, I have a connection failed because TDQ tries to set the username to ""root"" which is not correct. It ask me to review the connection when I clink on yes, and it sets the username to root, I tries to remove it , I still have the error.",8 TDQ-5858,"column analysis with jdbc connection can't stop to run","1.import a jdbc connection and related analysis by button(the project form other PC,so the drive path dosen't exist on my computer ). 2.run the related analysis.can not stop to run. 3.print many errors on the studio log view.and errors on the console view: Caused by: java.lang.NullPointerException java.lang.Class.forName0(Native Method) java.lang.Class.forName(Unknown Source) org.talend.core.model.metadata.builder.database.JDBCDriverLoader.getConnection(JDBCDriverLoader.java:80) ... 15 more ERROR: java.lang.RuntimeException: java.lang.NullPointerException 331997 [Thread-7] ERROR org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils - java.lang.RuntimeException: java.lang.NullPointerException ERROR: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.NullPointerException java.lang.RuntimeException: java.lang.RuntimeException: java.lang.NullPointerException org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.getConnection(ExtractMetaDataUtils.java:567) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.getConnection(MetadataConnectionUtils.java:1153) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.getClassDriver(MetadataConnectionUtils.java:624) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:198) org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:295) org.talend.core.model.metadata.builder.database.JavaSqlFactory.createConnection(JavaSqlFactory.java:148) org.talend.dq.analysis.connpool.TdqAnalysisConnectionPool.newConnection(TdqAnalysisConnectionPool.java:145) org.talend.dq.analysis.connpool.TdqAnalysisConnectionPool.getConnection(TdqAnalysisConnectionPool.java:126) org.talend.dq.analysis.AnalysisExecutor.getPooledConnection(AnalysisExecutor.java:311) org.talend.dq.analysis.ColumnAnalysisSqlExecutor.runAnalysis(ColumnAnalysisSqlExecutor.java:1049) org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:111) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:154) org.talend.dataprofiler.core.ui.action.actions.AnalysisExecutorThread.run(AnalysisExecutorThread.java:86) java.lang.Thread.run(Unknown Source) ",5 TDQ-5889,"Store the report execution time in the datamart","See related issue TDQ-4234. Store this execution information in the fact tables of the datamart. Add two columns in the 4 fact tables: REP_DURATION and REP_RUNTIME (TDQ_MATCH_INDVALUE, TDQ_OVERVIEW_INDVALUE,TDQ_SET_INDVALUE, TDQ_INDICATOR_VALUE) Then create a datamart migration task. ",8 TDQ-5898,"Unable to query Teradata TDQ","Analysis will not run and we are unable to query views or tables in the tool. Getting nullpointerexception and conversion errors when querying Teradata through both the Explorer and Profiler. Using both JDBC-ODBC and JDBC connections. Works in Open Profiler 5.0.2. ""Screenshot2012071813325.png"" Error when running a simple query to bring back a single column in the Explorer. ""H Doty error log file copy.log"" is the log after the Explorer nullpointerexception ""2.log"" is from the error on the Profiler Analysis",8 TDQ-5903,"Create a tGenKeyHadoop component","This component reads data on HDFS and applies the algorithms as defined in the tGenKey component. The data always stay on hadoop. This component will require the use of a tHDFSConnection in order to connect to hadoop. The properties of this component are the same as those from tGenKey plus some properties to define the data format: - the HDFS file URI - the field separator - an option to link with another tGenKeyHadoop component (unchecked by default) When the option to link with another tGenKeyHadoop is selected, the output of the previous component becomes the input of the current component. The schema of this component will be defined manually by the user except the fixed T_GEN_KEY column. But this fixed column must be automatically renamed when several tGenKeyHadoop components are linked together. That means the first component has a T_GEN_KEY_1 column, the second component a T_GEN_KEY_2 column, etc. In the Map/reduce implementation, no reducer is required here. Only a Mapper class is necessary as each record is handled independently. ",13 TDQ-5904,"Allow the tMatchGroupHadoop component to work with HDFS data file directly","Currently, this component reads local data and loads them into HFDS. We want to avoid this step in some cases. The component will still be able to load data into HDFS, but there should be an option so that the component will just read data existing in HDFS. The properties of the component will be: - the same as before plus - a checkbox ""use existing HDFS file"" (by default unchecked) - when checked, a new property : the ""HDFS file URI"" when the checkbox is checked, the component can be a starting component (meaning that a job can start with this component). ",8 TDQ-5905,"Add an option to link together a tMatchGroupHadoop component with a tGenKeyHadoop component","Add an option in the properties of the tMatchGRoupHadoop component : ""link with tGenKeyHadoop"". (checkbox + dropdown list to select a component) When unchecked, the behavior is just the same as before. When checked, the input of this component is the output generated by the tGenKeyHadoop component. ",13 TDQ-5906,"Allow the tMatchGroupHadoop component to use a tHDFSConnection","Add a property in the component to use an existing tHDFSConnection component: ""use an existing connection"" checkbox + dropdow list When the checkbox is checked, the connection to HDFS is done via the selected tHDFSConnection component, and the previous connection properties are hidden. when the checkbox is unchecked, the connection is set as before. ",8 TDQ-5907,"Enable Hive profiling","Enable Hive database connection in the profiler. 1. add Hive as a supported database connection in TOS-DQ 2. check all analyses and all indicators against Hive (with SQL engine). 3. check also the java engine 4. adapt the SQL templates of the indicators definition when required ",8 TDQ-5908,"for reload function cause the dbconeection disappear","1. create a mysql dbconnection 2. click a certain catalog, to get tables and views. 3. do ""Reload table list"", then do ""Reload database list"", then redo ""Reload table list"" after these functions, will get errors(attached in Details tab), and refresh reporsitory dbconnection disappear.",8 TDQ-5909,"the wizard information should not show the type name for fileConnection when import/export and delete","1. create a file connection, and create analysis about it. 2. try to delete the file connection, get inform information 3. try to export/import file analysis, and un-check the file connection. get inform the inform information doesn't show the file connection name , but seems like type name.",3 TDQ-5910,"Build a new datamart.jar file for QBE ","AFter the change done in TDQ-5889 create a datamart.jar that will be used in QBE. Don't forget to add labels for the new columns in the properties file. ",5 TDQ-5912,"Use the last version of HSQL DB in the DQ portal","The current 1.8.0 version is 4 years old. We should upgrade to the new version. ",8 TDQ-5923,"the threshold lose for the pattern after adding a new pattern","1. create a column analysis, add a pattern for one column. 2. set threshold for the pattern 3. add another pattern for the same column the threshold set for the first pattern disappear. pay attention to add by the icon in the analysis editor and also drag one to column ",5 TDQ-5926,"Tables without Fk can not show the content for oracle datamart","for oracle datamart 1, TABLES WITHOUT FK can not show the content,just a blank page show. (512 and 520)attached error in details tab 2, for Simple Evolution and Pattern Evolution, for the pattern result, will show two chart, but Report generated by studio and mysql dqportal just show one, we should unify it. (512 and 520) 3, the header of ""Pat_matching evolution"" and ""Simple stats evolution"" should be ""Table.column"", lose "".column"" (512,520) for the issue 2, if we show two pic please move the Null item",13 TDQ-5933,"Junit for feature TDQ-5847","Reproduce the issue by a Junit if possible. ",8 TDQ-5952,"Make the number of connections being configurable in preference used per analysis.","Currently , there is no way to reuse a single connection throughout an analysis. Make the number of connections being configurable in preference used by per analysis, the default value is 1.",20 TDQ-5959,"for the migration information about update the product version doesn't store in the tdq_migration table.","1. create a datamart by the earlier version 2. try to migrate datamart to current version. 3. successfully, but the operation of updating product version doesn't store in tdq_migration table",3 TDQ-5962,"Duplicated connection can't be expanded","1.create a new connection 2.duplicate one based on this connection 3.the duplecated connection can't be expanded(don't have the sign '+' on UI),must reload it.",8 TDQ-5967,"try to import the parser rule, but it goes to sql folder not Parser one.","try to import a parse rule file, in the import dialog , it can show the correctly path, after imported, the parser file will goes to the SQL folder, but it should go to Parser folder. pay attention also to cmd line project ",5 TDQ-5968,"try to check tdq_rule file under commandline project, can not get any items.","1. import some items to commandline project. 2. check items by ""listItem"" can get the tdq_rules file. 3. try to get by ""listItem -if type=tdq_rules"", get nothing. check the filter type, it is tdq_rules. now dq have a parser rule file, how can we distinguish them by the type name",8 TDQ-5969,"dqportal can not show the report content it is for all template ","issue 1 install a mysql datamart installer start hsql first then tomcat. visit the webpage, try to get the report content failed, all template can get the report list, but can not get report content attached the logs and pic(dqportalGeneratedFailed and SpagoBI.log) issue 2, the apperance seems different from others, refer to the pic（""FrequencyBasic and Evolution"" and ""Normal""）",2 TDQ-5973,"we'd better refactor the method ""runAnalysis"" for abstract class AnalysisExecutor","the method ""runAnalysis"" in every implemetation classes of AnalysisExecutor contain the following three parts: part 1: open a connection part 2: indicatorEvaluator define and evaluateIndicators part 3: close the connection we can do like this: part 1 and part 3 extract two new methods in abstract class AnalysisExecutor, and used by every implemetation classes ",13 TDQ-5974,"try to view rows on result page by context menu, but get some errors","1. create column analysis, column set analysis and functional dependency analysis 2. try to view row on these three kind of analysis get errors, but we can get result.",2 TDQ-5980,"Additional tMatchGroup options for NULL values","Null values can cause false positive matches where both fields are null, create false negatives when a good match when one field is NULL, etc. I'd like to see some control given to the user, Advanced options, that would be usefull for tMatchGroup (and tRecordMatching) - NULL only matches NULL i.e. NULL == NULL therefore this fields scores 1.0 - NULL matches everything i.e. CHAPMAN == NULL therefore this fields scores 1.0 (or better (possibly) the weight for this field becomes 0, i.e., this column is not considered any further and only the remaining fields are compared) - NULL never matches anything i.e CHAPMAN != NULL, NULL != NULL therefore these fields score 0.0 ",5 TDQ-5981,"Additional tMatchGroup options for multiple matching rules","I'd like to see tMatchGroup allow multiple matching strategies. For example, - Match on Name & Address - Match on DOB & Phone - Match on Name & Email address To improve the performance, this is a strategy that I have used in the past. - Match the fields (Name, Address, DOB, Phone, Email Address) - Specify the rules: Name And (Address or Email or Phone or DOB) OR DOB + (Phone or Email) Each may have their own blocking keys too. ie. if the match was not found, it may be because the Blocking Key was bad The point is that I want to match using multiple strategies because not all fields are 'fit for purpose' for a matching strategy. At the moment, I have to use multiple tMatchGroups and 'merge' the result sets from two or more outputs ",13 TDQ-5983,"Junit for feature TDQ-5907",NULL,8 TDQ-5989,"Drill down function -- view rows on Hive connection, close sql editor before get result will throw OOE ","create a column analysis with Hive connection after analyzed this column, turn to result page right click one indicator, -- view rows then will open an sql editor to select the data but if close the editor before it get result will throw an OOE error I will attach the error log file here.",5 TDQ-5990,"Create version 5.2.0M3 in Babili and populate it",NULL,2 TDQ-5993,"there is some issue about source file for rename folder","on build r89207-5.1.2,r89207-5.2.0(windows): find issue rename folder, then rename file in the folder get error, bug doesn't affect the other function. on r88970-5.0.4: rename a folder lead to the file which crated by right click the folder in it lose its content (tdq) ",5 TDQ-5999,"the detail infomation is incorrect","see the screenshot the context Name and context Group Name are opposite. the purpose and description should display(2 case: in the wizard set or after created connection, then open editor, set) ",3 TDQ-6005,"Create a configuration to automatically filter only DQ tasks","When the user opens the task view the first time, it should only display DQ tasks. ",8 TDQ-6006,"Support DQ portal on Weblogic","* Support DQ Portal on Weblogic 11 ",13 TDQ-6009,"Add the ability to edit context in the Profiler view","add the ""Contexts"" node in the DQ repository view and add all menus existing in DI. ",20 TDQ-6010,"Improvement of the indicator selection window","1. same request as in TDQ-2751 2. improvement scroll performances suggested requirements: The current panel is very hard to use and not scalable ; main problems with this design are: - very slow scroll with +10 columns (and some open indicators) - hard to read column name (need to resize the column every time) on the top - small number of column - first column with indicator name is not fixed, when you scroll right, it disappear - etc. I've enclosed a mockup of a new GUI for this Panel. - the Indicator column should be fixed. - the Top ""Selected Column"" should be fixed - the green minus allow you to hide a column - the red cross allow you to delete the column - the green plus allow you to unhide hidden column(s) (with #) - yellow is a dynamic highlighter showing you current selection",20 TDQ-6013,"the Redundancy Evolution template can not retrieve correct report list","issue 1: for the Redundancy Evolution template can not retrieve report correctly. it get the report about column analysis with use pattern, but should the report which use content Compare analysis--- on 5.2 issue 2: the overview evolution can not show the content, should change the time, can dev check the reason--512 mysql(5.2 oracle doesn't work now, hope it work well also). issue 3: the Potential pk can not show content on 5.2.0 oracle issue 4: the Threshold KPI just show two pic, should be 4, refer to the pic attached. issue 5: for the ""Integrity Report->Column Size analysis"" template , the content show the Item more than once, refer to the pic """"",13 TDQ-6014,"Implement the tGenKey improvements into the tGenKeyHadoop component","See original tGenKey component improvements.",3 TDQ-6015,"tGenkeyHadoop component issues","1. if link two tGenkeyHadoop component, and check the second component ""link with a tGenkeyHadoop"" the second one will got an error icon on the component, save and reopen job, eidt the schema, ""T_GEN_KEY_*"" column editable it should not be 2. in basic setting, if uncheck ""link with a tGenKeyHadoop"" in the advanced setting, the text box ""separator"" is visible, the text box is visible or not should be judged by the checkbox ""use existing HDFS file"" 3. the input schema do not contain ""T_GEN_KEY"" column, while link to tGenKeyHadoop component will auto add this column for tGenKeyHadoop but in the ""Algorithm"" column list, T_GEN_KEY shows up, this should not be",2 TDQ-6032,"download UDI issues","1, when upload the zip contains: sql template & relate UDI jar, only the sql can be showed in UDI editor, no jar displayed. 2, when there are several versions in exchange, when downloading, the user can not choose. 3, when the content of the exchange modified, fresh the exchange can not make the exchange reload.",13 TDQ-6033,"Junit required for commit r89240",NULL,3 TDQ-6038,"Deselect all rules of table analysis, after finish will throw NPE","create a table analysis and a rule, add this rule to analysis in editor, click ""add business rule"" icon button to add or delete rules click button ""Deselect All"" then OK will throw a NPE error {code} java.lang.NullPointerException at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer.removeItemBranch(AnalysisTableTreeViewer.java:775) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer.removeUncheckedWhereRuleIndicator(AnalysisTableTreeViewer.java:524) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer.showAddDQRuleDialog(AnalysisTableTreeViewer.java:470) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer.access$4(AnalysisTableTreeViewer.java:414) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisTableTreeViewer$6.mouseDown(AnalysisTableTreeViewer.java:363) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:185) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}",3 TDQ-6048,"Match data job and Deduplicate data job failed to read input schema","follow cheat sheet steps to create job ""Match Data job"" and ""Deduplicate Data job"" while at the step ""Choose Matching Fields"" cannot get input schema and I got an error in ""Problems"" view -- ""No schema has been defined yet."" but I checked the file that I select, there is a schema in it",2 TDQ-6049,"we'd better refactor the properties save","issue1: now, the properties values(Status,Author,Purpose,Description,Version) are saved at two places, both the *.item and *.properties files I think this is no need. we should save them at one file. (otherwise, save at two places, we must make sure they are alway the same when update/create ) we should consider all items, now in dq, just the connection save status is different from others. but if we considerd DI, the connection save status almost the same as DI(the propertes just save in the *.propertes file). two solutions: 1. all the properties values save at the *.propertes file.(unify with DI) 2. all the properties values save at the *.item file.(different with DI) issue2: delete the property ""filename"" from TDQItemImpl seems this is useless and only remain this property for source file and jrxml type file",13 TDQ-6052,"the tMatchGroupHadoop is different from tMatchGroup for one column ","create a job with a tMatchGroupHadoop,for the configuration of the component refer the job attached. I get a result which blocking keys ""id"" and ""id2"" are not same between two rows, but group them to one. test with tMatchGroup, they are not in one group. ",1 TDQ-6054,"the report can not run successfully when it contains a column analysis using the emailValidationJUDI","1. create column analysis add the emailValidationJUDI java udi. 2. run analysis, successfully. 3. generate report file about this analysis. failed get error(on details tab) three kinds of datamart all will get error.",8 TDQ-6070,"The report about the average length indicators is wrong in the dq portal, fix it. ","The average does not seem to be computed. Instead, it's the sum that it computed. ",8 TDQ-6081,"Create version 5.2.0M4 in Babili and populate it",NULL,2 TDQ-6085,"Export babili translations into trunk of SVN",NULL,2 TDQ-6089,"fix some bad practices","1. on the ResourceViewLabelProviderTest and UnitTestBuildHelper have some try catch structor, they hold back error to impact junit result. so need to add Assert.fail in it. 2. in ColumnAnalysisSqlExecutor line 741 add NON-NLS tag. 3. on the ReportExecutor maybe don't support ui so instead it by log.error.",2 TDQ-6091,"Workitem to write a junit for TDQ-5993","Rename SQL file action method need a junit test.",3 TDQ-6092,"for the ""view Compare"" show the db root structure but not views for several kinds of db","1. create an oracle dbconnection. 2. try to unfold a schema to views, right click the view folder->view compare, an editor open, but doesn't show the information of views, but schemas. you can also reproduce this by:(1) right click database ->database compare, in the open editor right click on one schema->compare the lists of views. this issue exist on teradata, sqlserver, db2, postsql. for mysql it is ok.",13 TDQ-6096,"SQL explorer cannot preview Ingres table/column","See attach picture.",8 TDQ-6099,"Fail to run column analysis with Teradata Interval Year","1.create an ODBC Teradata connection. 2.create a column analysis with a column which is Interval Year date type. 3.select ""Blank count"" and some Textual indicators. 4.can not run successfully,will get an error and warning(see Detail page,we can find this error in TDQ-5898 2.log ). Even if it is JDBC Teradata,could get this error. I think that some indicators should be disabled for the Interval Year date type. ",13 TDQ-6100,"delete ""ITEMS"" function doesn't work well","create some items, like (connections, analyses, UDIs ...) select at least two items do delete just one can be deleted and throw this error: {code} java.lang.reflect.InvocationTargetException at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.eclipse.ui.internal.progress.ProgressMonitorJobsDialog.run(ProgressMonitorJobsDialog.java:275) at org.eclipse.ui.internal.progress.ProgressManager.run(ProgressManager.java:1162) at org.talend.repository.ui.actions.DeleteAction.doRun(Unknown Source) at org.talend.repository.ui.actions.AContextualAction$2.run(Unknown Source) at org.talend.repository.RepositoryWorkUnit.executeRun(Unknown Source) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.repository.ui.actions.AContextualAction.run(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.excuteSuperRun(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.run(Unknown Source) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.RuntimeException: The service org.talend.designer.core.IDesignerCoreService has not been registered. at org.talend.core.GlobalServiceRegister.getService(Unknown Source) at org.talend.repository.ui.actions.DeleteAction$1.run(Unknown Source) at org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1975) at org.talend.repository.ui.actions.DeleteAction$2.run(Unknown Source) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 42 more Root exception: java.lang.RuntimeException: The service org.talend.designer.core.IDesignerCoreService has not been registered. at org.talend.core.GlobalServiceRegister.getService(Unknown Source) at org.talend.repository.ui.actions.DeleteAction$1.run(Unknown Source) at org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1975) at org.talend.repository.ui.actions.DeleteAction$2.run(Unknown Source) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.eclipse.ui.internal.progress.ProgressMonitorJobsDialog.run(ProgressMonitorJobsDialog.java:275) at org.eclipse.ui.internal.progress.ProgressManager.run(ProgressManager.java:1162) at org.talend.repository.ui.actions.DeleteAction.doRun(Unknown Source) at org.talend.repository.ui.actions.AContextualAction$2.run(Unknown Source) at org.talend.repository.RepositoryWorkUnit.executeRun(Unknown Source) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) at org.talend.repository.ui.actions.AContextualAction.run(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.excuteSuperRun(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.run(Unknown Source) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}",13 TDQ-6104,"Export babili translations into 5.1 branch",NULL,2 TDQ-6108,"[SVN Repo] when rename a folder which does not exist, an empty folder will be created without any content. ","""which does not exist"" means it is moved/deleted by others but not refreshed locally TODO: check the existance of the folder at first.",3 TDQ-6109,"Move all QAS components in the ""Data Quality/Address/QAS"" folder in the palette",NULL,1 TDQ-6114,"the remove duplicate job can not run correctly with postgresql","1. create a column analysis 2. select simple statistics,run 3. on result page, right click ""distinct/duplicate/unique"" indicator, get ""remove duplicate"" the job generated, but run failed, check the output component, no data set. refer to pic.",8 TDQ-6120,"Remove the option panel from the benford law indicator","This indicator has currently no option. Set the usual pop up ""no option to set"" when you click on the indicator's options. ",2 TDQ-6121,"Graphs are displayed twice when we add a new indicator","Create a column analysis with the benford law indicator and simple statistics. Run the analysis. There are two charts. (which is normal) Click on select indicators and add the summary statistics indicators. Now, the first two charts are duplicated and I have 5 charts. (If I refresh, the duplicate charts disappear). ",8 TDQ-6122,"Improve the Benford law chart","1. The bars must be at the same positions as the dots, even when there is some invalid data. Possible ways to customize the colors of a single bar: http://javabeanz.wordpress.com/2007/07/04/creating-barcharts-with-custom-colours-using-jfreechart/ http://stackoverflow.com/questions/4952931/jfreechart-is-it-possible-to-change-the-bar-color 2. Change the colors to: - for 1 - 9 digit, bars must be in Talend's green color (like for null count indicator, see attached screen capture). - for the Benford law dots, keep the blue color. - for the invalid data, use the red color. ",8 TDQ-6123,"Adapt the report for the Benford Law indicator","The current report about the Benford Law indicator is not correct. Display the same chart as in the studio. And change the value table to an appropriate table (see attached screen capture)",3 TDQ-6130,"Backport changeset of TDQ-5700 from trunk to branch 5.1 and 5.0",NULL,3 TDQ-6138,"RepDuration,RepRuntime should not show in the QBE","install the 512 dqportal by installer build. check the QBE part, RepDuration,RepRuntime nodes show under Overview Indicator Valued...in the Query tab. it should not.",1 TDQ-6149,"BRMS Repository Connection Limit","In the repository it is impossible to create multiple BRMS connections to the same package. It is necessary when you want to access different classes that have been uploaded to one package in the Guvnor. If I have 3 different classes org.talend.polygon.Triangle, org.talend.polygon.Square, org.talend.polygon.Pentagon that are in a single jar polygons.jar which I have uploaded to the Guvnor under the package org.talend.polygon, I can only access 1 class at a time in the same package. {code} Exception in component tBRMS_1_In Unable to access binding information for class org.talend.polygon.Square Make sure the binding has been compiled java.lang.NoSuchFieldException: JiBX_bindingList java.lang.Class.getDeclaredField(Class.java:1882) org.jibx.runtime.BindingDirectory.getBindingList(BindingDirectory.java:68) org.jibx.runtime.BindingDirectory.getFactory(BindingDirectory.java:211) demos.testsquare_0_1.TestSquare.tBRMS_1_InProcess(TestSquare.java:1214) demos.testsquare_0_1.TestSquare$1ThreadXMLField_tBRMS_1_Out.run(TestSquare.java:486) {code}",5 TDQ-6152,"Check the instanceof&if/else assertions for the WhereRuleAideIndicator in code","Times ago, we created a new WhereRuleAideIndicator class along with WhereRuleIndicator in order to compute the DQ rule percentage value when there is a join condition. But the code is not correctly handled for some condition statements, for example it opens one bug TDQ-6038 due to the lack of assertion for WhereRuleAideIndicator in AnalysisTableTreeViewer.getOwnedWhereRuleFiles?....? The aim of this work item is to check again for the code where it can be impacted. One easier way is to look up key word: ""WhereRuleIndicator"", then decide whether WhereRuleAideIndicator considered or not at the same place.",2 TDQ-6156,"can't create sybase database connection","on database wizard, create a sybase database connection, click check will throw the following exception: {code} java.lang.RuntimeException: java.sql.SQLException: JZ0I5: ?????????? CHARSET ??: GBK? at org.talend.core.model.metadata.builder.database.JDBCDriverLoader.getConnection(JDBCDriverLoader.java:127) at org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.connect(ExtractMetaDataUtils.java:810) at org.talend.core.model.metadata.builder.database.ExtractMetaDataFromDataBase.testConnection(ExtractMetaDataFromDataBase.java:290) at org.talend.repository.ui.utils.ManagerConnection.check(ManagerConnection.java:143) at org.talend.repository.ui.wizards.metadata.connection.database.DatabaseForm.checkConnection(DatabaseForm.java:902) at org.talend.repository.ui.wizards.metadata.connection.database.DatabaseForm.access$19(DatabaseForm.java:848) at org.talend.repository.ui.wizards.metadata.connection.database.DatabaseForm$4.widgetSelected(DatabaseForm.java:1071) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.jface.window.Window.runEventLoop(Window.java:825) at org.eclipse.jface.window.Window.open(Window.java:801) at org.talend.dataprofiler.core.ui.action.AbstractMetadataCreationAction.run(AbstractMetadataCreationAction.java:65) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) {code} if on linux, will throw exception like this: {code} Connection failure. You must change the Database Settings. java.sql.SQLException: JZ0I5: An unrecognized CHARSET property was specified: UTF-8. {code}",5 TDQ-6160,"Ensure that the hive profiling feature still works after TDI-22130",NULL,5 TDQ-6166,"Deleted connections still show up in Connections view","db connections that have been deleted under dq repo, are still available in the connection view under data explorer perspective",13 TDQ-6167,"Newly added JDBC driver doesn't show up in the DB Type dropdown - can't connect to DB under Data Explorer perspective","i added a new JDBC driver (vertica) in preferences (talend -> data explorer --> jdbc drivers), it doesn't show up as the DB type when i try to create a new connection i'm able to connect to vertica using the 'generic jdbc' driver and add the connection under Metadata. this allows me to view the db objects (tables, columns, data) in the profile perspective. however, in the data explorer perspective i am unable to connect to my vertica db connection. the error i get in a popup is ""Cannot connect to /. Check your URL""",8 TDQ-6168,"Unable to create analysis in TDQ","This is a reasonably fresh Studio installation, and I am trying to create a column analysis on a MySQL database on the local machine. The analysis never opens, I get an error in the editor window with the stack trace below. This happens both when I try to create the DB connection in the Profiling perspective and in the Integration perspective. I tried deleting and re-creating the DB connection in all sorts of ways, to no avail. Stack trace: java.lang.ClassCastException: org.talend.core.model.metadata.builder.connection.impl.ConnectionImpl cannot be cast to org.talend.core.model.metadata.builder.connection.DelimitedFileConnection org.talend.dq.nodes.DFConnectionRepNode.(DFConnectionRepNode.java:56) org.talend.dq.nodes.DFConnectionFolderRepNode.getChildren(DFConnectionFolderRepNode.java:79) org.talend.dq.helper.RepositoryNodeHelper.getModelElementFromFolder(RepositoryNodeHelper.java:1731) org.talend.dq.helper.RepositoryNodeHelper.getConnectionRepositoryNodes(RepositoryNodeHelper.java:1563) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.reloadDataproviderAndFillConnCombo(AbstractAnalysisMetadataPage.java:392) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.createConnBindWidget(AbstractAnalysisMetadataPage.java:271) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createAnalysisColumnsSection(ColumnMasterDetailsPage.java:274) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createFormContent(ColumnMasterDetailsPage.java:234) org.eclipse.ui.forms.editor.FormPage$1.run(FormPage.java:152) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.forms.editor.FormPage.createPartControl(FormPage.java:150) org.eclipse.ui.forms.editor.FormEditor.pageChange(FormEditor.java:471) org.talend.dataprofiler.core.ui.editor.CommonFormEditor.pageChange(CommonFormEditor.java:231) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.pageChange(AnalysisEditor.java:190) org.eclipse.ui.part.MultiPageEditorPart.setActivePage(MultiPageEditorPart.java:1067) org.eclipse.ui.forms.editor.FormEditor.setActivePage(FormEditor.java:603) org.eclipse.ui.part.MultiPageEditorPart.createPartControl(MultiPageEditorPart.java:352) org.eclipse.ui.internal.EditorReference.createPartHelper(EditorReference.java:670) org.eclipse.ui.internal.EditorReference.createPart(EditorReference.java:465) org.eclipse.ui.internal.WorkbenchPartReference.getPart(WorkbenchPartReference.java:595) org.eclipse.ui.internal.EditorReference.getEditor(EditorReference.java:289) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditorBatched(WorkbenchPage.java:2863) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditor(WorkbenchPage.java:2768) org.eclipse.ui.internal.WorkbenchPage.access$11(WorkbenchPage.java:2760) org.eclipse.ui.internal.WorkbenchPage$10.run(WorkbenchPage.java:2711) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2707) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2691) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2674) org.talend.dataprofiler.core.CorePlugin.openEditor(CorePlugin.java:312) org.talend.dataprofiler.core.ui.wizard.analysis.AbstractAnalysisWizard.openEditor(AbstractAnalysisWizard.java:92) org.talend.dataprofiler.core.ui.wizard.analysis.column.ColumnWizard.openEditor(ColumnWizard.java:126) org.talend.dataprofiler.core.ui.wizard.AbstractWizard.performFinish(AbstractWizard.java:70) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.dataprofiler.core.ui.action.actions.CreateNewAnalysisAction.run(CreateNewAnalysisAction.java:112) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:126) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",8 TDQ-6182,"Create version 5.2.0RC1 in Babili and populate it",NULL,2 TDQ-6184,"in remote project the refresh icon will not refresh the Recycle bin.","1. create two user aa and bb, both aa and bb have read-write rights to the remote project ""pro1"" 2. aa and bb user logon on the ""pro1"" at the same time. 3. aa delete an analysis to Recycle bin, refresh the Repository on bb side, the deleted analysis won't show in bb's Repository, but also won't show in Recycle bin. but if now bb want to create an analysis, just set same name with deleted one, so can not successfully, but he can not also see the existed one. note: restart studio, the analysis will show in Recycle Bin.",5 TDQ-6185,"rename report folder, get some redudant folders .","1. logon remote project, create a folder under Reports nodes. 2. try to rename it to a new name, the new folder get, but at the same time get some redundant folders and the old folder name under it(sometimes need to refresh Repository to show the redundant folder) in fact I also reproduce this on local project, but now can not, just reproduced on remote project. besides, pay attention to the move function of report and folder under Report. ",13 TDQ-6186,"Pattern Test view does not work with Hive","Use a hive connection to test pattern. The generated query is invalid. For instance, it is SELECT 'Bejin' REGEXP '^[A-Z]*$' ; The returned error is java.sql.SQLException: Query returned non-zero code: 11, cause: FAILED: Parse Error: line 1:23 cannot recognize input near ''^[A-Z]*$'' ';' '' in constant",5 TDQ-6193,"Pattern frequency indicator drill down function -- ""generate regex pattern"" can not work","run column analysis with pattern frequency indicator turn to result page, visit drill down function -- ""generate regex pattern"" will get this error {code} java.lang.UnsupportedOperationException at org.talend.dataprofiler.core.pattern.CreatePatternWizardPage1.createExtendedControl(CreatePatternWizardPage1.java:91) at org.talend.dataprofiler.core.ui.wizard.MetadataWizardPage.createControl(MetadataWizardPage.java:218) at org.talend.dataprofiler.core.pattern.CreatePatternWizardPage1.createControl(CreatePatternWizardPage1.java:56) at org.eclipse.jface.wizard.Wizard.createPageControls(Wizard.java:170) at org.eclipse.jface.wizard.WizardDialog.createPageControls(WizardDialog.java:734) at org.eclipse.jface.wizard.WizardDialog.createContents(WizardDialog.java:606) at org.eclipse.jface.window.Window.create(Window.java:431) at org.eclipse.jface.dialogs.Dialog.create(Dialog.java:1089) at org.talend.dataprofiler.core.ui.utils.OpeningHelpWizardDialog.create(OpeningHelpWizardDialog.java:65) at org.eclipse.jface.window.Window.open(Window.java:790) at org.talend.dataprofiler.core.pattern.actions.CreatePatternAction.run(CreatePatternAction.java:123) at org.talend.dataprofiler.core.ui.editor.preview.model.ChartTableFactory.createPattern(ChartTableFactory.java:474) at org.talend.dataprofiler.core.ui.editor.preview.model.ChartTableFactory$1$2.widgetSelected(ChartTableFactory.java:178) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}",1 TDQ-6194,"""Analyze duplicate"" option doesn't appear on a table analysis with join condition","Usually, when the DQ rule contains a join clause and there are more analyzed data in the joint than in the analyzed table, a new menu appears ""Analyze duplicate"". In the attached analysis, the rows of the join (7 rows)are more than the rows of the analyzed table (6 rows) because the columns used in the join contain duplicate values. But when I right click the join results, I don't have the ""analyze duplicate"" option, see attached capture. I think this option should appear whenever the rows of the join are more than those of the analyzed table.",8 TDQ-6200,"After switch context of a connection, the reload the table schema doesn't work well","create a DB connection, export context configured two context params group, has the same server but different catalog group A -- catalog A, group B -- catalog B, default is A the do switch context function, and reload this connection manually the catalog should change to B, file connection: switch context function sometimes will throw an NPE if success switch, after switch context, click ""guess schema"" function to reload table schema sometimes will throw an NPE {code} java.lang.NullPointerException org.talend.dataprofiler.core.ui.action.actions.SwitchContextAction.run(SwitchContextAction.java:69) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:127) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}",20 TDQ-6203,"Data Quality - Retrieve Schema ""corrupts"" Analysis ","Hi! DQ Project with one metadata database connection specified and one Data Profiling - Column Analysis created, analysing one of the tables. From the Integration Perspective, we choose to retrieve (unchanged) schema, and select all. Then we go to Profiling Perspective and open the Column Analysis -> all the columns have disappeared from the GUI. Tool needs to display warning message to user when retriving all schemas, since existing analysis will become unusable (and very difficult to repair). For more detailed information, please see attached Word document.",5 TDQ-6204," the move folder which contains items function doesn't change the client tag value in remote project","1. logon a remote project. 2. create an analysis in folder 'a' 3. try to move folder 'a' to folder 'b', after finished check the client tag in dbconnection, it is still the older one, doesn't contains the 'b' part. do same operation for a norminal dbconnection, after this, check the ""(HiveConnection.java:67) org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:104) java.sql.DriverManager.getConnection(DriverManager.java:582) Why do we try to connection with the Hive driver to a mysql connection? java.lang.RuntimeException: java.lang.RuntimeException: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown database 'my_person_joins' org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.getConnection(ExtractMetaDataUtils.java:655) Now the connection is deleted. See attached log for more details. Build: Talend-Studio-r90934-V5.2.0NB",8 TDQ-6211,"Missing range indicator","See attached screen capture. In previous version (4.1.2 in the attached picture), the range was computed and displayed in the result tab. Now, it's not. Please, fix the issue. ",5 TDQ-6224,"Export babili translations into trunk of SVN",NULL,2 TDQ-6227,"migrate oracle datamart failed "," try to migrate the lower version oracle datamart(4.1.x,4.2.x) to current version, but faild. ",8 TDQ-6232,"Generate auto-configured analysis from tables (or columns)","h3. UI level : - add a menu on the table node in the DQ repository view (DB table or file table) called: ""Guess column analysis"" - add the same menu on the contextual menu when selecting a set of columns h3. backend level - the action of this menu will do the following: ## get the semantic of the columns ## find concepts in ontology repository with similar semantics ## select indicators that can apply to the columns given their semantic and the information stored in the semantic repository ## set thresholds in indicators whenever possible ",13 TDQ-6233,"the result for invalid items about Benford Law Frequency is not correct in sql mode.","* BUG 1 1. create a column analysis , add Benford Law Frequency indicator. 2. check the result, the invalid result is not correct in sql mode. java is correct. for the sql mode, check the ""View executed query"" result: SELECT cast(LEFT(`NAME`,1) as char), COUNT(*) c FROM `dba`.`data_benford_law` t GROUP BY LEFT(`NAME`,1) order by LEFT(`NAME`,1) LIMIT 10 what the ""limit 10"" mean. * BUG 2 beside. for sybase user the indicator, can not get any result, just get error(in Details tab) * BUG 3 View row of ""invalid"" always gives empty result. ",8 TDQ-6235,"Benford law indicator - make the color as red in statistics table of anaysis result page ",NULL,1 TDQ-6236,"modify the duplicate analysis, the old analysis is modified too","duplicate an analysis (A) with a where condition then delete the where condition from the duplicated one(Copy_A), the old analysis(A) where condition is deleted too",8 TDQ-6237,"the rename folder function change the 'path' to uncorrect result","1. create a dbconnection in a folder. 2. rename the folder, check the value of path ""path=""metadata/connections/dd/aa""/"" should not show the metadata/connections/ this issue also exist on other kinds of items",13 TDQ-6241,"generate basic report about column analysis just get a blank content file","generate a report with a column analysis, basic type. check the generated report file, no any content in it. no error, any datamart can reproduce there is no 513 build these days, please dev check the root reason, and verify this issue exist on 513 or not, thanks.",8 TDQ-6242,"overview report can not generate successfully with hsql db.","1. try to generate a overview report with hsql db, but get error. error attached on details tab please dev check the root reason, and make sure this issue exist on 513 or not, we can get TDQ build recent day, do can not check, thanks",5 TDQ-6243,"the blank count result for sybase is incorrect, the result is always 0","the blank count result for sybase is incorrect. the result is always 0",8 TDQ-6244,"Fix unrecognized median indicator definition issue on branch 5.1 and 5.0 - related to TDQ-5381","on branch 5.1 the new created is correct the migrated median indicator is still ""unrecognized"" branch 5.0 the new indicator and migrated both are ""unrecognized""",2 TDQ-6252,"TOP should not try to connect to the analyzed database during report generation, if the ""Refresh"" option is not checked for this analysis.","When the ""Refresh"" option is not checked for this analysis, the report is generated based on the stored results in the analysis, database connection is not needed.",8 TDQ-6253,"Cannot create pattern","Try the ""New Regex Pattern"" menu in Libraries/Pattern/Regex folder or subfolders. It gives the exception: java.lang.UnsupportedOperationException at org.talend.dataprofiler.core.pattern.CreatePatternWizardPage1.createExtendedControl(CreatePatternWizardPage1.java:91) at org.talend.dataprofiler.core.ui.wizard.MetadataWizardPage.createControl(MetadataWizardPage.java:218) at org.talend.dataprofiler.core.pattern.CreatePatternWizardPage1.createControl(CreatePatternWizardPage1.java:56) at org.eclipse.jface.wizard.Wizard.createPageControls(Wizard.java:170) at org.eclipse.jface.wizard.WizardDialog.createPageControls(WizardDialog.java:734) at org.eclipse.jface.wizard.WizardDialog.createContents(WizardDialog.java:606) at org.eclipse.jface.window.Window.create(Window.java:431) at org.eclipse.jface.dialogs.Dialog.create(Dialog.java:1089) at org.talend.dataprofiler.core.ui.utils.OpeningHelpWizardDialog.create(OpeningHelpWizardDialog.java:65) at org.eclipse.jface.window.Window.open(Window.java:790) at org.talend.dataprofiler.core.pattern.actions.CreatePatternAction.run(CreatePatternAction.java:123) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",5 TDQ-6259,"Results of analysis with email JUDI are lost","Create a column analysis with the Email Java UDI. Run the analysis. See the results. Restart the studio, open the analysis. Switch to the result tab, it's empty: all results are set to 0. ",5 TDQ-6261,"open the ""Configuration wizard"" on double click on the tMatchGroup component",NULL,8 TDQ-6265,"Can not unfold columns in Data Explorer perspective after some actions","1.create a new connection with mysql tbi 2.unfold all columns under table 'customer' in DQ perspective 3.turn to Data Explorer perspective, open the Database Structure view,Generate 2 sql under table 'customer' by the context menu,they run well on sql editor. 4.close all editor in Data Explorer perspective,turn to DQ perspective and unfold table 'customer'. 5.turn to Data Explorer perspective,try to unfold table 'employee' or others,will be fail and get an error: java.lang.NullPointerException at net.sourceforge.squirrel_sql.fw.sql.SQLDatabaseMetaData.privateGetJDBCMetaData(SQLDatabaseMetaData.java:1571) at net.sourceforge.squirrel_sql.fw.sql.SQLDatabaseMetaData.getColumnInfo(SQLDatabaseMetaData.java:1469) at net.sourceforge.squirrel_sql.fw.sql.SQLDatabaseMetaData.getColumnInfo(SQLDatabaseMetaData.java:1497) at net.sourceforge.sqlexplorer.dbstructure.nodes.TableNode.getColumnNames(TableNode.java:146) at net.sourceforge.sqlexplorer.dbstructure.nodes.ColumnFolderNode.loadChildren(ColumnFolderNode.java:92) at net.sourceforge.sqlexplorer.dbstructure.nodes.AbstractNode.load(AbstractNode.java:337) at net.sourceforge.sqlexplorer.dbstructure.nodes.AbstractNode.getChildNodes(AbstractNode.java:129) at net.sourceforge.sqlexplorer.dbstructure.DBTreeContentProvider.getChildren(DBTreeContentProvider.java:50) at org.eclipse.jface.viewers.AbstractTreeViewer.getRawChildren(AbstractTreeViewer.java:1354)",1 TDQ-6271,"Hide data of small groups in tMatchGroup configuration wizard","When we click on ""hide groups less than X items"", the data currently don't change. They should change according to the displayed groups. ",8 TDQ-6272,"Create version 5.2.0RC2 in Babili and populate it",NULL,2 TDQ-6286,"fix the problem of connection field in analysis editor","steps to reproduce: 1. prepare environment and import the item package of TDQ-6207 2. open the imported analysis, the connection field shows the first one of all in alphabetical order",3 TDQ-6287,"fix the issue when we save a modified connection in DI perspective","In the context of TDQ-6207, if we 1. open a dbconnection editor 2. switch to DI perspective 3. modify and save 4. switch back to Profiler perspective Then if I modify the name of the connection and save. ex: from AA to BB, but the repository node is not renamed following this operation. Continue to change from BB to CC, the repository node is now renamed to BB but not CC. ",8 TDQ-6290,"Simplify manual installation of DQ Portal","create ""install.sh"" script. This script is at the root of the DQ portal zip. Execute it with the following command: sh install.sh then follow the instructions (the script displays the required parameters, run it again with the appropriate parameters). ",3 TDQ-6291,"for the structure can not show correctly for sybase.","1. in my sybase database, have two login name : a1(default catalog-catalogA), a2. two catalog: catalogA, catalogB. schema under catalogA:schemaA(a1), schema under catalogB: schemaB(a2). 2. try to create a sybase connection:with userName:a1, with no ""Database"" set--so two catalogs show. 3. check the schema under the two catalogs, schemaA show under the two catalogs, just should show under catalogA. schemaA show under catalogB with no tables 4. if we create the dbconnection set the catalog, the schema will just show under its own catalog. ",13 TDQ-6303,"import udi indicator of test2.csv, can't get the warning information and the ""finish"" button can't enabled too.","About the test case TDQQA-2952:Import indicators when import the attachment file ""test2.csv"",you should see an warning in the dialog header saied ' Some value are not be surrounded by quotation marks' and see an text field with warning icon in the preview table and the 'finish' should ""enabled."",but there is no warning showned in the import dialog, and the 'finish' button is ok.",3 TDQ-6308,"In UDI selection dialog uncheck a udi or button deselect all doesn't work","in UDI selection dialog, uncheck one udi or click button ""deselect all"" to remove the udi editor didn't change to ""dirty"", means disable to save reopen the editor, it's still there",3 TDQ-6313,"Export babili translations into trunk of SVN",NULL,2 TDQ-6318,"for the top and tdq can not show same structure of sqlserver","1. create a sqlserver connection on tdq, set the catalog filter. 2. after finished.check the schema under the catalog. 2. do step 1-2 on top. the schema under the catalog is defferent on top and tdq",2 TDQ-6323,"improve description fields in Detail view","Carriage return are not well rendered in the detail view. Expand the description field over several lines in order to be able to display correctly the description with several lines. ",5 TDQ-6329,"In column set analysis editor, remove pattern by the pattern selection dialog will keep icons ","in column set analysis remove some patterns by the pattern selection dialog pattern labels are removed but the icon keeps.. and click those icon will get this error {code} org.eclipse.swt.SWTException: Widget is disposed at org.eclipse.swt.SWT.error(SWT.java:4083) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.SWT.error(SWT.java:3969) at org.eclipse.swt.widgets.Widget.error(Widget.java:468) at org.eclipse.swt.widgets.Widget.checkWidget(Widget.java:340) at org.eclipse.swt.widgets.Widget.getData(Widget.java:554) at org.talend.dataprofiler.core.ui.editor.composite.AbstractColumnDropTree.openIndicatorOptionDialog(AbstractColumnDropTree.java:306) at org.talend.dataprofiler.core.ui.editor.composite.AbstractColumnDropTree$1.mouseDown(AbstractColumnDropTree.java:143) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:185) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}",8 TDQ-6343,"Create version 5.2.0 in Babili and populate it",NULL,2 TDQ-6347,"three pattern show as 'null' after restart the studio.","1. open the TOP project. 2. exit, reopen. the pattern show as 'null'",3 TDQ-6348,"make sure the ""refresh"" unchecked, the generated report file will show one item more times.","1. create a report file , check the refresh check box unchecked. 2. generate the report file, for the N times you generated, the items will show N times. refer to the attached pdf this not only exist on column analysis report, but other kinds of analysis. please find the root reason, and also make sure work well when the item checked.",3 TDQ-6351,"Export babili translations into trunk of SVN",NULL,2 TDQ-6356,"can not create sqlserver connection without user/passwd","1. try to create a sqlserver connection with ""Microsoft SQL Server"" selection in the wizard, 2. just put the server information. 3. click check ""ok"" both on tdq and top. 4. finished, ok on top, failed on TDQ(get error). on TOP can create analysis, but failed to run. get error,same error on tdq, attached to ""Details"" tab. work well on top 92510-5.1.2",3 TDQ-6360,"after the ETL generated, the analysis can not run .","1. create a column analysis. select some indicator and pattern. run. 2. turn to analysis result page, right click on the Unique/Distinct/Duplicate count t->""Remove deduplicate"". generate a job, run it, turn back to dq, re-run then anaysis get error(you can also right lick on pattern, to get invalid/valid data job): !ENTRY org.talend.platform.logging 4 0 2012-10-23 18:08:16.120 !MESSAGE 2012-10-23 18:08:16,119 ERROR org.talend.dq.analysis.ColumnAnalysisSqlExecutor - No schema found for columnstuAddress reopen the analysis, all columns gone, restart studio doesn't work. try to unfold a table which doesn't load before get error. attached on ""Details"" tab. for developer, please investigate the root reason, and check whether reproduce on other branch, I can not get build for other branch now, thanks very much. ",2 TDQ-6372,"Remove duplicate job one issue: if one table name exist under two different catalog, when try to ""remove duplicate"" or ""get invalid job"" can not get the structure correctly.",NULL,1 TDQ-6375,"Change the column analysis editor to display the data","See attached Mockup.",20 TDQ-6384,"Refactor the magic class DBConnectionFillerImpl ","In DBConnectionFillerImpl.java, take fillSchemaToCatalog() method as an example: {code:java} fillSchemaToCatalog(Connection dbConn, DatabaseMetaData dbJDBCMetadata, Catalog catalog, List schemaFilter) {code} Currently every type of database will call this method, in it's body, there are many if/else to adapt database types. such as {code:java} if(dbJDBCMetadata instanceof SybaseDatabaseMetaData) if (!(MetadataConnectionUtils.isPostgresql(dbJDBCMetadata) || MetadataConnectionUtils .isSybase(dbJDBCMetadata))) { if (MetadataConnectionUtils.isMssql(dbJDBCMetadata) && dbJDBCMetadata.getDatabaseMajorVersion() > 8 && dbJDBCMetadata.getDriverMajorVersion() > 1) { {code} This is really bad code design, we need a better class hierarchy design pattern for this to meet all database type's needs. ",13 TDQ-6389,"for the sqlserver and postgresql connection can not show the structure correctly.","1. create a postgresql/sqlserver connection set or not set the catalog parameter(doesn't set the schema). 2. check the structure, only one schema show under each catalog. in fact I have several. please check it same issue as informix db.",8 TDQ-6395,"rename the dbconnection function doesn't work well","1. on dq perspective, create four dbconnections, named 'a','b','c','d' 2. create column analysis about 'b' and 'c' named 'b_analysis' and 'c_analysis', analysis can run well. 3. change to DI perspective, double click any dbconnection, to open the db configure wizard, just click 'cancel', no need to change anything. 4. back to dq, change the name of 'b' connection to 'bb', successfully. 5. reopen the b_analysis, can not show the dbname correctly, not 'bb' just a,c or d. issue 2: 6. turn to di, change the 'c' name to 'cc'. 7. back to dq, reopen 'c_analysis', the items gone. find this issue also on r93147-5.1.3 please dev check the root reason, and check 5.0.4 exist or not, we doesn't have 5.0.4 recent build. thanks. top seems ok. ",8 TDQ-6435,"tMatchGroup configuration wizard fails to refresh when using context variables in input component","The tMatchGroup configuration drops an error when using context variables in the input component when you click on refresh button in the wizard. see screenshot for detailed description.",3 TDQ-6424,"Email validation new UDI does not launch in an analysis","I add the email validation udi in an column anaylis on an email data (the one in cust data examples of the DQDEMO project). The analysis does not even run. State is null. see screenshots.",3 TDQ-6434,"Not Possible to view Source Files like .sql","Not Possible to view Source Files like .sql See ScreenShot ",5 TDQ-6430,"DQ Hive Profiling - Column Analysis progress bars do not show any text","See attached. ",2 TDQ-6429,"New Indicator Name is Inconsistent","As show in this screen shot, the new e-mail validation indicator has different names, depending upon whether it is on the Exchange or in the studio.",1 TDQ-6421,"DQ Studio - profiling HIVE 100% CPU","Running an overview analysis for a Hive connection on OSx and Unix causes 100% utilization for Studio.",8 TDQ-6407,"hide the Hortonworks connection from the TOS DQ","As the embedded mode is not working for profiling, we need to hide the hortonworks menu from the combo list when we are in TOS DQ. (We must still keep the menu when we are in TDQ) Same thing for the ""embedded"" mode of Cloudera. ",5 TDQ-6411,"Upgrade jasper report library","The current version of iReport is 4.0.2. Upgrade the jasper libraries and check that all TDQ reports still work. ",8 TDQ-6417,"cannot run analysis on hsqldb in TOS DQ","Run the 5.2.0 DQ portal. Connect to the tdqportal hsql database from TOS DQ. See attached item file. try to run an overview analysis. It fails because of an exception (see details tab).",5 TDQ-6437,"Fix NPE in TUP-273 (recycle bin deletion issue)",NULL,13 TDQ-6438,"Unreadable parameters in UDI","See attached capture. 1. When the focus is on an existing field, the text is duplicated. This is a minor issue, but it's confusing. 2. when you edit a parameter, it would be useful to switch to the next field with the ""tab"" key. ",3 TDQ-6439,"Create version 5.2.1 in Babili and populate it",NULL,2 TDQ-6441,"Export babili translations into 5.2 branch of SVN",NULL,2 TDQ-6445,"increase synonym result table size when in full screen","The current result table does not fit the window when the view is in full screen. It must. See screen capture.",2 TDQ-6450,"time analysia can not show the relationship when one varchar value just have one datetime corresponding","1. create a time correlation analysis with address+date column. 2. run no data show in the result chart. refer to the pic. I also have attached the table used. use data from tbi->bith_date + position_title is ok.",1 TDQ-6455,"mssql database compare several times will check failed and cannot do compare anymore","create a mssql database connection, do several times database compare will pop up a dialog says: check connection failure ... and throw this error {code} java.lang.reflect.InvocationTargetException org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(Unknown Source) org.talend.cwm.compare.ui.actions.PopComparisonUIAction.run(Unknown Source) org.talend.cwm.compare.ui.actions.SubelementCompareAction.openComparisonEditor(Unknown Source) org.talend.cwm.compare.ui.actions.SubelementCompareAction.run(Unknown Source) org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.performCompareAction(Unknown Source) org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer.access$1(Unknown Source) org.talend.cwm.compare.ui.views.CompareModelContentMergeViewer$CompareMouseListener.mouseDoubleClick(Unknown Source) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: org.eclipse.emf.ecore.resource.impl.ResourceSetImpl$1DiagnosticWrappedException: org.eclipse.emf.ecore.xmi.IllegalValueException: Value 'orgomg.cwm.resource.relational.impl.CatalogImpl@4d1d5468 (name: rootdb, visibility: vk_public) (defaultCharacterSetName: null, defaultCollationName: null)' is not legal. (platform:/resource/TOP_DEFAULT_PRJ/metadata/connections/.refreshccccccccccccccccccccccccccccccccccc.comp, -1, -1) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.handleDemandLoadException(ResourceSetImpl.java:315) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.demandLoadHelper(ResourceSetImpl.java:274) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.getResource(ResourceSetImpl.java:397) org.talend.dq.writer.EMFSharedResources.getResource(Unknown Source) org.talend.cwm.compare.factory.comparisonlevel.TableViewComparisonLevel.createTempConnectionFile(Unknown Source) org.talend.cwm.compare.factory.comparisonlevel.AbstractComparisonLevel.popComparisonUI(Unknown Source) org.talend.cwm.compare.ui.actions.PopComparisonUIAction$1.run(Unknown Source) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 35 more Caused by: org.eclipse.emf.ecore.xmi.IllegalValueException: Value 'orgomg.cwm.resource.relational.impl.CatalogImpl@4d1d5468 (name: rootdb, visibility: vk_public) (defaultCharacterSetName: null, defaultCollationName: null)' is not legal. (platform:/resource/TOP_DEFAULT_PRJ/metadata/connections/.refreshccccccccccccccccccccccccccccccccccc.comp, -1, -1) org.eclipse.emf.ecore.xmi.impl.XMLHandler.setFeatureValue(XMLHandler.java:2663) org.eclipse.emf.ecore.xmi.impl.XMLHandler.handleForwardReferences(XMLHandler.java:1149) org.eclipse.emf.ecore.xmi.impl.XMLHandler.endDocument(XMLHandler.java:1228) com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endDocument(Unknown Source) com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source) com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source) com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(Unknown Source) org.eclipse.emf.ecore.xmi.impl.XMLLoadImpl.load(XMLLoadImpl.java:181) org.eclipse.emf.ecore.xmi.impl.XMLResourceImpl.doLoad(XMLResourceImpl.java:180) org.eclipse.emf.ecore.resource.impl.ResourceImpl.load(ResourceImpl.java:1494) org.eclipse.emf.ecore.resource.impl.ResourceImpl.load(ResourceImpl.java:1282) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.demandLoad(ResourceSetImpl.java:255) org.eclipse.emf.ecore.resource.impl.ResourceSetImpl.demandLoadHelper(ResourceSetImpl.java:270) ... 41 more Caused by: java.lang.IndexOutOfBoundsException: targetIndex=1, size=1 org.eclipse.emf.common.util.BasicEList.move(BasicEList.java:664) org.eclipse.emf.common.notify.impl.NotifyingListImpl.doMove(NotifyingListImpl.java:1335) org.eclipse.emf.common.notify.impl.NotifyingListImpl.move(NotifyingListImpl.java:1320) org.eclipse.emf.ecore.xmi.impl.XMLHelperImpl.setValue(XMLHelperImpl.java:1195) org.eclipse.emf.ecore.xmi.impl.XMLHandler.setFeatureValue(XMLHandler.java:2658) ... 57 more {code}",8 TDQ-6456,"the inform information is not correct when try to rename an analysis to an existing one.","1. create an analysis named 'aa' 2. create another analysis named 'bb' 3. open 'bb', try to rename to 'aa' get infrom dialog This physical file(""bb"") already exists! Check if it's in the Recycle Bin or another folder. I think we should not show 'bb' it, should be 'aa' test on V5.2.1NB-r93900,V5.1.3NB-r93897,V5.0.4NB-r93900",1 TDQ-6457,"add generate job menu in the result chart of column set analysis",NULL,5 TDQ-6458,"Fail to add dependeces when select analysis in report editor","1.create a column analysis 2.create a report by context menu on ""Reports"" folder node 3.in the report editor,click ""select analyses"" and select an analysis then save. 4.open the report file,can't see the tag """"; open the analyis file,can't see the tag """". if generate a report by context menu on analysis node,it will be ok.",8 TDQ-6467,"System pattern -- ""Email Address"" get different result between SQL engine and Java engine","system resource -- Pattern -> Regex -> internet -> Email Address run with column analysis on SQL engine and Java engine get the different result take a look at the screen shot",5 TDQ-6468,"upgrade the hive libraries to 0.9.0",NULL,5 TDQ-6469,"Can not generate report","1.create a column analysis 2.create a report based on this analysis 3.set the datamart,then click generate report button,get a NPE,and the report doc is empty: java.lang.NullPointerException at org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:108) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:156) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:140) at org.talend.dq.analysis.ReportExecutor.execute(ReportExecutor.java:58) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.runReport(ReportDocGenerator.java:335) at org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:185) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:120) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)",2 TDQ-6471,"DQ rule analysis generate a job to get valid/invalid rows, the generated sql is incorrect","the generated job by DQ rule analysis can not run well because the sql is incorrect it like this: ""SELECT [..,..] FROM tablename WHERE (( [Conditions] )) WHERE "" the last ""where"" is needless",2 TDQ-6472,"try to duplicate a parser rule, no actions","1. create a parser rule. 2. right click it, try to duplicate one. no actions.",8 TDQ-6478,"connection analysis about oracle/teradata db get error","1. create an oracle/teradata connection analysis. 2. create a connection analysis about this connection. the analysis run get error and the progress bar seems different with before. test on build r94135-5.1.3 this issue doesn't show.",1 TDQ-6480,"Benford Law Frequency indicator chart doesn't show the column which data is zero in generated report file","Benford law frequency indicator chart in report file is incorrect if the column contains no data, it will not show in report for eg: the ""3"", ""4"" column is 0.0%, then these two columns will not appear in report document",5 TDQ-6481,"SQL syntax error when use tOracleValidRow and tOracleInValidRow ","Test jobs have been uploaded. Job TestCase_tOracleXXRow_11 obtain throw error: Exception in component tOracleInvalidRows_2 java.sql.SQLSyntaxErrorException: ORA-00933: SQL 命令未正确结束 Job TestCase_tOracleXXRow_connect_11 obtain throw error: Exception in component tOracleValidRows_1 java.sql.SQLSyntaxErrorException: ORA-01741: 非法的零长度标识符 ",5 TDQ-6484,"Refactoring the code of loading jars in Hive embedded mode","After this TDI-23768 sub-task is finished, we must refacoring code for hive embedded mode. Now it's in a separate execution sequence comparing to standard hive mode.",8 TDQ-6485,"for oracle open the dbconnection wizard by the ""edit"" button, do nothing but inform user to reload.","issue 1: 1. create an oracle dbconnection set filter or not. 2. create a column analysis about this connection. 3. open the connection editor, click the ""edit"". then the wizard pop up. change nothing, but click ""check"" then click ""Finish"" there will the reload dialog popup--but I didn't change anything. if don't click ""check"", just click ""Finish"", no wizard popup issue 2: redo issue 1's step , but for step 3, remove the schema filter in the wizard, then finish the wizard, so all the sachems show. but check the analysis , columns gone. check the first schema--the number behind ""Tables"" is '0' test on r93900-5.0.4, and r94217-5.1.3, the issue exists. issue 3: for issue 1, if we click check, and during the wizard, we change the name of the connection,then at the pop up dialog we click ""reload"" , then recheck the analysis, all columns gone. and in the repository still the old name. ",5 TDQ-6487,"connection analysis about which contains both catalog and schema after execution cannot expand the result automatically","run a connection overview analysis which contains both catalog and schema structure cannot expand the result automatically(Statistical information section) and throw an SWT error: {code} org.eclipse.swt.SWTException: Failed to execute runnable (java.lang.IllegalArgumentException: Index out of bounds) at org.eclipse.swt.SWT.error(SWT.java:4083) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:137) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.IllegalArgumentException: Index out of bounds at org.eclipse.swt.SWT.error(SWT.java:4064) at org.eclipse.swt.SWT.error(SWT.java:3998) at org.eclipse.swt.SWT.error(SWT.java:3969) at org.eclipse.swt.widgets.Widget.error(Widget.java:468) at org.eclipse.swt.widgets.Table.getItem(Table.java:2496) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractFilterMetadataPage.refresh(Unknown Source) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractFilterMetadataPage.fireRuningItemChanged(Unknown Source) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(Unknown Source) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) ... 23 more {code}",5 TDQ-6502,"Export babili translations into trunk of SVN",NULL,2 TDQ-6506,"after migration,some analysis can not run well","1. just migration file from 424 and 503 but the migrated file can not run well. seems most are about oracle. I have attached all the error log file, about each kind of indicator. during the migration no errors. for file from 424 I can migrate to 511 successfully. ",8 TDQ-6507,"Reduce the number of connection creation when reloading table folder.","At AbstractComparisonLevel.reloadCurrentLevelElement() , it will call database connecting low level method many times (4 at least). It can bring really performance issues, optimize it.",8 TDQ-6511,"fix the issue when ""Use an existing connection"" (Error ORA-01741)","when tValidRows uses ana existing connection, the schema value is contained in the selected tConnection component, and the schema in tValidRows is empty. That's why we got ""select ... from \""\"".\""TableName\"" ..."" as generated query. Note that for Postgresql database, the schema param is compulsary, we must retrieve this value from the tConnection component.",5 TDQ-6512,"a ""generate job"" menu appears in Talend Open Studio for Data Quality","a ""generate job"" menu to extract distinct values from a frequency table is available in a 5.2.1.NB-r93795 community build for data quality. See attached capture. this menu should be available only in subscription builds.",3 TDQ-6516,"for TOS_DQ the welcome page is still the old one, but for other SE build seem with the new one.","we'd better make sure the welcome same as other product, with the new one.",3 TDQ-6519,"backport to 5.1","This parent is TDQ-6287.",2 TDQ-6523,"make sure the preview function can be used when the connection is hive embedded mode.",NULL,2 TDQ-6539,"Disable the ""Run Report"" button after clicked and reset to enabled after the report generation is done.","The behavior should be like the current ""Execute Analysis"" button. A known issue if we do not do this: User may double click the button and the indicator values will be inserted twice with the same timestamp, and this will change the final results, ex: all benford percertage results will be divided by 2.",5 TDQ-6549,"Fix the wrong title","From this bug: TDQ-5467 When the analyzed column is filtered out from DQ repository view, it will popup a dialog to notify user that the column is hiding. But the title of this dialog is not correct.",1 TDQ-6550,"Open warning dialog to user when the SQL expression had been removed from indicator definition when runing the analysis","From this issue: TDQ-5645 The error will go into error viewer, but it's better to popup a message dialog to notifying. The message can be: ""Expression of is not found from indicator definition, do you want to add a new expression?"" Yes, open definition editor No, do nothing",1 TDQ-6557,"after create a MDM connection, then edit it, can not reload it again","issue1: after create a MDM connection, then edit it(for example: change data-Model, data-Container to Product), can not reload it issue2: note: after duplicate a MDM connection which can be unfolderred, can not unfolder it",8 TDQ-6571,"Limit result in advance indicator option pannel loose effect on Ingres DB ","Run the attached analysis and see the analysis result.",5 TDQ-6587,"rename the FileConnection sometimes, there will throw Exceptions","open the FileConnection wizard and click cancel first, if open the FileConnection wizard again and modify the name, there will throw Exceptions {code} java.lang.reflect.InvocationTargetException org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:116) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:98) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.computePagination(ColumnMasterDetailsPage.java:417) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createPaginationTree(ColumnMasterDetailsPage.java:368) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createAnalysisColumnsSection(ColumnMasterDetailsPage.java:347) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createFormContent(ColumnMasterDetailsPage.java:237) org.eclipse.ui.forms.editor.FormPage$1.run(FormPage.java:152) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.forms.editor.FormPage.createPartControl(FormPage.java:150) org.eclipse.ui.forms.editor.FormEditor.pageChange(FormEditor.java:471) org.talend.dataprofiler.core.ui.editor.CommonFormEditor.pageChange(CommonFormEditor.java:231) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.pageChange(AnalysisEditor.java:190) org.eclipse.ui.part.MultiPageEditorPart.setActivePage(MultiPageEditorPart.java:1067) org.eclipse.ui.forms.editor.FormEditor.setActivePage(FormEditor.java:603) org.eclipse.ui.part.MultiPageEditorPart.createPartControl(MultiPageEditorPart.java:352) org.eclipse.ui.internal.EditorReference.createPartHelper(EditorReference.java:670) org.eclipse.ui.internal.EditorReference.createPart(EditorReference.java:465) org.eclipse.ui.internal.WorkbenchPartReference.getPart(WorkbenchPartReference.java:595) org.eclipse.ui.internal.PartPane.setVisible(PartPane.java:313) org.eclipse.ui.internal.presentations.PresentablePart.setVisible(PresentablePart.java:180) org.eclipse.ui.internal.presentations.util.PresentablePartFolder.select(PresentablePartFolder.java:270) org.eclipse.ui.internal.presentations.util.LeftToRightTabOrder.select(LeftToRightTabOrder.java:65) org.eclipse.ui.internal.presentations.util.TabbedStackPresentation.selectPart(TabbedStackPresentation.java:473) org.eclipse.ui.internal.PartStack.refreshPresentationSelection(PartStack.java:1254) org.eclipse.ui.internal.PartStack.setSelection(PartStack.java:1207) org.eclipse.ui.internal.PartStack.showPart(PartStack.java:1606) org.eclipse.ui.internal.PartStack.add(PartStack.java:497) org.eclipse.ui.internal.EditorStack.add(EditorStack.java:103) org.eclipse.ui.internal.PartStack.add(PartStack.java:483) org.eclipse.ui.internal.EditorStack.add(EditorStack.java:112) org.eclipse.ui.internal.EditorSashContainer.addEditor(EditorSashContainer.java:63) org.eclipse.ui.internal.EditorAreaHelper.addToLayout(EditorAreaHelper.java:225) org.eclipse.ui.internal.EditorAreaHelper.addEditor(EditorAreaHelper.java:213) org.eclipse.ui.internal.EditorManager.createEditorTab(EditorManager.java:778) org.eclipse.ui.internal.EditorManager.openEditorFromDescriptor(EditorManager.java:677) org.eclipse.ui.internal.EditorManager.openEditor(EditorManager.java:638) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditorBatched(WorkbenchPage.java:2860) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditor(WorkbenchPage.java:2768) org.eclipse.ui.internal.WorkbenchPage.access$11(WorkbenchPage.java:2760) org.eclipse.ui.internal.WorkbenchPage$10.run(WorkbenchPage.java:2711) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2707) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2691) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:2674) org.talend.dataprofiler.core.CorePlugin.openEditor(CorePlugin.java:298) org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction.duRun(OpenItemEditorAction.java:133) org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction$1.run(OpenItemEditorAction.java:117) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:84) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:217) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3011) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1851) org.talend.dataprofiler.core.ui.action.actions.OpenItemEditorAction.run(OpenItemEditorAction.java:124) org.talend.dataprofiler.core.ui.utils.WorkbenchUtils.refreshCurrentAnalysisEditor(WorkbenchUtils.java:393) org.talend.dataprofiler.core.service.TOPRepositoryService.refreshCurrentAnalysisEditor(TOPRepositoryService.java:514) org.talend.repository.ui.wizards.metadata.connection.files.delimited.DelimitedFileWizard.performFinish(DelimitedFileWizard.java:360) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.dataprofiler.core.ui.action.actions.EditFileDelimitedAction.run(EditFileDelimitedAction.java:55) org.talend.dataprofiler.core.ui.views.DQRespositoryView$6.mouseDoubleClick(DQRespositoryView.java:463) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:77) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:616) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.NullPointerException org.talend.dataprofiler.core.model.impl.ModelElementIndicatorImpl.getElementName(ModelElementIndicatorImpl.java:778) org.talend.dataprofiler.core.model.impl.DelimitedFileIndicatorImpl.getElementName(DelimitedFileIndicatorImpl.java:40) org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.getModelElemetnDisplayName(AnalysisColumnTreeViewer.java:726) org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.addItemElements(AnalysisColumnTreeViewer.java:514) org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.setElements(AnalysisColumnTreeViewer.java:405) org.talend.dataprofiler.core.ui.editor.analysis.MasterPaginationInfo.render(MasterPaginationInfo.java:74) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 97 more {code}",3 TDQ-6589,"Column Content Comparison analysis drill down menu ""view match/not match rows"" with informix database cannot work","try to visit ""view match/not match rows"" function of content comparison analysis with informix database connection I got an error dialog says ""A syntax error has occurred."" and no result same as issue TDQ-6570, the query is wrong",5 TDQ-6610,"Analysis editor composite will got chaos after execution in DI perspective","run an analysis in DI perspective turn back to DQ perspective, the composite got be like the screenshot and failed run in DI {code} java.lang.reflect.InvocationTargetException at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) at org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:116) at org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:98) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createPreviewCharts(ColumnMasterDetailsPage.java:600) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.refresh(ColumnMasterDetailsPage.java:628) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.fireRuningItemChanged(AbstractAnalysisMetadataPage.java:210) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:339) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.NullPointerException at org.talend.dataprofiler.core.ui.views.ColumnViewerDND.installDND(ColumnViewerDND.java:106) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.createTree(AnalysisColumnTreeViewer.java:207) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.setElements(AnalysisColumnTreeViewer.java:389) at org.talend.dataprofiler.core.ui.editor.analysis.MasterPaginationInfo.render(MasterPaginationInfo.java:69) at org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 35 more Root exception: java.lang.NullPointerException at org.talend.dataprofiler.core.ui.views.ColumnViewerDND.installDND(ColumnViewerDND.java:106) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.createTree(AnalysisColumnTreeViewer.java:207) at org.talend.dataprofiler.core.ui.editor.composite.AnalysisColumnTreeViewer.setElements(AnalysisColumnTreeViewer.java:389) at org.talend.dataprofiler.core.ui.editor.analysis.MasterPaginationInfo.render(MasterPaginationInfo.java:69) at org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) at org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:116) at org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:98) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createPreviewCharts(ColumnMasterDetailsPage.java:600) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.refresh(ColumnMasterDetailsPage.java:628) at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.fireRuningItemChanged(AbstractAnalysisMetadataPage.java:210) at org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:339) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:127) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}",3 TDQ-6611,"Fix labels issues in Benford law statistics","See attached screen capture. ",3 TDQ-6613,"Change labels of the frequency statistics chart","See attached screenshot. Please, consider the other chart too and feedback to me if you're not sure about the necessity of a change. ",3 TDQ-6617,"Develop a library for the report generation","This library will read reports, execute analyses, store the data in the data mart and (optionally) generate pdf reports. ",20 TDQ-6620,"Support Address Validation Vendor Loqate","Add support components for address validation partner Loqate (www.loqate.com) See Steve S. if additional technical API information or technical contacts are needed. Note: the category of this component will be ""Data_Quality/Address/Loqate"" ",13 TDQ-6633,"there is no drill down for duplicate cout which analyzed mdm column","1. crate a column analysis about mdm connection. 2. make the entity has some duplicate value, so we should get the drill down of duplicate count indicator, run the analysis with java engine, result is correct, but no drill down on table chart, on the pic chart, there is drill down, but can not get any result.",13 TDQ-6645,"cannot change an option in DQ to not store data in the analysis","The option store data with column set analysis is always checked even you changed and saved it comes back again.",2 TDQ-6654,"Refactorying http://talendforge.org/trac/top/changeset/95805#file0","What is the needed to call this method in Local project？ initChildForRemoteProject()",1 TDQ-6658,"Junit required for r95607",NULL,2 TDQ-6664,"so many warning show in error log when reload the connection setting","1.right click on Db connections and select Create connection 2.name it and click next 3.set Db Type as MySQL for example and fill valid connection information click check 4.after check succeeded click finish 5.double click the connection you just created to edit it 6.click ""Export as context"" or change the db info(such as db name),click check, after check succeeded click finish, you will be asked wether to reload the connection,select reload and click ok result: many warnings shown in error log Warning Thu Dec 27 14:59:31 CST 2012 2012-12-27 14:59:31,692 WARN org.talend.cwm.compare.factory.comparisonlevel.AbstractComparisonLevel - Element not updated: org.talend.core.model.metadata.builder.connection.impl.DatabaseConnectionImpl@524db33c (name: mysql, visibility: vk_public) (properties: {}, id: null, comment: , label: mysql, synchronised: false, divergency: false) (pathname: null, isCaseSensitive: false, version: null, ContextMode: false, ContextId: null, contextName: null) (DatabaseType: MySQL, DriverJarPath: null, DriverClass: org.gjt.mm.mysql.Driver, URL: jdbc:mysql://192.168.30.147:3306/test?noDatetimeStringSync=true, dbVersionString: MYSQL_5, Port: 3306, Username: root, Password: 1QY6ZyNqCD4BAhKeqSkILQ==, ServerName: 192.168.30.147, DatasourceName: , FileFieldName: , SID: test, SqlSynthax: SQL Syntax, StringQuote: "", NullChar: 000, DbmsId: mysql_id, ProductId: MYSQL, DBRootPath: null, AdditionalParams: noDatetimeStringSync=true, StandardSQL: true, SystemSQL: false, cdcTypeMode: null, SQLMode: false, UiSchema: ) Warning Thu Dec 27 14:59:22 CST 2012 NLS unused message: OpenJobScriptAction_OpenEditJobScript_text in: org.talend.metalanguage.jobscript.ui.actions.messages",3 TDQ-6663,"TableSelectionDialog can not dependency DQRepositoryNode.","create an analysis and move to DI perspective. open TableSelectDialog then have DQRepositoryView will openning whether do you have open it before that. should let TableIndicator save node information as ModelElementIndicator This issue is only existed in Table analysis. the problem is that the table selection in table analysis editor will require the DQ perspective being opened. Whereas it should not.",5 TDQ-6672,"for the low frequency indicator result in report and analysis is different for the sort order","1. create an analysis file select the low frequency indicator. 2. generate report about the indicator. 3. check the result the sort order in analysis and report is different. please make sure other low frequency indicator also same(bin low frequency is same now) ",5 TDQ-6674,"the result page should better change the catalog name to certain UDI name","1. create udi file 2. add to column analysis, 3. run analysis. 4. check result on result tab. the name of the udi just show the catalog name but not the certain udi name, we'd better change it: if we have more than one same kind of UDI, how to identify it. ",1 TDQ-6678,"the report template is not very correct for content compare analysis","1. create a content compare comparison analysis, select two column for left(id2,name2) and right(id2, name2) 2. create report about the analysis. 3. generate a basic report, then an evolution report. check the basic: will show 4 table charts, refer to the pic attached, in fact, the analysis get these result by compare left to right as a whole, but in report separate it to several for evolution report: get first and second two pages. if analysis contains only one column, only first page in my opinion only second page is enough. pay attention to dqportal.",8 TDQ-6686,"overview report generate failed when one table name in my analyzed db has a long name","1. create a dbconnection make sure it has a long name table. 2. create a overview report about the connection. 3. generate report, get error. {code} !MESSAGE 2013-01-07 15:00:50,097 ERROR org.talend.dq.persistence.DatabasePersistence - org.hibernate.exception.DataException: could not insert: [org.talend.dataprofiler.datamart.hibernate.TdqOverviewIndvalue] !STACK 0 org.hibernate.exception.DataException: could not insert: [org.talend.dataprofiler.datamart.hibernate.TdqOverviewIndvalue] org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:77) org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43) org.hibernate.id.insert.AbstractReturningDelegate.performInsert(AbstractReturningDelegate.java:40) org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:2093) org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:2573) org.hibernate.action.EntityIdentityInsertAction.execute(EntityIdentityInsertAction.java:47) org.hibernate.engine.ActionQueue.execute(ActionQueue.java:248) org.hibernate.event.def.AbstractSaveEventListener.performSaveOrReplicate(AbstractSaveEventListener.java:290) org.hibernate.event.def.AbstractSaveEventListener.performSave(AbstractSaveEventListener.java:180) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:108) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:186) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:33) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:175) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:27) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:70) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:535) org.hibernate.impl.SessionImpl.save(SessionImpl.java:523) org.hibernate.impl.SessionImpl.save(SessionImpl.java:519) sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.hibernate.context.ThreadLocalSessionContext$TransactionProtectionWrapper.invoke(ThreadLocalSessionContext.java:301) $Proxy19.save(Unknown Source) org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:133) org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.historizeData(ReportDocGenerator.java:450) org.talend.dataprofiler.core.tdq.action.ReportDocGenerator.generate(ReportDocGenerator.java:263) org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$1.run(GenerateReportFileAction.java:126) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: com.mysql.jdbc.MysqlDataTruncation: Data truncation: Data too long for column 'TV_NAME' at row 1 com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3376) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3310) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1853) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1976) com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2503) com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1737) com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2022) com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1940) com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1925) org.hibernate.id.IdentityGenerator$GetGeneratedKeysDelegate.executeAndExtract(IdentityGenerator.java:73) org.hibernate.id.insert.AbstractReturningDelegate.performInsert(AbstractReturningDelegate.java:33) ... 25 more {code}",3 TDQ-6687,"Remove the temporary solution of TDQ-6413 after TDI-24381","After TDI-24381 done, we should revert the temporary solution in TDQ-6413.",1 TDQ-6689,"Export babili translations into 5.1 branch",NULL,2 TDQ-6692,"remove the dialog when change the name of connection and change refresh mode.","1.open one analysis editor. 2.open one connection editor. 3.change the name of connection on the connection editor or database Wizard. 4.you will find it. when refresh editor we use close editor then reopen it. but it will come to a bad feel for user. It is better to create a notice to refresh a part of editor. care about modify connection version on the database Wizard it need a refresh too on the analysis editor. ",8 TDQ-6698,"Create a new tDqReportRun component to execute reports with the new reporting engine library","The component may need database connections components in order to be runnable. We may put several tXXXXConnection components on the job editor's canevas for each connection used by the analyses of the report. This will help us to have the required drivers on the classpath of the job. The tDqReportRun will have a table where the user selects the existing connections. This list will be like the ""component list"" combo box in tMySqlInput. The list of connection components will be configured and placed automatically in the tDqReportRun component with a job generation menu on an existing report in the DQ repository view. But this list will be set manually if the user creates an empty job and drag&drop the ",13 TDQ-6703,"import the project from TDQ-6676, get NPE","java.lang.NullPointerException at org.talend.dq.helper.PropertyHelper.getPropertyFile(PropertyHelper.java:102) at org.talend.dq.CWMPlugin.addConnetionAliasToSQLPlugin(CWMPlugin.java:147) at org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter.notifySQLExplorerForConnection(FileSystemImportWriter.java:881) at org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter.finish(FileSystemImportWriter.java:632) at org.talend.dataprofiler.core.ui.imex.model.ZipFileImportWriter.finish(ZipFileImportWriter.java:63) at org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter$1.run(FileSystemImportWriter.java:471) at org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:84) at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:217) at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3010) at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1892) at org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter.write(FileSystemImportWriter.java:481) at org.talend.dataprofiler.core.ui.imex.ImportWizard$1.run(ImportWizard.java:90) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) ",5 TDQ-6705,"Support the new HDP version (Bimota) 1.2.0",NULL,8 TDQ-6753,"Create version 5.2.2 in Babili and populate it",NULL,2 TDQ-6772,"Avoid DQ repository view crash when the product version cannot being evaluated.",NULL,1 TDQ-6807,"Use the same naming rules as in ""TDI-24610 Invalid characters for old metadata items""","The metadata item had been finished by @Nicolas, in DQ , all items must be use the same naming rules with metadata items.",8 TDQ-6813,"Update the Talend Logo everywhere","New Talend logo ""Integration at any scale"". Update the logo in all places in the studio and in the DQ portal. ",3 TDQ-6834,"Export babili translations into trunk of SVN",NULL,2 TDQ-6837,"Create version 5.3.0M2 in Babili and populate it",NULL,2 TDQ-6841,"Complete the UDI drill down feature","See the sub-tasks for the remaining issue.",8 TDQ-6844,"From TDQ-5392 remove GENERATED annotation or add ""NOT""","When a EMF mothod is going to be modified, must care about the @GENERATED annotation. * {code:java} /** * * * @generated */ public String getName() { return name; } /** * normalize the name. * * @generated */ public void setName(String newName) { String oldName = name; name = WorkspaceUtils.normalize(newName); if (eNotificationRequired()) eNotify(new ENotificationImpl(this, Notification.SET, PropertiesPackage.TDQ_FILE_ITEM__NAME, oldName, name)); } {code} Add NOT after @GENTERATED",1 TDQ-6850,"can not initialize the pattern and rules and source file correctly when load an remote project .","1. create a remote project on 521 on one server. 2. migrate the file to another server by Repository Manager(just set the rule as author filter) 3. migrate to new server successfully. 4. try to load the remote project by studio. issue 1(refer to pic and error log): in libraries only indicators show. strange, we have other folder and files in both svn and local machine for the project. I just check by 5.3.0, import pattern to cmdline project, and then export the patterns. check the orgiginal patterns and exported patterns, xmi id changed, surprise. issue2(refer to pic): when log on to the project, the studio sometimes get inform dialog, about indicators and patterns rename. so : what the opportunity dq will initialize the libraries. why xmi id changed under cmdline(should check all kinds of file), ",13 TDQ-6868,"Export babili translations into 5.2 branch of SVN",NULL,2 TDQ-6903,"Enable contextual Data mart in the report editor","The feature is that we need to be able to use a contextualized connection in the report editor. We need: 0. a new field in the pref page to set the default path of the logo 1. a button in the preference page to export the data mart connection and path information (folder and logo) as a context. 1b. a button in the preference page to revert the context (see the behavior of the database connection revert button). 2. a button in the report editor to attach a context to the report (it will select a context from the repository view). This button is to be added in the context section. 3. run the report with contextual information 4. change the context used by a report 5. export the context information when we export the items The export context action will open the new context wizard. Each variable will start with the report name followed by _. For instance, if the report name is ""crm"", then the variables will start with ""crm_"". The variable exported from the preference page only concern the fields available in the preference page: database connection, logo path and folder path. In the report editor, there will be more variables: See attached screen capture ""export_context2.png"". A ""Context"" section must be added after the ""Database Connection"" section in the report editor. In this section, a combo list with the context names will be displayed. The report is executed with the selected context. When there is no context, the combo list is empty. Technically, the EMF context items must be copied into the report item. See how it is done for jobs. {code} {code} (Optional in a first implementation) A. Ideally, if possible, the view Context could be reused to display the context attached to the Report. See with DI team whether it's possible or if the Context view can only be linked to jobs. B. When the repository context is updated, a pop-up should tell whether to propagate the changes. Then the list of impacted reports should be displayed. If the user choose to propagate the changes, a copy of the repository context is done into the report item (same behavior as the DI jobs). ",20 TDQ-6921,"text indicator can not run correctly for special data","1. create a column analysis, add a nvarchar2 type column. 2. add text indicator run the analysis, get error.",8 TDQ-6925,"Use tools mentioned in the meeting (sleak etc.) to find the resources in DQ projects that are not disposed appropriately before.","Create a subtask in TDQ-4268 for each issue found ",5 TDQ-6949,"Create version 5.3.0M3 in Babili and populate it",NULL,2 TDQ-6976,"Export babili translations into trunk of SVN",NULL,2 TDQ-7048,"Create version 5.3.0RC1 in Babili and populate it",NULL,2 TDQ-7050,"Export babili translations into trunk of SVN",NULL,2 TDQ-7079,"the indicator selection dialog just missed some link on the help content ","open the indicator selection dialog, check the links. Actual Result: on the two pic, just missed some links Expected Result: should have links for all indicators and can link well.",1 TDQ-7087,"Create version 5.3.0RC2 in Babili and populate it",NULL,2 TDQ-7114,"Add UK to tQASBatchAddressRow","QAS Batch is available for the UK (AFAIK it was originally a UK product) Yet only Luxembourg!, Germany, France and the USA are available from the drop down in the above Talend component. Can this be added please?",8 TDQ-7124,"Export babili translations into trunk of SVN",NULL,2 TDQ-7167,"Create version 5.3.0 in Babili and populate it",NULL,2 TDQ-7169,"Export babili translations into trunk of SVN",NULL,2 TDQ-7192,"Add an option to only return exact matches in our standardization components","Currently, the tSynonymSearch returns EXTRA DEEP BASE when we search for EXTRA REACH. It is not wanted. It relates somehow to TDQ-3608 But the wanted behavior is to only return a match when the search string is EXACTLY found in the index. The technical solution may be to surround the input string with a double quote "" or to add a + in front of each word. The input string is the full token extracted by ANTLR (in case of tStandardizeRow). That's not sufficient though: for instance, a search for ""RED"" would nevertheless return ""RED BASE"" ",3 TDQ-7247,"Create version 5.3.1 in Babili and populate it",NULL,2 TDQ-7249,"Create a TUJ for tDqReportRun","This TUJ should test the execution of a report containing several analyses. There should be one analysis of each type and the column analysis should use regex pattern, java udi, and udi. The analyses don't need to be refreshed (uncheck the refresh checkbox in the report editor) so that we don't need to really run the analyses. But the analyses must have run at least once before they are included into the TUJ, so that we get results. The TUJ should test that the execution runs correctly and produces expected results. We should also have a second tDqReportRun component that fails in order to test that the returned execution status is not ok. ",2 TDQ-7298,"Delete different items only the first one go into recycle bin","select two different type items and delete them only the first one in it (actually both of them in) refresh repository the other one in recycle expected result: while do delete all of them should into recycle at the same time actually result: only the first one go into recycle (note: this only exists in 5.3.x)",1 TDQ-7301,"In the tMatchGroup wizard, the text of the ""plus"" button isn't correct & the MASTER output column is missing from the matching table","In the configuration wizard of tMatchGroup: -the text linked to the plus button of the Configuration view reads ""New Rule"" and it should read ""New Configuration"" (see attached image) -The columns in the matching table are missing the standard output MASTER column (see attached image)",2 TDQ-7303,"UI improvement in Match studio","1. the different groups cannot be distinguished (see screenshot: all groups use the same green color). We should make the distinction clearer either with some lines or by changing a bit the colors of the groups with the same size. 2. we should remove shadows in the bar chart and use fully colored bars. ",8 TDQ-7310,"for the jdbc connection still can not preview even if add driver list in the preference--- if driver is add later than db create","want to analyze a dq unsupport db. 1. create a dq unsupport connection with jdbc connection. 2. try to preview , can not . 3. so add driver in the preference 4. preview again, still can not. Expected Result: in step 4, hope can preview ok. Actual Result: in step 4, can not preview. if add driver first, then create connection will be ok.",5 TDQ-7311,"Enable the user to specialize indicators and patterns for a custom (not supported yet) database ","By default, the list of supported databases is fixed in the TOS DQ Wizard. Only those databases can be profiled. The user may connect to another database with JDBC, but he can't add the SQL template for his specific database. He can currently only modify the default SQL template in order to support his database. We need to open this list in the indicator and regex editors so that we can add SQL template for specific unsupported yet databases. ",8 TDQ-7323,"add one check when click ""refresh"" or ""ok"" button to check whether current blocking key contain two same column","1.create a job and make it use tmatchGroup. 2.open the tmatchGroup Dialog and add two same column on bolcking key table. 3.click ""refesh"" button will have a exception for compile error. then click ""ok"" button and run the job will get same issue. 4.we need to add one check when we click both button, if blocking key contain two same column will have a warring dialog to notice user.",2 TDQ-7381,"Export babili translations into 5.3 branch of SVN",NULL,2 TDQ-7407,"Only display the Cheat Sheet view on new startup of the studio","The default perspective should display only the cheat sheet when it starts. All views (dq repository and detail view) must be closed and the editor part minimized. (picture 1) The cheat sheet place holder should be on the left of the editor part (pic 2) and take 1/4 of the screen. The cheat sheet place holder should be on the left of the DQ repository view and detail view which are on the left of the editor (pic 3). The DQ repository view takes another 1/4 of the screen and the editor the last 1/2. The first time an item is created via the cheat sheet, the DQ repository view and Detail view must open (pic 3). Or when the cheat sheet is closed and the selected perspective is Data Profiling, then the DQ repository view and Detail view must open (pic 4). ",5 TDQ-7416,"Integrate newest dq portal version (5.1)","Integrate newest SpagoBI version in DQ portal. Make all dq portal engines available.",5 TDQ-7418,"Profiler : Allow variables, like context variables","Allow variables, like context variables, to be valid fields in analysis and report input fields, like date range on where clauses. Today to run a profile over a date start/stop and then change the range requires hard coding and then changing that hardcoded value. Concerned analysis fields: - data filter - number of connections per analysis Concerned report fields: - output folder - output filename - execution date range (start / end) - logo file path Enable context usage of contexts in TOS DQ (only use built-in contexts => no need to display the context node in dq repository view)? is Context view reusable? Adapt the analysis editor to display the context and allow the user to switch between contexts just as in the report editor. Add a separate section ""Context group"" in the analysis editor AND move the current context of the report editor into a new section too.",13 TDQ-7420,"run analysis get error with all indicators for informix database","run a column analysis get error with all indicators for informix database. many of analysis can not run correctly, I guess the following is the reason, not support the ifnull fuction java.sql.SQLException: Routine (ifnull) can not be resolved. at com.informix.jdbc.IfxSqli.a(IfxSqli.java:3449) at com.informix.jdbc.IfxSqli.E(IfxSqli.java:3762) at com.informix.jdbc.IfxSqli.dispatchMsg(IfxSqli.java:2574) at com.informix.jdbc.IfxSqli.receiveMessage(IfxSqli.java:2490) at com.informix.jdbc.IfxSqli.executeExecute(IfxSqli.java:2378) at com.informix.jdbc.IfxSqli.executeExecute(IfxSqli.java:2353) at com.informix.jdbc.IfxResultSet.b(IfxResultSet.java:390) at com.informix.jdbc.IfxStatement.a(IfxStatement.java:1319) at com.informix.jdbc.IfxStatement.executeImpl(IfxStatement.java:1289) at com.informix.jdbc.IfxStatement.c(IfxStatement.java:1005) at com.informix.jdbc.IfxStatement.execute(IfxStatement.java:891) at org.talend.dq.analysis.ColumnAnalysisSqlExecutor.executeQuery(Unknown Source) at org.talend.dq.analysis.ColumnAnalysisSqlExecutor.executeQuery(Unknown Source) at org.talend.dq.analysis.ColumnAnalysisSqlParallelExecutor.run(Unknown Source) at org.talend.dq.analysis.ColumnAnalysisSqlExecutor$ExecutiveAnalysisJob.run(Unknown Source) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.sql.SQLException at com.informix.util.IfxErrMsg.getSQLException(IfxErrMsg.java:407) at com.informix.jdbc.IfxSqli.E(IfxSqli.java:3767) ... 14 more ",5 TDQ-7443,"generate report file button can not use the datamart part parameter correctly if first time generate failed","1. create a report file. 2. in the report editor set datamart parameter-- set a wrong password other information is correct. 3. generate report file, get inform dialog: username or passwd is not correct. 4. change passwd to correct one,save, regenerate report file. Actual Result: still get inform dialog. Expected Result: generate report file correctly. note: reopen report work well. if first set correct,work well, then change to a wrong one, will get inform dialog.----correct",3 TDQ-7453,"tDqReportRun component can not run-- report with oracle overview analysis","1. create an overview analysis about oracle. 2. create a report about the analysis. 3. generate the report file, work well. 4. right click on the report->Launch a report. 5. run the generated job. Actual Result: will get error, job can not run well. Expected Result: job should run well. and generate doc well. {code} org.talend.dq.analysis.AnalysisExecutor -1193 [main] INFO org.talend.dq.analysis.AnalysisExecutor - Connection to oracle Exception in thread ""main"" java.lang.ExceptionInInitializerError at org.talend.core.model.metadata.DBConnectionFillerImpl.fillTables(DBConnectionFillerImpl.java:1025) at org.talend.core.model.metadata.MetadataFillFactory.fillTables(MetadataFillFactory.java:192) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.loadTables(DqRepositoryViewService.java:345) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getTables(DqRepositoryViewService.java:195) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getTables(DqRepositoryViewService.java:204) at org.talend.dq.indicators.AbstractSchemaEvaluator.evalSchemaIndicLow(AbstractSchemaEvaluator.java:460) at org.talend.dq.indicators.AbstractSchemaEvaluator.evalSchemaIndic(AbstractSchemaEvaluator.java:426) at org.talend.dq.indicators.ConnectionEvaluator.executeSqlQuery(ConnectionEvaluator.java:131) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:128) at org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:197) [statistics] disconnected at org.talend.dq.analysis.AbstactSchemaAnalysisExecutor.runAnalysisLow(AbstactSchemaAnalysisExecutor.java:65) at org.talend.dq.analysis.ConnectionAnalysisExecutor.evaluate(ConnectionAnalysisExecutor.java:57) at org.talend.dq.analysis.AnalysisExecutor.runAnalysis(AnalysisExecutor.java:280) at org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:133) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:157) at org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:141) at org.talend.dq.analysis.ReportExecutor.execute(ReportExecutor.java:62) at org.talend.dataquality.reporting.engine.ReportDocGenerator.runReport(ReportDocGenerator.java:370) at org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:204) at test_link.tdqreportrun_1370595579170_0_1.tdqReportRun_1370595579170.tDqReportRun_1Process(tdqReportRun_1370595579170.java:756) at test_link.tdqreportrun_1370595579170_0_1.tdqReportRun_1370595579170.runJobInTOS(tdqReportRun_1370595579170.java:1092) at test_link.tdqreportrun_1370595579170_0_1.tdqReportRun_1370595579170.main(tdqReportRun_1370595579170.java:958) Caused by: java.lang.NullPointerException at org.talend.commons.utils.workbench.extensions.ExtensionImplementationProvider.createInstances(ExtensionImplementationProvider.java:161) at org.talend.commons.utils.workbench.extensions.ExtensionImplementationProvider.getInstanceV2(ExtensionImplementationProvider.java:128) at org.talend.commons.utils.workbench.extensions.ExtensionImplementationProvider.getInstanceV2(ExtensionImplementationProvider.java:105) at org.talend.core.model.metadata.builder.database.ExtractMetaDataFromDataBase.(ExtractMetaDataFromDataBase.java:137) ... 22 more {code}",5 TDQ-7471,"""Export report script"" should now export a generated job","The action of this menu must be replaced by: - the generation of the job with the tDqReportRun component - the export of the job (as it would be done it in DI perspective) ",8 TDQ-7479,"Remove second page of parser rule creation wizard","This page is useless. Remove it. ",3 TDQ-7504,"Match Analysis Editor","h3. New analysis Create a new kind of analysis called ""match analysis"" under the ""column set category"". h4. User stories *As a* data quality user, *I want* to easily create a profile analysis *so that* I can find duplicate records (just like the tMatchGroup component does). *TODO* write other User stories + acceptance criteria The analysis setting tab is described by the ""Match Editor"" mockup. h4. Select Data Set the ""Create connection"" button opens a connection wizard (the first page is the metadata page usually used in wizard, the second page asks the user to choose between a database and a file, the following pages are related to the previous choice). At the end of the creation wizard, the user is asked to select the data (as it would be done in the ""select data"" wizard described just below). The ""Select Data"" button opens the columns selection window. When the user clicks ok, a sample of the data is retrieved and displayed in the data table. Notice that the data table has *6* additional columns (all columns related to the matching: GID, GRP_SIZE... and the BLOCK_KEY column) which are empty at the beginning. (Attribute scores is the MATCHING_DISTANCES of the component actually). h4. Adding blocking keys The ""Select blocking key"" button is a push button. When the button is pushed, the user will be able to add rows into the ""blocking key"" table by selecting the columns in the ""data"" table. When the user clicks once on a column in the data table, this column is added to the blocking key table. The selected column header becomes red color. When the user clicks again on the same column in the data table, this column is removed from the blocking key table and the color of the header in the data table is the default. When the user clicks on the button again, then the selection ends. h4. Adding match keys The ""Select matching key"" button is a push button. When the button is pushed, the user will be able to add rows into the ""matching key"" table by selecting the columns in the ""data"" table. When the user clicks once on a column in the data table, this column is added to the matching key table (in all match rules tabs when there several match rule tabs - the first one when no match rule exist yet). The selected column header becomes green color. When the user clicks again on the same column in the data table, this column is removed from all the matching rules in the match key table and the color of the header in the data table is set back to the default color. When the user clicks on the button again, then the selection ends. h4. Removing blocking keys A right-click on a row in the blocking key table will display a ""Remove element"" menu. This menu will remove the selected key(S) from the blocking table. The ""DEL"" key from the keyboard must also be enabled to remove columns. h4. Removing matching keys A right-click on a row in the matching key table will display a ""Remove element"" menu. This menu will remove the selected key(S) from the match rule of the match key table. The ""DEL"" key from the keyboard must also be enabled to remove columns. h4. Execution prerequisites Selecting a blocking key is optional. The user may not select any blocking key but at least one match key is required. A pop-up should display when the user tries to save or run the analysis without any match key defined. h3. Running charts h4. block chart The ""Visualize"" button will refresh the charts according to the settings and the data sample. It will also compute the generated key and update it in the data table. h4. match chart The ""Visualize"" button will refresh the charts according to the settings and the data sample. It will compute the groups and update the corresponding fields in the data table. The chart must be interactive as the one in the tMatchgroup component configuration wizard. h2. Result tab The analysis run button will execute the matching rules against the whole dataset and switch to the result tab. h3. Import, exporting match definitions. The import/export buttons will import and existing match definition from the repository or create a new match rule definition in the repository. The import button overwrite the local match rule. The export button creates a new match rule (hence a wizard as usual to create an item). This wizard is the same as the one for the ""new match rule"" (if we do it. Maybe, that's not needed). ",13 TDQ-7510,"when click ""Move up"" or ""Move down"" in column analysis editor, the tree of ""Analyzed Columns"" will be expanded all","1. open a column analysis which have some columns, all some indicators for these columns 2. collapse all 3. select one column, click ""Move up"" or ""Move down"" 4. the tree will be expanded all, actually we expect the tree be collapsed all still",5 TDQ-7539,"Implement the import/export to repository actions",NULL,20 TDQ-7595,"Port the tGenKey component to the M/R framework",NULL,13 TDQ-7596,"Port the tMatchGroup component to the M/R framework","This component will reuse API from the tMatchGroupHadoop component. ",13 TDQ-7597,"Deprecate the tLaunchDqReport","- Remove it from the palette (just hide it or directly delete it?) ",3 TDQ-7611,"Create version 5.2.3 in Babili and populate it",NULL,2 TDQ-7614,"Export babili translations into 5.2 branch of GIT",NULL,2 TDQ-7625," Configuration wizard of tMatchGroup does not work if it is used after tRecordMatching","cf attached job",13 TDQ-7635,"Unify component properties layout for DQ hadoop component","1. the DQ components tGenKeyHadoop and tMatchGroupHadoop have two fields : host and port whereas tHDFSInput has only one field: NameNode URI. Merge these two fields into a single field. And create the migration task supporting old component configurations. 2. Add the HDFS browser button for the HDFS Directory field. 3. Enable the use of hadoop cluster configuration (Property type: built-in or repository selector in tHDFSInput for instance) by adding the property type combo to these two components. ",13 TDQ-7676,"Get the correct bundle name with different database type","In function DynamicInputNodeHelper.addInputNode(),still use the deprecated function 'addComponent(String exactName, String id, Point location)'. At here,should get the correct bundle name with different database type(Mysql,HIVE...),then replace 'addComponent(String exactName, String id, Point location)' with 'addComponent(String bundleName, String exactName, String id, Point location)'.",5 TDQ-7692,"Match Analysis Reporting","Enable Match analysis to be included in the reports. ",3 TDQ-7702,"Cancel the analysis execution but the ""Run"" button is still disabled","while running an analysis, the ""Run"" button is disabled but if I cancel the execution the button still disabled need reopen the analysis editor expected result: while I cancel the process the button should be enabled actually result: the button is disabled",1 TDQ-7703,"tDqReportRun job should give correct information when datamart structure does not exist","for hsqldb, the datamart structure is created automatically, and the job works well. but for mysql and oracle datamart, the structure must be created by user. Otherwise, the EXE_STATUS should be false and an error message should be shown in the result list. Currently, the EXE_STATUS is true and the message is empty.",2 TDQ-7737,"Create version 5.4.0M2 in Babili and populate it",NULL,2 TDQ-7739,"Create version 5.3.2 in Babili and populate it",NULL,2 TDQ-7780,"Refine the entrypoint of new match analysis creation","- Move ""Match Analysis"" from ""Column Analysis"" to ""Table Analysis"" - Add context menu on repository view on table and column node. - Add the new analysis into cheat sheets. (extracted to a separate task TDQ-8230)",13 TDQ-7827,"hive connection not show in ""Connections"" view",NULL,5 TDQ-7831,"Add move up/move down button for match key and blocking key table in rule definition editor","finished up and down button Operating on the UI. ",8 TDQ-7840,"set the ""Link with Editor"" default value is ""linked""","when the first time start a studio, set this",3 TDQ-7842,"Investigate why when start studio the first, the layout of perspective is different","see https://jira.talendforge.org/browse/TDQ-7829 the size is a little smaller than on tdq(see attachment files) it is strange even they use the same configuration file ",5 TDQ-7845,"Export babili translations into trunk of SVN",NULL,2 TDQ-7847,"Export babili translations into trunk of SVN",NULL,2 TDQ-7849,"Create version 5.4.0M3 in Babili and populate it",NULL,2 TDQ-7869,"Buttons improvements in Match Analysis","See attached screen capture.",3 TDQ-7877,"Technical improvements for match analysis",NULL,13 TDQ-7882,"Complete Contextual Datamart Feature - Enable to propage a context to a list of reports",NULL,13 TDQ-7892,"issue for vertica after feature TDQ-2104","issue 1. benford law indicator can not drill down, both int type and varchar type column for int type column: operator does not exist: int ~~ unkonw. for varchar type column: invalid item drill down, syntax error at or near ""Regexp' issue 2. for the generate job function on result page, all can not work work. issue 3. analysis set sql engine, generate report, frequency indicator will show all the items, limit 10 seems doesn't work. issue 4. when crate dbconnection, doesn't set database, so it will set 'default' in Repository, overview analysis can not run with oracle datamart. errors for issues refer to file attached.",13 TDQ-7894,"Improve Create Connection wizard","The current layout of the ""create connection"" wizard of the match analysis editor must be improved. See attached screen capture. ",3 TDQ-7903,"Create a help page for the new Match Analysis wizard",NULL,3 TDQ-7910,"Import match rules from repository into matching components","Be able to import existing match rules from the repository into the tMatchGroup, tRecordMatching, tGenkey (std and M/R), tMatchGroupHadoop components. ",13 TDQ-7917,"Disable the ability to add the match analysis into a report. ","We can't generate a report from this kind of analysis. Therefore, we must remove the right-click menu ""new Report"" on this kind of analysis. And in the report editor, we must not be able to select this type of analysis.",3 TDQ-7918,"Check whether we can profile the exist Hive distributions",NULL,20 TDQ-7919,"Create version 5.4.0RC1 in Babili and populate it",NULL,2 TDQ-7944,"Restore the tLaunchDQReport component and put it in the technical category","The component must not be removed from the palette until the 6.0 version. Therefore, we must restore it and hide it from the usual palette by adding it to the technical category and removing it from the DQ category. ",5 TDQ-7951,"Add the context selection button in the context view when it's attached to a report","when the preference page is not contextualized and I create a new report, I cannot add an existing context to the report. I need to be able to add a context to a report, just as we add context to jobs. Enable the button in the context view that browse the contexts and can select them. ",8 TDQ-7975,"Create TUJ for standardization components","Convert existing jobs to TUJs",8 TDQ-8020,"Design a library to sample data for analyses","Use a Reservoir Sampling algorithm. See http://getpocket.com/a/queue/list/sampling/",2 TDQ-8027,"Make it possible for users to load the customized algorithm jar in match analysis editor.",NULL,13 TDQ-8036,"Generated reporting job cannot run","Create a report, generate a ""launch report job"". Try to run it. It will ask for downloads of mysql and oracle drivers. After the drivers are downloaded, try to run the job. It still complains about missing jta.jar Try to run it nevertheless, then we get this exception: Starting job tdqReportRun_1379494104625 at 10:49 18/09/2013. [statistics] connecting to socket on port 4031 [statistics] connected Exception in thread ""main"" java.lang.NoClassDefFoundError: net/sourceforge/sqlexplorer/ExplorerException org.talend.cwm.db.connection.ConnectionUtils.findDriverByLibManageSystem(ConnectionUtils.java:581) org.talend.cwm.db.connection.ConnectionUtils.getClassDriver(ConnectionUtils.java:559) org.talend.cwm.db.connection.ConnectionUtils.createConnection(ConnectionUtils.java:176) org.talend.cwm.db.connection.ConnectionUtils.checkConnection(ConnectionUtils.java:227) org.talend.cwm.db.connection.ConnectionUtils.isConnectionAvailable(ConnectionUtils.java:369) org.talend.dataquality.reporting.engine.ReportDocGenerator.validateReport(ReportDocGenerator.java:339) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:215) test.tdqreportrun_1379494104625_0_1.tdqReportRun_1379494104625.tDqReportRun_1Process(tdqReportRun_1379494104625.java:779) test.tdqreportrun_1379494104625_0_1.tdqReportRun_1379494104625.runJobInTOS(tdqReportRun_1379494104625.java:1117) [statistics] disconnected test.tdqreportrun_1379494104625_0_1.tdqReportRun_1379494104625.main(tdqReportRun_1379494104625.java:982) Caused by: java.lang.ClassNotFoundException: net.sourceforge.sqlexplorer.ExplorerException java.net.URLClassLoader$1.run(URLClassLoader.java:366) java.net.URLClassLoader$1.run(URLClassLoader.java:355) java.security.AccessController.doPrivileged(Native Method) java.net.URLClassLoader.findClass(URLClassLoader.java:354) java.lang.ClassLoader.loadClass(ClassLoader.java:423) sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 10 more Job tdqReportRun_1379494104625 ended at 10:49 18/09/2013. [exit code=1]",8 TDQ-8040,"Add a button ""show in repository view"" in the match analysis editor",NULL,5 TDQ-8043,"Add a scroll bar in the data table when there is more data that can be seen","Currently, there is no scroll bar although we can scroll with the mouse wheel. There should be a scroll bar",5 TDQ-8044,"Add the ability to sort data by a click on the table header in the match analysis","A click on the header should sort the data. ",13 TDQ-8045,"Allow the user to edit the match rule tab header.","See screen capture.",13 TDQ-8063,"Support hive profiling for distribution HDP 1.3",NULL,8 TDQ-8067,"DQ profiling support for HDP 2.0 in 5.4",NULL,5 TDQ-8068,"Support hive profiling for MapR 3.0",NULL,5 TDQ-8079,"Export babili translations into trunk of SVN",NULL,2 TDQ-8082,"Create org.talend.dataquality.record.linkage.ui.nl","The internationalization fragment is missing for org.talend.dataquality.record.linkage.ui Create the i18n fragment of org.talend.dataprofiler.common.ui too. ",2 TDQ-8084,"Match rule editor changes for MDM / T-Swoosh","h4.General * It is the only DQ item that must *not* switch to the the Profiler perspective when clicked on. It is extremely annoying in the context of MDM. * Also it must *not* recall the other associated views such as the details view. h4.Editor GUI See [^matchrulechanges.png]. From top to bottom: * Radio labels: change T-Swoosh to: ""MDM T-Swoosh Algorithm"". We need ""MDM"" in there. * MDM T-Swoosh should be the default when created from MDM *--> Separate TMDM work item: TMDM-6350* * Hide the Block key generation panel. This is for a future iteration of MDM's integrated matching, not in 5.4. * Match key panel ** Title: change to ""Match and Survive"" ** Remove/hide the '+' button on the right-hand side, only *one* match rule allowed in T-Swoosh in 5.4 ** Merge the last 2 cols of the survivorship table into the match rule table. We can only define the survivorship key onto the same column as the match keys in T-Swoosh 5.4. So since it's a 1-1 between match keys and survivorship keys, let's just use a single table for both. ** Change the 2nd threshold's label to ""Confident match threshold"". * Remove/hide the survivorship panel altogether. Survivorship keys are always in par with match keys. *IMPORTANT NOTE:* These change requests are pure GUI, there should be no impact on the underlying EMF.",20 TDQ-8090,"Allow the user to reorder the match rule tabs","When several match rule tabs exists in the analysis editor or in the match rule editor, the user should be able to reorder them by drag&drop.",8 TDQ-8144,"""MDM connection"" should not be listed in the create connection wizard when creating match analysis","-delete ""MDM connection"" from the list of connections in the connection wizard when creating match analysis (see the first capture). -delete ""MDM connection"" from the list of connections when you click the ""Select data"" tab in the match analysis editor(see the second capture).",5 TDQ-8151,"Create version 5.4.0 in Babili and populate it",NULL,2 TDQ-8189,"Repository view is not refreshed after a MySQL connection creation the first time","- start a new studio. - create a mysql connection - after the connection creation wizard is finished, the download dialog opens and asks for downloading mysql driver. - click download. - after the driver is downloaded, there is nothing to unfold below the connection. I can't access the catalogs, tables, ... See attached capture. ",8 TDQ-8190,"Support hive profiling for Cloudera 4.3 and 4.4 (Yarn/Hadoop2)",NULL,13 TDQ-8191,"Export babili translations into trunk of SVN",NULL,2 TDQ-8232,"Support profiling mapR 2.1.2 ",NULL,3 TDQ-8203,"delete analysis by right click on sub node of report node is not synchronous with editor of report if editor is opening","delete analysis by right click on sub node of report node should update report editor with same time. 1.create a report by right click on the analysis node. 2.keep report editor is opening and expand the sub node of report node try to find analysis node. 3.right click on the analysis node and select delete analysis action. 4.pop up a choose dialog ask you whether want to delete the analysis forever and choose yes. expect: the report editor should be updated. The analysis which be deleted just now should not exist on the analysis list. result: the analysis will exist yet. ",5 TDQ-8206,"""Hide"" action should also hide data in the data sample table in the match analysis editor","When clicking on the ""hide groups less than x items"", the data in the data table should be filtered out accordingly. Just like in the component",5 TDQ-8212,"Do not open the DQ repository view when saving the editor","we can follow the following 4 steps to do the refactoring: 1. refactoring DQRepositoryNodes 2. action/editor/page/handler, recursiveFind() 3. command line 4. sub nodes under connection details: 1.1 profiling node analysis node report node 1.2 library node indicator node pattern node rule node source file node jrxml node exchange node: need not to refactoring the above Nodes need to refactor, remove the property ModelElement and refactor the related method {code} private Analysis analysis; public Analysis getAnalysis() { return this.analysis; } public void updateAnalysis(Analysis ana) { this.analysis = ana; } {code} remove the property analysis and the method updateAnalysis() refactor the method getAnalysis(), get the analysis from the Node {code} public Analysis getAnalysis() { return ((TDQAnalysisItem)this.getObject().getProperty().getItem()).getAnalysis(); } {code} other node just like this 1.3 folder node and connection node need not to refactoring 2.1 action OpenItemEditorAction : using RepositoryNode as the parameter of this class, refactoring the related codes to adapt to this change RunAnalysisAction: keep using the Item, add comments here, remove the deprecated method 2.2 editor/page/handler AbstractItemEditorInput : using RepositoryNode as the parameter, all the Editor and pages need to adapt to this change org.talend.dataprofiler.core.ui.wizard.analysis.AbstractAnalysisWizard.openEditor(Item item): get the Node from the Item first and then pass the Node to the EditorInput 2.5 recursiveFind() need to remvoe most recursiveFind() method, but still need to keep several recursiveFind() method, because some time still need to find the node according to the ModelElement or other type object these refactoring need to deal with as a whole, this part will cost more time than first part ReportWriter line 74: ... AnalysisRepNode recursiveFindAnalysis = RepositoryNodeHelper.recursiveFindAnalysis(ana); ... if (recursiveFindAnalysis != null && recursiveFindAnalysis.getProject().isMainProject()) { ... find another method to check the project is main project or reference project create the RepositoryNode first when use wizard to create Item, then use this node to open the editor for the 3 and 4 step, we can do them later ",7 TDQ-8214,"Match analysis editor cosmetic changes","See pic.",2 TDQ-8230,"Create cheat sheet for new Match Analysis.",NULL,5 TDQ-8236,"Eclipse help view for the Match rule wizard.","The Match rule creation wizard is accessible from the Repository. So contextual help should be availalble using the F1 key, and should also be available with a Help button at the bottom of the wizard (eclipse already provide this feature, it just needs to be activated).",8 TDQ-8242,"TOP should do same things as TDQ to open the dialog which can download all of jar files when stdio is opening ","TOP should do same things as TDQ to open the dialog which can download all of jar files when stdio is opening. The image of dialog has been attached. ",13 TDQ-8252,"Support hive profiling for MapR 2.1.3",NULL,5 TDQ-8256,"Hadoop components for DQ support HDP 2.0.0","The DI Hadoop components now support HDP 2.0.0. So the DQ Hadoop components might need to keep pace.",8 TDQ-8265,"update the content when check mysql database user privileges",NULL,5 TDQ-8282,"Update tmatch group ""refresh"" button label","Update tMatchGroup refresh button in the configuration wizard. Refresh name is not intuitive. Could be better with ""Chart"" or ""Visualize"" ",2 TDQ-8289,"If you change the basic data set for the matching analysis the whole screen should be reset",NULL,5 TDQ-8325,"Reduce memory usage during TDQ item export","I have 44 analyses and 7 reports in my project and I clicked at the export wizard button. The wizard is open after 10 seconds of dependency calculation. and the memory usage is shown in the attached picture. ",2 TDQ-8350,"Create version 5.4.1 in Babili and populate it",NULL,2 TDQ-8360,"After change the analyzed file connection path columns in analysis will be removed even the news are same as the originals","analyze a file connection keep the analysis editor open, and if change the file path and retrieve the new schema(some columns are same as the originals) and do NOT update the editor for column analysis columns still in editor, but actually all columns are removed for match analysis columns in match analysis editor do not change(originals) click ""select data"" to open the column selection dialog, you can see only the same columns are checked This issue need to implement a new feature of reload file connection.",13 TDQ-8376,"Cannot edit a synonym","Open addons/data/synonym/idx_city_exonyms/all_4_countries Search ""strasbourg"" Edit the entry to remove ""Est"" as a synonym. Save. It yields to an error and nothing is saved. See pic",3 TDQ-8377,"Technical - Refine commit of TDQ-8068 Support hive profiling for MapR 3.0","For commit : http://talendforge.org/trac/top/changeset/111240#file0 - Add a comment to explain the logic for if/else.",1 TDQ-8381,"Export babili translations into trunk of SVN",NULL,2 TDQ-8385,"handle org.talend.dqdemos",NULL,3 TDQ-8394,"when create datamart with user which doesn't have enough privileges, can get only one error.","1. create a report 2. set datamart information in report editor(mysql/oracle), make sure (1)user just have access privileges. (2) datamart tables/views doesn't exist. 3. then click ""check"", try to create datamart. Expected Result: get many error for what privileges we need to add Actual Result: just get an error , refer to doc attached.",5 TDQ-8395,"tRecordMatching : bug with lookup","There is a bug with the tRecordMatching and it's lookup. In the ""End"" part of the code, the lookup is flushed and it's caused big issue when you use the component : - after an iterate link - in a Data Service (ESB) Workaround : edit the code surrounded in the screenshot",5 TDQ-8401,"Hive profiling cannot finish on mapR3.0 embedded mode in Win 8","From TDQ-8068 tested on build Talend-Studio-r111555-V5.4.1EP while run analysis with embeded mode with hive in MapR 3.0.1 the process is always running and will never stop no error log",8 TDQ-8428,"Sampling algorithm to run Analysis on a sample of data which is not necessary the first 1000 or first 5000 rows.","It would be nice to have some smart Sampling algorithm which can return a smaller dataset than the entire dataset while we are doing our PROFILE analysis and Matchgroup set up. The idea is to have a significant sample, random and not only filter on the x first rows of our data sets. ",8 TDQ-8429,"in demo project the first analysis--GenderAna can not genereate ETL job correctly about the pattern(Email Address)","1. create a new project. 2. on the welcome page,click ""Demos"", on the pop up dialog select dq demo, and import it. 3. change the msyql configuration to your correct one. 4. run the fist analysis--enderAna. 5. focus on ""Result page"", right click on the pattern --> Email Address -->Generate Job, on the pop up dialog select the first one option. Expected Result: generate a job correctly. Actual Result: job can generated but the dialog still show. note: just create a new connection, and column analysis with pattern, the issue won't show. {code} java.lang.NullPointerException org.talend.designer.core.ui.editor.nodes.Node.checkSchema(Node.java:3410) org.talend.designer.core.ui.editor.nodes.Node.checkNode(Node.java:3685) org.talend.designer.core.ui.editor.nodes.Node.checkAndRefreshNode(Node.java:3676) org.talend.designer.core.ui.editor.cmd.QueryGuessCommand.execute(QueryGuessCommand.java:165) org.talend.datacleansing.core.ui.actions.IndicatorJobAction.setParameters(IndicatorJobAction.java:144) org.talend.datacleansing.core.ui.actions.pattern.PatternIndicatorJobAction.setParameters(PatternIndicatorJobAction.java:93) org.talend.datacleansing.core.ui.actions.pattern.PatternValidRowsJobAction.setParameters(PatternValidRowsJobAction.java:50) org.talend.datacleansing.core.ui.jobs.template.AJobAction.addTemplateNodes(AJobAction.java:295) org.talend.datacleansing.core.ui.jobs.template.AJobAction.doRun(AJobAction.java:153) org.talend.repository.ui.actions.AContextualAction$2.run(AContextualAction.java:611) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:93) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:237) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3197) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1979) org.talend.repository.ui.actions.AContextualAction.run(AContextualAction.java:617) org.talend.datacleansing.core.ui.actions.IndicatorJobAction.run(IndicatorJobAction.java:327) org.talend.datacleansing.core.ui.actions.ui.pattern.PatternJobSelectWizard.performFinish(PatternJobSelectWizard.java:66) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.datacleansing.core.ui.service.DatabaseJobService.createJobActon(DatabaseJobService.java:97) org.talend.datacleansing.core.ui.service.DatabaseJobService.executeJob(DatabaseJobService.java:77) org.talend.dataprofiler.core.ui.editor.preview.model.ChartTableFactory$1.widgetSelected(ChartTableFactory.java:152) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:145) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) {code}",8 TDQ-8431,"tRecordMatching import rules from dq Repository, some parameters can not set correctly.","1. create rule manually or export from match analysis, --make sure rules have a key item select ""Matching Function"" select ""Custom"" and set class name. 2. create a job add tRecordMatching 3. on the Component tab of tRecordMatching, click ""import rules from Repository"" 4. on the pop up dialog select the rules. Expected Result: parameters set correctly, job can run well. Actual Result: ""Matching Function"" set ""Exact"", ""Custom Matcher"" lose ""double quote"", and add jar name, in fact, have jar name job can not run.",5 TDQ-8433,"Component that generates duplicates","Create a component that generates duplicate data from an input flow. This component would be mostly used in combination with a tRowGenerator. Settings: - percentage of duplicates to generate (will tell how many rows to generate from a given row - will be less than one). This means that when a row comes in, we must decide whether to generate or not a duplicate row (In order to do this, we could use a sampling algo). - fields that are subject to changes (choose which columns may have changes) - for each chosen field, choose how to modify them. - this could be exact duplicated value - approximate duplicated value - replacement value (use a synonym from an index file) - delete value (set to null or blank) - min and max percentage of fields to be modified ",8 TDQ-8443,"Drag a UDI to current folder will throw 2 error","in DQ Repository, drag a UDI to current folder will get 2 error {code} Problems occurred when invoking code from plug-in: ""org.eclipse.ui.navigator"". -------------------------------------------------------------------------------------------------------------------------------------- org.eclipse.core.runtime.AssertionFailedException: assertion failed: Cannot move '/TOP_DEFAULT_PRJ/TDQ_Libraries/Indicators/User Defined Indicators/Copy_of_Row_Count_0.1.properties'. Destination should not be under source's hierarchy. org.eclipse.core.runtime.Assert.isTrue(Assert.java:110) org.eclipse.core.internal.resources.Resource.assertMoveRequirements(Resource.java:195) org.eclipse.core.internal.resources.Resource.move(Resource.java:1585) org.eclipse.core.internal.resources.Resource.move(Resource.java:1565) org.talend.commons.utils.workbench.resources.ResourceUtils.moveResource(Unknown Source) org.talend.core.repository.utils.XmiResourceManager.moveResource(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.moveResource(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.moveObject(Unknown Source) org.talend.core.repository.model.ProxyRepositoryFactory.moveObject(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD$2$1.run(Unknown Source) org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1975) org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1957) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD$2.run(Unknown Source) org.talend.repository.RepositoryWorkUnit.executeRun(Unknown Source) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveObject(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveOthersNode(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveRepositoryNodes(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.handleDrop(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.handleDrop(Unknown Source) org.eclipse.ui.navigator.CommonDropAdapter$1.run(CommonDropAdapter.java:194) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.ui.navigator.CommonDropAdapter.performDrop(CommonDropAdapter.java:184) org.eclipse.jface.viewers.ViewerDropAdapter.drop(ViewerDropAdapter.java:276) org.eclipse.ui.part.PluginDropAdapter.drop(PluginDropAdapter.java:69) org.eclipse.swt.dnd.DNDListener.handleEvent(DNDListener.java:90) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:774) org.eclipse.swt.dnd.DropTarget.Drop(DropTarget.java:456) org.eclipse.swt.dnd.DropTarget.Drop_64(DropTarget.java:392) org.eclipse.swt.dnd.DropTarget$3.method6(DropTarget.java:260) org.eclipse.swt.internal.ole.win32.COMObject.callback6(COMObject.java:119) org.eclipse.swt.internal.ole.win32.COM.DoDragDrop(Native Method) org.eclipse.swt.dnd.DragSource.drag(DragSource.java:363) org.eclipse.swt.dnd.DragSource.access$0(DragSource.java:289) org.eclipse.swt.dnd.DragSource$1.handleEvent(DragSource.java:172) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code} {code} assertion failed: Cannot move '/TOP_DEFAULT_PRJ/TDQ_Libraries/Indicators/User Defined Indicators/Copy_of_Row_Count_0.1.properties'. Destination should not be under source's hierarchy. -------------------------------------------------------------------------------------------------------------------------------------- org.eclipse.core.runtime.AssertionFailedException: assertion failed: Cannot move '/TOP_DEFAULT_PRJ/TDQ_Libraries/Indicators/User Defined Indicators/Copy_of_Row_Count_0.1.properties'. Destination should not be under source's hierarchy. org.eclipse.core.runtime.Assert.isTrue(Assert.java:110) org.eclipse.core.internal.resources.Resource.assertMoveRequirements(Resource.java:195) org.eclipse.core.internal.resources.Resource.move(Resource.java:1585) org.eclipse.core.internal.resources.Resource.move(Resource.java:1565) org.talend.commons.utils.workbench.resources.ResourceUtils.moveResource(Unknown Source) org.talend.core.repository.utils.XmiResourceManager.moveResource(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.moveResource(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.moveObject(Unknown Source) org.talend.core.repository.model.ProxyRepositoryFactory.moveObject(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD$2$1.run(Unknown Source) org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1975) org.eclipse.core.internal.resources.Workspace.run(Workspace.java:1957) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD$2.run(Unknown Source) org.talend.repository.RepositoryWorkUnit.executeRun(Unknown Source) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveObject(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveOthersNode(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.moveRepositoryNodes(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.LocalRepositoryObjectCRUD.handleDrop(Unknown Source) org.talend.dataprofiler.core.ui.views.resources.RepositoryNodeDorpAdapterAssistant.handleDrop(Unknown Source) org.eclipse.ui.navigator.CommonDropAdapter$1.run(CommonDropAdapter.java:194) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.ui.navigator.CommonDropAdapter.performDrop(CommonDropAdapter.java:184) org.eclipse.jface.viewers.ViewerDropAdapter.drop(ViewerDropAdapter.java:276) org.eclipse.ui.part.PluginDropAdapter.drop(PluginDropAdapter.java:69) org.eclipse.swt.dnd.DNDListener.handleEvent(DNDListener.java:90) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:774) org.eclipse.swt.dnd.DropTarget.Drop(DropTarget.java:456) org.eclipse.swt.dnd.DropTarget.Drop_64(DropTarget.java:392) org.eclipse.swt.dnd.DropTarget$3.method6(DropTarget.java:260) org.eclipse.swt.internal.ole.win32.COMObject.callback6(COMObject.java:119) org.eclipse.swt.internal.ole.win32.COM.DoDragDrop(Native Method) org.eclipse.swt.dnd.DragSource.drag(DragSource.java:363) org.eclipse.swt.dnd.DragSource.access$0(DragSource.java:289) org.eclipse.swt.dnd.DragSource$1.handleEvent(DragSource.java:172) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) org.eclipse.equinox.launcher.Main.main(Main.java:1383) {code}",5 TDQ-8451,"Job about tGenkey and tGenkeyHadoop can not run well when select ""remove[diacritical marks and lower/upper case]"" for pre-algorithm","1. create a job with input+tGenkey/tGenkeyHadoop+output 2. add one column for tGenkey/tGenkeyHadoop at Algorithm part. 3. set pre-algorithm with ""remove diacritical marks and upper/lower case"" or ""remove diacritical marks "" 4. run job. Expected Result: job can run well. Actual Result: job run failed. note: ok on 5.3.1, no 5.3.2 build now so doesn't test, {code} Exception in thread ""main"" java.lang.NoClassDefFoundError: org/talend/utils/string/AsciiUtils org.talend.windowkey.AlgoBox.removeDiacriticalMarks(AlgoBox.java:325) org.talend.windowkey.AlgoBox.removeDMAndUpperCase(AlgoBox.java:367) test2a.job_tgenkey_0_1.job_tGenkey.tOracleInput_1Process(job_tGenkey.java:1098) test2a.job_tgenkey_0_1.job_tGenkey.runJobInTOS(job_tGenkey.java:1501) test2a.job_tgenkey_0_1.job_tGenkey.main(job_tGenkey.java:1366) Caused by: java.lang.ClassNotFoundException: org.talend.utils.string.AsciiUtils java.net.URLClassLoader$1.run(URLClassLoader.java:366) java.net.URLClassLoader$1.run(URLClassLoader.java:355) java.security.AccessController.doPrivileged(Native Method) java.net.URLClassLoader.findClass(URLClassLoader.java:354) java.lang.ClassLoader.loadClass(ClassLoader.java:424) sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 5 more {code}",3 TDQ-8460,"when set an unexist folder for the tDqReportRun, can't generate report doc file but show success in the log","create a tDqReportRun job, set an unexist folder for it, run this job Except Result: can't generate report doc file, show failed in the log Actual Result: can't generate report doc file, but show success in the log",8 TDQ-8470,"on the ""cheat sheet selection dialog"" (get by Help-->cheat sheets...)doesn't contains match anaysis under ""Talend->Analysis"" ","1. click Help-->cheat sheets... 2. check the pop up dialog, under ""Talend-Cheat sheets""-->analysis, Actual Result no match analysis here Expected Result: on the cheat sheet tab list have match analysis, may be we should also show here.",5 TDQ-8481,"Cannot select table from a file connection in the match analysis wizard","# create a file connection # Open the match analysis wizard with the ""new analysis"" menu and click ""next"" # select the ""metadata"" table in the file connection and click ""finish"" This gives the following exception and no data appear in the analysis editor. java.lang.ClassCastException: org.talend.core.repository.model.repositoryObject.MetadataTableRepositoryObject cannot be cast to org.talend.core.model.metadata.MetadataColumnRepositoryObject at org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.translateNodeIntoModelElement(MatchMasterDetailsPage.java:1083) at org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.translateSelectedNodeIntoModelElement(MatchMasterDetailsPage.java:1063) at org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.refreshColumnAndData(MatchMasterDetailsPage.java:842) at org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.setSelectedNodes(MatchMasterDetailsPage.java:838) at org.talend.dataprofiler.core.ui.wizard.analysis.column.MatchWizard.updateAnalysisBySelectedNode(MatchWizard.java:92) at org.talend.dataprofiler.core.ui.wizard.analysis.column.MatchWizard.openEditor(MatchWizard.java:79) at org.talend.dataprofiler.core.ui.wizard.AbstractWizard.performFinish(AbstractWizard.java:67) at org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) at org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) at org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.jface.window.Window.runEventLoop(Window.java:825) at org.eclipse.jface.window.Window.open(Window.java:801) at org.talend.dataprofiler.core.ui.action.actions.CreateNewAnalysisAction.run(CreateNewAnalysisAction.java:112) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1258) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3540) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3161) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:145) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) ",3 TDQ-8482,"incomplete matching distances in match analysis editor","See attached screen capture",5 TDQ-8497,"improve the dialog message","when do empty recyle bin",1 TDQ-9001,"Update component configuration file for TDI-28502","Now we have supported hiding columns(either custom or non-custom type) in column list controller by *FILTER* attribute. So if you want to hide T_GEN_KEY column of tGenKeyHadoop you can modify it's configuration file like below: {code:xml} ... ... ... {code} or simplly: {code:xml} ... ... ... {code} If you want to hide more than one column; for instance, you want to hide all custom columns of tMatchGroupHadoop you can modify it's configuration file like below: {code:xml} ... ... ... ... {code} or simplly: {code:xml} ... ... ... ... {code}",2 TDQ-8515,"Export babili translations into 5.3 branch of GIT",NULL,2 TDQ-8518,"import exported jrxml file get many errors--but can imported","1. in one project, import build-in jrxml. 2. export them. 3. delete all the jrxml 4. import the exported one. Expected Result: should import no errors. Actual Result: get many errors in error log, but can import it. org.talend.dataprofiler.core.ui.imex.model.FileSystemImportWriter - the ModelElemnt of property is null! ",1 TDQ-8532,"keep the same decimal precision on chart and table for benford indicator","1.create a column analysis with benford indicator. 2.run this analysis,turn to result page,the decimal precision on chart is not same as on table. 3.generate a report form this analysis. the decimal precision on chart is not same as on table too. ",8 TDQ-8535,"View Database Structure can not show table and view for hive connection (test by CDH4)","1. create a cdh4 standalone connection. 2. preview one table, works. 3. turn to data explorer, right click on the connection-->View Database Structure 4. result: database structure tab open, but no tables show,refer to pic attached. get warning. 5. restart studio, redo step3. Expected Result: can show tables well. Actual Result: can not show tables, after restart step 5 will get error, ",8 TDQ-8536,"Catalog overview analysis with hive(HDP1.2 embedded) connection filter table is invalid","Catalog overview analysis with hive(HDP1.2 embedded) connection filter table is invalid",8 TDQ-8543,"The popup message is not correct when renaming a opened Jrxml","1, use the Jrxml in some report 2, open the jrxml file 3, select "" rename"" on the right-click menu 4, the popup message is: ""!!! RenameJrxmlFileAction.jrxmlFileOpening!!!"" Should be some meaningful message.",3 TDQ-8545,"when reload table list on the hdp connection, get error","org.talend.cwm.compare.exception.ReloadCompareException: java.lang.NullPointerException at org.talend.cwm.compare.factory.comparisonlevel.CatalogSchemaComparisonLevel.reloadElementOfPackage(CatalogSchemaComparisonLevel.java:313) at org.talend.cwm.compare.factory.comparisonlevel.CatalogSchemaComparisonLevel.getSavedReloadObject(CatalogSchemaComparisonLevel.java:183) at org.talend.cwm.compare.factory.comparisonlevel.CatalogSchemaComparisonLevel.compareWithReloadObject(CatalogSchemaComparisonLevel.java:148) at org.talend.cwm.compare.factory.comparisonlevel.AbstractComparisonLevel.reloadCurrentLevelElement(AbstractComparisonLevel.java:186) at org.talend.cwm.compare.ui.actions.ReloadDatabaseAction$1$1.run(ReloadDatabaseAction.java:159) at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) at org.eclipse.jface.operation.ModalContext$ModalContextThread.block(ModalContext.java:173) at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:388) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) at org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:38) at org.talend.cwm.compare.ui.actions.ReloadDatabaseAction.run(ReloadDatabaseAction.java:186) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:141) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.NullPointerException at java.util.Hashtable.put(Unknown Source) at java.util.Properties.setProperty(Unknown Source) at java.lang.System.setProperty(Unknown Source) at org.talend.core.model.metadata.builder.database.JavaSqlFactory.doHivePreSetup(JavaSqlFactory.java:410) at org.talend.metadata.managment.connection.manager.HiveConnectionManager.createHiveEmbeddedConnection(HiveConnectionManager.java:174) at org.talend.metadata.managment.connection.manager.HiveConnectionManager.createConnection(HiveConnectionManager.java:70) at org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:129) at org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.checkConnection(MetadataConnectionUtils.java:285) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.loadTables(DqRepositoryViewService.java:333) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.loadTables(DqRepositoryViewService.java:323) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getTables(DqRepositoryViewService.java:192) at org.talend.cwm.compare.factory.comparisonlevel.CatalogSchemaComparisonLevel.reloadElementOfPackage(CatalogSchemaComparisonLevel.java:292) ... 43 more ",8 TDQ-8548,"get different result with summary statistics indicators when analyze DB2","1.create a DB2 connection(192.168.30.75) 2.create an analysis with this connection 3.select column Talend->TEST1->ID,select summary statistics indicators. 4.run this anaysis with sql then java engine. turn to result page.Inter Quartile Range and Low Quartile indicator have different result.",5 TDQ-8549,"create new pattern from pattern test view get a NullPointerException","NullPointerException as below: java.lang.NullPointerException org.talend.dataprofiler.core.pattern.actions.CreatePatternAction.run(CreatePatternAction.java:98) org.talend.dataprofiler.core.ui.views.PatternTestView$6.widgetSelected(PatternTestView.java:358) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:141) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",1 TDQ-8550,"the icon on force delete dialog is not correct for sql rules","1. create a table rule analysis, add a sql rule 2. delete sql rule to Recycle Bin. 3. try to empty Recycle bin, get a force delete dialog. Expected Result: should show the icon for sql rule correctly. Actual Result: the icon is not correct for sql rule.",3 TDQ-8551,"No warning icon shows for the corresponding data in the '%Match' column of 'Analysis Result' page.",NULL,5 TDQ-8554,"""Average Length "" can not show correct result in evolution report.","1. create a column analysis, add text indicator. 2. create report about the analysis. 3. generate report with Evolution template. Actual Result: in report, ""Average Length"" result is not correct. Expected Result: should show result correctly. ",1 TDQ-8557,"improve force delete a analysis and the java udi its used","test on Talend-Studio-r113457-V5.3.2 and trunk 1. create a java udi 2. create a analysis with java engine, and run it 3. delete analysis and udi 4. empty recycle bin 5. in the dialog,select force delete, and finish, get error java.lang.NullPointerException at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.logicDeleteDependeny(DQDeleteAction.java:550) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.physicalDeleteDependencies(DQDeleteAction.java:531) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.physicalDelete(DQDeleteAction.java:405) at org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction.run(DQDeleteAction.java:244) at org.talend.dataprofiler.core.ui.action.actions.DQEmptyRecycleBinAction.run(DQEmptyRecycleBinAction.java:67) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:150) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) issue2: when the analysis and its udi all in the recycle bin, and no other items use them, should do empty recycle bin directly without confirm dialog ",5 TDQ-8563,"Create Junit for r113086","1, create junit for the added public method in EObjectHelper; 2, modify the junit of the modified method in DQDeleteHelper.",3 TDQ-8565,"cmdline project can not found the jar which manually added to lid/java","1. log on studio, create db2 connection(no jars in studio, so should manually added to lib/java) 2. create report about the connection. 3. exit the project. 4. log on a cmdline project (commandline.bat and Talend-Studio-win-x86_64.exe in same folder, so the jar already exist) 5. import the report created on step 2. 6. try to execute Report, get error. {code} !STACK 0 java.lang.ClassNotFoundException: com.ibm.db2.jcc.DB2Driver org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:506) org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:422) org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:410) org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(DefaultClassLoader.java:107) java.lang.ClassLoader.loadClass(ClassLoader.java:356) java.lang.Class.forName0(Native Method) java.lang.Class.forName(Class.java:186) org.talend.cwm.db.connection.ConnectionUtils.getClassDriver(ConnectionUtils.java:580) org.talend.cwm.db.connection.ConnectionUtils.createConnection(ConnectionUtils.java:173) org.talend.cwm.db.connection.ConnectionUtils.checkConnection(ConnectionUtils.java:224) org.talend.cwm.db.connection.ConnectionUtils.isConnectionAvailable(ConnectionUtils.java:354) org.talend.dataquality.reporting.engine.ReportDocGenerator.validateReport(ReportDocGenerator.java:309) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:185) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generate(LocalReportDocGenerator.java:130) org.talend.datacleansing.core.service.TDQReportService.executeReport(TDQReportService.java:71) org.talend.commandline.command.CommandProcessor.executeReport(CommandProcessor.java:556) org.talend.commandline.command.ExtensionCommandSwitch.caseExecuteReportCommand(ExtensionCommandSwitch.java:79) org.talend.commandline.client.command.extension.AbstractExtensionCommandSwitch.doSwitch(AbstractExtensionCommandSwitch.java:35) org.talend.commandline.command.CommandProcessorSwitch.caseExtensionCommand(CommandProcessorSwitch.java:161) org.talend.commandline.client.util.CommandAbstractSwitch.doSwitch(CommandAbstractSwitch.java:70) org.talend.commandline.command.CommandConsumer.executeCommand(CommandConsumer.java:57) org.talend.commandline.command.CommandConsumer.execute(CommandConsumer.java:35) org.talend.commandline.mode.ServerCommandLine$CommmandConsumerRunnable.run(ServerCommandLine.java:139) java.lang.Thread.run(Thread.java:722) !ENTRY org.talend.platform.logging 4 0 2014-01-21 15:47:00.773 !MESSAGE 2014-01-21 15:47:00,772 ERROR org.talend.dataquality.reporting.engine.ReportDocGenerator - Run analysis error: abc_1 : Driver not found: com.ibm.db2.jcc.DB2Driver !ENTRY org.talend.platform.logging 1 0 2014-01-21 15:47:00.858 !MESSAGE 2014-01-21 15:47:00,858 INFO org.talend.datacleansing.core.service.TDQReportService - Generated successfully, the report document is store in null !ENTRY org.talend.platform.logging 1 0 2014-01-21 15:49:03.297 !MESSAGE 2014-01-21 15:49:03,296 INFO org.talend.dataprofiler.datamart.utils.DatamartUtils - The structure of talend_dq113525 EXIST, do you want to handle the connection? !ENTRY org.talend.platform.logging 4 0 2014-01-21 15:49:03.330 !MESSAGE 2014-01-21 15:49:03,325 ERROR org.talend.cwm.db.connection.ConnectionUtils - com.ibm.db2.jcc.DB2Driver {code}",8 TDQ-8567,"report about content compare analysis can not generate when set internationalization as French","1. set internationalization as French(works well on set English). 2. create a report about content compare analysis. 3. try to generate report with ""Basic"" template Expected Result: report generate work well. Actual Result: can not get generate report, get errors.",5 TDQ-8574,"The 'Could not connect to your database alias; the exact message was:..' error message poped up after previewing the tables about informix connection.",NULL,8 TDQ-8600,"Data Profiling - Column Analysis fails with Netezza","From Ticket: When I try to run a column analysis containing a pattern low frequency indicator on a Netezza table, I get the following error: ""Fail to run the analysis: Address_Columns_Analysis. Error message: At least one analysis execution failed, Check the error logs for more details."" I have attached the error log. It appears the query for the indicator Pattern Low Frequency Table is unable to be created. However, when I look at the indicator definition under the settings, I see the following SQL template for the Default Database: ""SELECT <%=__COLUMN_NAMES__%>, COUNT(*) c FROM <%=__TABLE_NAME__%> t <%=__WHERE_CLAUSE__%> GROUP BY <%=__COLUMN_NAMES__%> ORDER BY c ASC"" When I replace the expression templates with my table values, I am able to execute it in a separate query editor. We are able to connect to Netezza using Data Integration and the correct driver has been placed under the lib/java folder as well as added as an Extra Class path under Windows -> Preferences -> Talend -> Data Explorer -> JDBC Drivers. We need to be able to execute analysis with Pattern Frequency Stats as well as the other system indicators on Netezza tables Attaching provided workspace log as well.",3 TDQ-8601,"Add CDH5 Support in Profiling",NULL,2 TDQ-8603,"change the match rule editor icon in the export/import item dialog","see attachment image",2 TDQ-8609,"password displays","When I right-click in analysis results and click ""Generate Job"" and select ""generate an ELT job to get only invalid rows"", the input component in the generated job displays my password (instead of *********) in the component settings area.",5 TDQ-8614,"Validate that DQ (M/R) components can run on CDH5","Main components to check are: - tMatchgroup - tStandardizeRow - tGenKey No need to validate standard tGenKeyHadoop and tMatchGroupHadoop components. They're going to be deprecated. ",8 TDQ-8615,"Add support for HDP 2.1 ","Profiling + Data Preview + M/R Components",13 TDQ-8616,"Add support for Pivotal HD 2.0","We must support Pivotal -HD 1.1- *2.0* (Profiling + preview + components)",13 TDQ-8617,"Check that DQ M/R components can run with Pivotal HD","Confirm that the DQ M/R components can run with Pivotal HD 2.0 (Don't check tXXHadoop components)",5 TDQ-8619,"Add support of Kerberos when doing Hive profiling",NULL,8 TDQ-8620,"Investigate profiling with Apache Stinger","The purpose of this research task is to evaluate the Hive profiler on http://hortonworks.com/labs/stinger/ The HDP 2.0 sandbox does not have Stinger activated by default, but HW offers a ""technical preview"" which does not seem hard to install: http://public-repo-1.hortonworks.com/HDP-LABS/Projects/Stinger/StingerTechnicalPreviewInstall.pdf This work item does not require any commit but you may need to patch the studio or run from the dev environment in order to be able to connect to Hive. ",20 TDQ-8622,"DQ Reports generate report of wrong person ","When 2 different persons are generating reports from different time zones, both will get the same reports. Ex. One person is generating DQ reports in New York (Eastern Time), and another is generating reports from San Francisco (Pacific Time). If both happen to be generating the same report using tDqReportRun from different integration jobs. Then the person in SanFrancisco (later time zone) will start receiving reports of the person in the Eastern Time zone.",13 TDQ-8623,"fixed junit fail","We maybe break some junit when do feature or fixed some bug. Fixed them on this task, and improve those junit make them only care about what will be input and what will be output or get. About how we get those result we should ignore it so that our junit will not easy to be broken. Note that we should explain what change is make this break when we commite some code to fix one junit.",1 TDQ-8625,"Run job which contains tMatchgrouphadoop will failed",NULL,8 TDQ-8634,"Branding update","Update branding images in studio and DQ portal. Review other required changes see PMUP-149",3 TDQ-8636,"Special characters in analysis name did not show correctly in repository",NULL,5 TDQ-8637,"Unable to execute regular expression functions against Teradata","I am using the Talend Open Studio for Data Quality 5.4.1.r111943 on a Windows XP laptop connecting to a Teradata database (version 13.10.04.14). When attempting to execute any of the regular expressions against a column in a Teradata table, I receive the following error message: java.lang.NullPointerException at com.teradata.jdbc.TeraStatement.parseCreateProcedure(TeraStatement.java:197) at com.teradata.jdbc.jdbc_3.ifjdbc_4.TeraLocalStatement.parseCreateProcedure(TeraLocalStatement.java:569) at com.teradata.jdbc.jdbc_3.ifjdbc_4.TeraLocalStatement.executeQuery(TeraLocalStatement.java:81) at com.teradata.jdbc.jdbc_3.ifjdbc_4.TeraLocalStatement.executeQuery(TeraLocalStatement.java:110) at org.talend.dataprofiler.core.ui.views.PatternTestView.testRegularText(Unknown Source) at org.talend.dataprofiler.core.ui.views.PatternTestView.access$0(Unknown Source) at org.talend.dataprofiler.core.ui.views.PatternTestView$8.widgetSelected(Unknown Source) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",5 TDQ-8657,"some problem about report","1. ColumnSet basic report of html type in DQPortal, can't show the result in the table, but in pdf file, it is ok. see: cs_basic_html.png and cs_basic_pdf.png 2. in the evolution report, the first point of the line is ahead of the time in the x axis, the time should ahead of the point. see: column_evolution.png, column_set_evolution.png, overview_evolution.png, dqrule_evolution.png",3 TDQ-8678,"Refactor & Junit for Hive handlers","Now, this hierarchy is wrong. {code:java} public class HiveYarnHandler extends HortonWorksHandler { {code} Refactoring the code with appropriate Junits coverage.",3 TDQ-8691,"TLoqateAddressRow stalls no way to determine what the problem is","TLoqateAddressRow stalls no way to determine what the problem is is there a way to tell the component to send any address/record to a file or reject and move on to the next record. Several times I ran different size batches and it just stalls no way to determine what the problem is.",8 TDQ-8689,"Threshold violation alert job on a DQ rule has incorrect wording in email message",NULL,8 TDQ-8690,"Customer would like option to use Oracle with service name in DQ Reports","Customer would like to have the option to select ""Oracle with Service Name"" and only Oracle with SID is currently available for DQ reports. The ""Database connection settings"" folder in the report editor must be adapted to this requirement. Same thing for the Reporting preference page. There are two things to do: # add the different ways to connect to Oracle # allow the user to edit directly the URL (like we can edit it in the new connection wizard) For 5.5, we'll only add the service name option and we won't modify the URL behavior. The other features will be done in 5.6.",2 TDQ-8695,"The ""Report generation failed"" dialog pops up When run basic report about column content comparison analysis.","1.Start studio. 2.Create one column content comparison analysis. 3.Create basic report with create analysis of last step. 4.Run report. Expected result: The report generated successfully and no error shows. Actual result: The report cannot be run successfully. See attachment error.jpg and column content comparison.txt ",5 TDQ-8706,"Improve Datamart settings","Customer would like to have the option to select ""Oracle with Service Name"" and only Oracle with SID is currently available for DQ reports. The ""Database connection settings"" folder in the report editor must be adapted to this requirement. Same thing for the Reporting preference page. There are two things to do: # add the different ways to connect to Oracle # allow the user to edit directly the URL (like we can edit it in the new connection wizard) notes: - the url field is editable for all databases (not only oracle) - when the url is edited, the values of the server, database, schema and port should be retrieved into the ""server"", ""database"", ""schema"" and ""port"" fields. - display a warning if the URL is invalid (syntactically) - like in the connection wizard, the fields are editable, only the label in front of the fields are greyed out (in order to show that they are not required to be filled in - they are filled in automatically)",13 TDQ-8718,"Removing DB selection in Match Analysis causes ""Progress Information"" window to loop","I have created a match analysis in the profiler. I decided to change the data source, so I removed the check mark for the existing DB and when I did that, the ""Progress Information"" window keeps popping up (see attachment). It seems to be in a loop.",8 TDQ-8717,"Null result for Range (in summary indicators) when the first data is null and in java mode","1, prepare the data in the table: make the first data of the column is: null, the following data can have values. 2, create a summary analysis to analyze this column , and select java mode to run it. 3, the result of the range is : null , which should not be(in sql mode ,the value is not null) FOr mysql, and DB2, (maybe also other dbs),all have this problem. this is caused only when the first data is null in table. the related code is: MinValueIndicatorImpl line 100. (which should add judgement before just turn it to double)",1 TDQ-8725,"Report format distortion on business rule basic report","Report format distortion when viewed through the DQPortal - The labels get cut off, headers disappear in the business rule basic. And when I export the report, I found: 1, export as PDF and RTF, it shows correct 2, export as XLS, it shows liked the this issue 3, export as JPG, failed on all kinds of reports, it shows blank dialog, in log, there has such excepiton: 12 Mar 2014 11:44:47,464 ERROR it.eng.spagobi.utilities.engines.AbstractEngineStartServlet.handleException:70 - Service execution failed it.eng.spagobi.utilities.engines.SpagoBIEngineException: An error occurred while executing report. Check log file for more information at it.eng.spagobi.engines.jasperreport.services.JasperReportEngineStartAction.doService(JasperReportEngineStartAction.java:111) at it.eng.spagobi.utilities.engines.AbstractEngineStartServlet.doService(AbstractEngineStartServlet.java:53) at it.eng.spagobi.utilities.service.AbstractBaseServlet.service(AbstractBaseServlet.java:54) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at it.eng.spagobi.utilities.filters.SpagoBIAccessFilter.doFilter(SpagoBIAccessFilter.java:200) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) at java.lang.Thread.run(Thread.java:636) Caused by: it.eng.spagobi.engines.jasperreport.JasperReportEngineRuntimeException: Impossible to run report at it.eng.spagobi.engines.jasperreport.JasperReportEngineInstance.runReport(JasperReportEngineInstance.java:124) at it.eng.spagobi.engines.jasperreport.services.JasperReportEngineStartAction.doService(JasperReportEngineStartAction.java:101) ... 18 more Caused by: it.eng.spagobi.engines.jasperreport.JasperReportEngineRuntimeException: Impossible to run report at it.eng.spagobi.engines.jasperreport.JasperReportEngineInstance.runReport(JasperReportEngineInstance.java:257) at it.eng.spagobi.engines.jasperreport.JasperReportEngineInstance.runReport(JasperReportEngineInstance.java:122) ... 19 more Caused by: java.lang.RuntimeException: Error while producing jpg image of the report at it.eng.spagobi.engines.jasperreport.exporters.JRJpegExporter.exportReport(JRJpegExporter.java:84) at it.eng.spagobi.engines.jasperreport.JasperReportEngineInstance.runReport(JasperReportEngineInstance.java:251) ... 20 more Caused by: java.lang.IncompatibleClassChangeError: Found class com.sun.image.codec.jpeg.JPEGImageEncoder, but interface was expected at it.eng.spagobi.engines.jasperreport.exporters.JRJpegExporter.exportReport(JRJpegExporter.java:74) ... 21 more ",5 TDQ-8734,"No response when open the basic report with column content comparison anlysis in the Dq portal","1.Start studio and create mysql database. 2.Create one column content comparison analysis. 3.Create basic report with created column content comparison. 4.Login Dq portal with tdq_user and password: tdq. 5.Select ""Redundancy Basic"" in the ""Redundancy Report"" under ""Reporting"" menu. 6.Click search icon of ""Report"". 7.Select column_content and click ""confirm"" button in the popped dialog. 8.Select ""Execute Document"" icon. Expected result: The report should be shown. Actual result: No response after clicking ""Execute Document"" icon. (Report name: column_content datamart: see attachment datamart.jpg analysis configuration: column configuration.jpg Log file of dq portal:catalina.2014-03-14.log and SpagoBIJasperReports.log) ",5 TDQ-8737,"Unified Address Validation API","expected input: 1 address field expected output: 1 address field (corrected) + 1 status field (string) + 1 accuracy code (returned by the vendor? or defined by Talend?) + optional list of enrichment fields (1 string in key/value format) The initialization of the API requires some parameters: # the address correction vendor (Enum) # the parameters required by the vendor (key, values) # default country (when we cannot parse the country of the input address) # list of enrichment fields (list of fields that the vendor can provide such as location coordinates, administrative area, ...). This list is a closed list (we need to map it to the actual list of each vendor) Wrapping existing vendors: https://help.talend.com/display/TalendComponentsReferenceGuide54EN/tGoogleAddressRow https://help.talend.com/display/TalendComponentsReferenceGuide54EN/tLoqateAddressRow https://help.talend.com/display/TalendComponentsReferenceGuide54EN/tMelissaDataAddress https://help.talend.com/display/TalendComponentsReferenceGuide54EN/tQASAddressRow Note: This API will be used by all new components and by iPaaS. *To be defined further*",13 TDQ-8741,"tGoogle* to provide a way to apply a license","h1. Requirement The tGoogle* components are limited in the number of calls per day accepted by Google. A customer has purchased a licence to make more calls per day, they need to be able to apply the license in the component somehow. Ideally we would include a facility to supply a licence (in the component, or elsewhere in the Studio) h1. Background See also http://www.talendforge.org/forum/viewtopic.php?id=33027 ",8 TDQ-8766,"Create a component tReservoirSampling",NULL,2 TDQ-8771,"Create version 5.4.2 in Babili and populate it",NULL,2 TDQ-8774,"tMatchGroup component in map/reduce job is creating different GID than standard job","I have created a map/reduce job using tMatchGroup. The GID that is created has a different format than the GID from a standard job. GID from map/reduce job - d79469c1-c9fe-4de3-ac7c-e3190e3f5d6e GID from standard job - 1 I think these should be consistent and definitely prefer the GID from the standard job. TODO: Add a version to the component. if the component has no version defined (after an import action), then we output a numeric GID (for backward compatibility). if the component is just dragged&dropped on a new job, then the version is, let's say, 2. And the output GID is of string type. this means, nothing to change in the UI part. ",8 TDQ-8778,"Align the tMatchGroup (M/R) features with those of the tMatchGroupHadoop","The tMatchGroupHadoop has an option to do matching with multiple passes. This feature must exist in the tMatchGroup component. ",20 TDQ-8780,"when generate ""Alert threshold Violation"" job, will get inform dialog, but both ""yes"" and ""no"" works for the job.","1. create a report, set datamart with mysql or oracle. 2. right click on the report-->Generate jobs->Alert threshold Violation the job generated and will pop up a dialog(refer to pic), no matter click ""yes' or ""no"" job can run well, so what's the difference, can we remove it ",3 TDQ-8785,"Add support to Cloud connector for address validation as one component.","Component name: tCloudAddressRow # Develop the Loqate Address Provider to be included in the Address Verification API # Develop a tLoqateCloudAddressRow component that uploads data to the cloud and retrieves the corrected data. h1. Technical reference documentation https://www.everythinglocation.com/api-references/ We develop first the transactional processing: https://www.everythinglocation.com/api-rest-transactional/ Before launching the address correction requests, we may check the status of the server with ""https://devsaas1/rest/version/?lqtkey=[APIKEY]"". See also https://help.talend.com/display/TalendComponentsReferenceGuide54EN/tLoqateAddressRow The component category is the same as the existing address components (Data Quality/Address ?) We'll design one component for all Address providers. The first version of the component focuses only on the available fields provided by the Adddress API. The fields define the output schema. *Notes*: - Automatically Define an output schema that contains all the columns available in the API. - only use the ""synchronous"" calls of the API. (will use async calls in a later version) - like tLoqateRow, define an input mapping in the properties - like in tLoqateRow, do define an output mapping. But auto fill this mapping with all the fields available in the API (they are the same as the output schema). The user is able to rename fields or remove fields in the output schema. - dropdown list option in the component to choose the provider between : Loqate, Melissadata (Google only for developers) - the output schema is currently given by the list of fields from the API (address1, address2, country, ....). *Output code*: use vendor code for accuracy code, status code, geocoding code *Advanced settings*: - keep the same loqate advanced settings as in the tLoqateRow (check whether the other providers work the same way). ",20 TDQ-8786,"Enable Cloudera Impala profiling","Cloudera Impala: http://www.cloudera.com/content/cloudera/en/products-and-services/cdh/impala.html Installation: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/Installing-and-Using-Impala.html SQL reference: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/ciiu_langref.html JDBC connection: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/ciiu_impala_jdbc.html?scroll=impala_jdbc Security: We must at least support http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/ciiu_kerberos.html Relation with Hive: http://is.gd/wIcQmh",5 TDQ-8787,"Incremental display of results in the profiler","Currently, when we run an analysis, we display the results only after all indicators are computed. Now, we must display the results in the charts as soon as they are computed. With the SQL engine, each indicator is computed independently. Therefore we can display the results of each indicator in the charts as soon as they arrive. Question: - some charts require several indicators (simple statistics chart for instance). Can we build the chart dynamically? That is add bars to the chart as each indicator result comes. - if not we need to group indicators together. Therefore, only complete charts would appear: The simple stat chart would appear as soon as all simple stat indicators are computed and the frequency table chart would be computed independently as soon as the frequency indicator is computed. Notes: - The user can switch between the settings page and the results page. Therefore, the chart must be incrementally displayed both in the setting page (when the focus is the setting page) and in the results page (when the focus is the results page). - this feature only applies to SQL engine (with Java engine, there is a loop on all rows and all indicators are computed at the same time, so we can't display one indicator before the other). - in column set analysis with SQL engine, there is only one chart with simple statistics => nothing to do (moreover, all indicators are computed together too) - nothing to do for match analysis, all correlation analyses - overview analysis: we won't display the results dynamically in the table. - table display: can we dynamically display the results in a table (simple statistics for instance)? - chart display: can we dynamically display the results in a chart (simple statistics for instance)? - could display each bar dynamically (if possible) for -- functional dependency -- Business rule -- redundancy analysis - no need to refresh charts when we run a report (no direct synchronization exists between report execution and analysis execution) - if there is a focus on the editor and we execute the analysis from the menu (in dq repository or in toolbar), we need to dynamically refresh the charts. - the ""refresh"" button in the analysis editor keeps the same behavior as before: it only display the charts, there is no computation of the indicators. *Suggestion*: display the chart with empty values at the beginning (while queries are running), then add values into the chart when they are computed. ",20 TDQ-8788,"Improve the memory management of the java engine computation engine ","See PMDQ-168 All analyses should be able to profile several GB of data without crashing or without stopping the computation (as is currently the case)",20 TDQ-8789,"Integrate the t-swoosh algorithm in the match analysis editor",NULL,20 TDQ-8790,"Support MelissaData Cloud Address web service in the tCloudAddressRow component","See tCloudAddressRow specification. For documentation purpose: http://www.melissadata.com/address-verification/index.htm http://www.melissadata.com/address-verification/countries.htm ",5 TDQ-8797,"Deprecate tFuzzyJoin and tBlockedFuzzyJoin","These two components are efficiently replaced by the tRecordMatching component. Hide them from the palette. Just keep them for backward compatibility. ",1 TDQ-8805,"reload database list about for ""General JDBC connection about hsql Server mode"" lead to all structure lose","1. crate a General JDbc connection about hsql serve mode server start by->java -cp ../lib/hsqldb.jar org.hsqldb.server.Server --database.0 file:bbb --dbname.0 ww hsql version: hsqldb-2.3.2 2. db connection show well. 3. try to ""reload database list"", Expected Result: should show structure well. make sure all reload function work well. Actual Result: structure lose. note: this issue show on 5.4.2-r115399, r115399-5.6.0 on 5.3.3-115069 no this issue, no more new build, dev please check this.",8 TDQ-8808,"Create missing fragments","org.talend.designer.tdqmatching.nl Check again whether there are other missing fragments in DQ projects too. ",5 TDQ-8810,"drill down function for analysis about context dbconnection can not get correct data at certain operations","1. create a context mysql connection, make sure it has two context group, and one group is about server 1(default context), another is about server2. server1 and server2 has a same catalog and under the catalog have a same table(T1), but Row count in two server is different. 2. connection get tables from server1 3. create a column analysis about T1, add ""Row Count"" indicator 4. run get correct result, drill down also is ok 5. switch context to server2 6. run analysis get ""Row Count"" from server2, but drill down for ""Row Count"" still get from server1. do ""Reload table list"" will solver the drill down issue on step 6. note: if the two context group are from same server but different catalog name, drill down in step 6 is ok. ",2 TDQ-8818,"The tdqReportRun job can't be to run successfully after running on remote server.",NULL,5 TDQ-8830,"Create a tBatchAddressRowCloud component","We first need to enrich the Address API to support batch file processing. The process has several steps: # read data from input stream and prepare files (we may need several files during a stream) to be sent to the address provider. # send the file(s) to the address provider and get the results. # output the results in the output flow of the component The input stream may be splitted in several files (for instance, if there is a limit to the number of rows to submit to the address provider). So, there may be the need for a size parameter in the component. Each file can be sent independently. This means we don't need to wait for the response to the first file in order to start requesting the an address correction on the second file. We can even think to process data in parallel: when a Talend flow is parallelized in the job editor, several files of input data must be created. Each of the file must be sent as soon as ready to the Rest API. We must also be able to deactivate the parallel execution when the provider does not support several requests at the same time. Once the API works and Junit are created, we can develop the tBatchAddressRowCloud component. h1. Handle Loqate first This component receives address records and call the loqate batch API: https://www.everythinglocation.com/api-rest-batch/ See also https://www.everythinglocation.com/batch/list.php This component sends a file (formatted as expected by Loqate) to the web service, retrieves the corrected addresses and output them in an output flow. ",3 TDQ-8837,"Make TOS DQ compatible with Apache license","Attached the list of libraries to remove. The third party library download feature must install all the required libraries when needed. Compatibility list: http://apache.org/legal/resolved.html#category-a",5 TDQ-8839,"Upgrade Loqate component with latest library","The API had a major Schema change in 2013. We need to upgrade the component with the latest API. Download latest Loqate repository and check that everything works fine. ",5 TDQ-8882,"Export babili translations into git (for 5.4.3)",NULL,2 TDQ-8970,"Integrate the t-swoosh algorithm in the tMatchGroup component","{color:green}-->Request：{color} - Add a radio button in the tMatchGroup wizard to select between T-Swoosh and Simple VSR algorithms (on the same rows as the ""limit"" field) --> when select ""VSR"", show the ""key definition"" table with 5 columns; --> when select ""T-swoosh"", show 2 tables: 1) ""key definition"" table with 8 columns, 2) Default Surviviorship Rules table with 3 columns. ( the 2nd table is locate under the 1st table) - When running the job, need to check which algorithm is selected, and use it in tMatchGroup. - (Reuse as much as possible the composite classes of the analysis editor) - (Reuse the same EMF model in the component as in the match rule of dq repository view) - Make sure the import/export match rules work with these new parameters (and that we did not break the old behavior) {color:green}-->Analyze/Design:{color} 1) UI part: - Need to add 2 swoosh's tables in ConfigureMatchRuleDialog, the current ""Key definition"" table is different with the table in the Match analysis, and the swoosh's table maybe also can not reuse the table in the match analysis - MatchRuleUIService is working for the tMatchGroup only, and the match analysis uses another set of table viewers. - The chart and the preview data table no need to change 2) Model part: - The match analysis uses: RecordMatchingIndicator, the tMatchGroup uses: - The T-swoosh need: SurvivorShipAlgorithmParams for AnalysisMatchRecordGrouping, - The tmatchgroup operate the match rules in its main.javajet, this means: if can not move it out to a java class( or reuse current ones), need to add the logic for swoosh in javajet too. It is better to consider how to make add different algorithm easier in future for tMatchGroup. 3) ""Chart"" part: - The ""Chart"" button on the ConfigureMatchRuleDialog now has 2 different logics: VSR and T-swoosh. The execution behind it is different. Need to check how many percent of the code from the match analysis can be reused. 4) execute algorithm part: - The match analysis uses : BlockAndMatchManager to execute ( in it, separate the algorithm, to use AnalysisMatchRecordGrouping or AnalysisSwooshMatchRecordGrouping). Currently the tMatchGroup overwrite ""AbstractRecordGrouping"" in its tMatchGroupIn_main.javajet, try to reuse the same logic for the match analysis. (If difficult, at least try to reuse AnalysisMatchRecordGrouping or AnalysisSwooshMatchRecordGrouping) - In tMatchGroupIn_main.javajet, too many match related logics, check if them can be replaced by related java classes in record.linkage. {color:green} --> Implement:{color} 1) UI part: - Firstly, modify the Configuration dialog: --> add the algorithm choose button, --> add 2 tables for swoosh: key definition, default survivorship rule (Can not reuse the table viewer : SurvivorShipTableViewer, because the component is different) need to check for each columns in the table ( value, how to initial swoosh algorithm with them in javajet) --> make the new tables action correct for add/remove row. --> when select swoosh : hide the VSR related table, show 2 swoosh related table; when select VSR, hide swoosh's tables, show VSR's table. 2) Model part: The component use the plugin: org.talend.designer.tdqmatching, so need to modify this plugin, to add the support for swoosh. 3) Chart on the config dialog: need make ""chart"" button work correctly for each algorithm: for swoosh algorithm: 4) run job part: ",20 TDQ-8972,"Add support to Experian QAS in the tAddressRowCloud component","We need to add QAS support in the tAddressRowCloud component. http://www.qas.com/address-verification.htm#tab_3",13 TDQ-8979,"Deprecate tMachGroupHadoop and tGenKeyHadoop","Hide these components from the default palette (move them in a hidden category) change tMachGroupHadoop and tGenKeyHadoop to a hidden category ""Technical"" ",1 TDQ-8982,"Check that indicators can run in parallel","Column analysis can already create several connections to the database and run several queries in parallel. Here, we must list the databases that don't support parallel queries. And we must see list the analysis types that can't use parallel execution. ",8 TDQ-9004,"Update indicators and regexes in Talend Exchange",NULL,5 TDQ-9029,"Activate Exchange indicators and regexes and rules for 6.0","Upgrade interesting extensions in Talend Exchange.",3 TDQ-9050,"english and french message for Delete inform dialog are different","1. create a dbconnection and a column analysis. 2. delete the dbconnection, then empty the Recycle Bin, check the inform dialog message Expected Result: it should be same Actual Result: not same ",1 TDQ-9058,"Alter threshold violation can not run well when datamart is oracle and report use context parameters.","1. create a report file. in report editor set db type: oracle with sid. 2. in the context tab, add host,port,sid, schema,user, password, and set values for each parameters,(my schema and uer is same) 3. make sure report use the context value. 4. generate report file. succssfully. 5. right click on the report to generate a ""Alter threshold violation"" job. Expected Result: job can run well, after set parameters for tSendMail Actual Result job can not run. NOTE: if datamart use mysql, it is ok. if datamart use oracle, but doesn't use context, it is also work well.",8 TDQ-9071,"Unify address results codes ","Different providers use different result codes for accuracy codes. We must define our own codes and then map the codes from the providers to our codes. That means that the user can then easily change the provider and the rest of the job (after the address component) will remain the same. Suppose the user wants to filter some addresses given their accuracy code, with unified codes, no change is required after changing a provider. ",13 TDQ-9089,"Create version 5.4.3 in Babili and populate it",NULL,2 TDQ-9775,"add Oracle OCI support and db version in the tdqportal installer"," - add a new database type ""Oracle OCI"" in the database list of the tdqportal installer - add a new combo ""Db Version"" in the wizard of the tdqportal installer -Addition to the screenshots: add a browse button on the right of the database type in the second page of the wizard so that the user will provide the driver for his connection.- -We must not provide the JDBC drivers.- ",2 TDQ-9109,"Semantic Studio","Add semantic-aware features to the studio. See related features: https://jira.talendforge.org/issues/?filter=18839",13 TDQ-9124,"Improve date pattern recognition and enrich the current date pattern indicator","Use these regular expression to find the appropriate data pattern. First, a more generic pattern (a pattern that would match all date patterns) should be used to determine whether the data is in a possible date format. Then in a second step, the more precise date pattern must be applied in order to determine the date format. ",8 TDQ-9130,"Create version 5.5.1 in Babili and populate it",NULL,2 TDQ-9132,"Create version 5.5.2 in Babili and populate it",NULL,2 TDQ-9141,"Profiler : Allow variables, like context variables - Part I ","Allow variables, like context variables, to be valid fields in analysis and report input fields, like date range on where clauses. Today to run a profile over a date start/stop and then change the range requires hard coding and then changing that hardcoded value. Concerned analysis fields: - data filter - number of connections per analysis Concerned report fields: - output folder - output filename - execution date range (start / end) - logo file path Enable context usage of contexts in TOS DQ (only use built-in contexts => no need to display the context node in dq repository view)? is Context view reusable? Adapt the analysis editor to display the context and allow the user to switch between contexts just as in the report editor. Add a separate section ""Context group"" in the analysis editor AND move the current context of the report editor into a new section too.",20 TDQ-9163,"try to create mysql datamart by studio, get download jar dialog pop up which not related mysql","open a report, set parameter in the report editor which datamart doesn't exist click ""check"" get download jar dialog pop up, but the jar is not related with mysql. NOTE: if can not reproduce, restart studio, then re-click ""check""",8 TDQ-9164,"improvement about report","detail information refer to sub-task",8 TDQ-9172,"Add multiple pass option in standard tMachGroup","The standard version of the tMatchGroup must be aligned with its MR counterpart: we must enable the multiple-pass option. https://wiki.talend.com/display/talenddataqualityteam/Differences+between+matching+components",3 TDQ-9177,"tCloudAddressRow improvements","- Change ""Input Address"" label to ""Mapping"" - For the ""output script"" in advanced settings, remove ""(English)"" from the label ""Latin(English)"". Choices should be Latin/Native",8 TDQ-9179,"Add Google as a provider in tCloudAddressRow","Use the Places API from Google. See more details in TDQ-8741",8 TDQ-9183,"some problems of datamart",NULL,13 TDQ-9194,"remove plugin org.talend.dataprofiler.libraries","after https://jira.talendforge.org/browse/TDQ-8837 ,there isn't anywhere to use 'org.talend.dataprofiler.libraries'.",1 TDQ-9205,"dqportal can not support mysql high version driver.","1. install dqportal with Talend-DQPortal-20140707_1931-V5.6.0SNAP.zip, choose mysql datamart type 2. after install finished, copy mysql-connector-java-5.1.30-bin.jar to tomcatpath/lib 3. start dqpotal. 4. try to show detail report content Expected Result: show report content well. Actual Result: can show the report list, but can not show report content. note: if on step 2 use mysql-connector-java-5.0.8-bin.jar, it is works. No problem when installing with the installer. ",5 TDQ-9206,"in preference page, edit status for datamart parameters should be correct(should same with report editor).","1. open preference page, go to datamart settings page 2. datamart select mysql or oracle, 3. check the ""Url"" filed status, it is not gray, in report editor, it is gray by default. 4. when focus on ""Url' text field, ""Host"",""Port"", ""Db Name"" status no change, in report editor it turns gray. Expected Result: edit status should same behaviour with report editor Actual Result: it is not same behaviour",1 TDQ-9207,"tLaunchDQReports should not show in job Palette by default.","1. In Di perspective, open a job. 2. check the job Palette, tLaunchDQReports under ""Deprecated"" Expected Result: the component should not show by default Actual Result: show the component NOTE: on 551, we don't show it",1 TDQ-9211,"Profiler hangs after clicking on Select Data in Matching profile","I have previously created a matching profile that is using a hive table as input. I opened the matching profile and I do not have my hive vm up. When I click on the Select Data button, the little circle comes up and the studio shows ""Not Responding"". I've let it sit there for about 10 minutes and it never comes back. I have to restart the studio. There should be a time out after a certain amount of time and this should be configurable.",5 TDQ-9212,"Create version 5.5.2 in Babili and populate it",NULL,2 TDQ-9214,"Create version 5.6.0M2 in Babili and populate it",NULL,2 TDQ-9216,"Export babili translations into git on 5.5 branch",NULL,2 TDQ-9218,"Export babili translations into git on master branch",NULL,2 TDQ-9229,"Input fields improvements in the tCloudAddressRow component","Two things to do in this feature: # the input fields can be propagated to the output (for instance, the input schema could contain information about the customer account, etc). # the input address mapping should be the same as for the other providers (internally, we must concatenate the different fields in order to pass a single address to the Google api)",8 TDQ-9244,"when db server is stopped, some operations can not get correct inform dialog.","1. create a match analysis about mysql dbconnection, select matching key 2. stop the mysql server , so can not connect to it. issue 1: try to run the match analysis, get error refer to ""match_ analsis_now.jpg"" but o 551 refer to ""match_analyis_551.jpg"" issue 2: try to click ""refresh data"" on match analysis editor, get a dialog not any information.(ok on 551) issue 3: try to reload database list, try to do database compare, also on the dialog no correct information(also on 551) ",3 TDQ-9254,"create a TUJ for TDQ-9172","This TUJ contians all case of description on TDQ-9172.",5 TDQ-9268,"Add download of required / optional packages in the TOS_DQ same as the enterprise product.","Add download of required / optional packages in the TOS_DQ same as the enterprise product.",8 TDQ-9270,"improve for the match analysis editor after integrating the t-swoosh algorithm","issue1: change ""MDM T-Swoosh Algorithm"" to ""T-Swoosh Algorithm"" issue2: when select ""MDM T-Swoosh Algorithm"", and select ""store on disk"" in the ""Analysis parameter"" then run analysis, get NPE java.lang.NullPointerException at org.talend.dataquality.record.linkage.grouping.swoosh.DQMFBRecordMerger.merge(DQMFBRecordMerger.java:63) at org.talend.dataquality.matchmerge.mfb.MFB.execute(MFB.java:137) at org.talend.dataquality.record.linkage.grouping.TSwooshGrouping.swooshMatch(TSwooshGrouping.java:120) at org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.end(AbstractRecordGrouping.java:394) at org.talend.dq.analysis.ExecuteMatchRuleHandler.executeWithStoreOnDisk(ExecuteMatchRuleHandler.java:148) issue3: improve the table column width more longer in the ""Default Surviorship Rules"" issue4: in the ""Match and Survivor"" section, in the ""Match Rule 1"" tab, add a new item, select string type column as ""Input column"", select ""Largest (for numbers)"" as ""Function"", click ""chart"" button, popup a error dialog to show user is better java.lang.NumberFormatException at java.math.BigDecimal.(Unknown Source) at java.math.BigDecimal.(Unknown Source) at org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.parseNumberValue(MFBRecordMerger.java:208) at org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.createMergeValue(MFBRecordMerger.java:121) at org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.merge(MFBRecordMerger.java:62) change the ""Confidence Weight"" to 0 click ""chart"" button, popup a error dialog to show user is better java.lang.IllegalArgumentException: All attribute matcher weights are 0. This is an invalid setting! at org.talend.dataquality.record.linkage.record.AbstractRecordMatcher.normalize(AbstractRecordMatcher.java:186) at org.talend.dataquality.record.linkage.record.AbstractRecordMatcher.setAttributeWeights(AbstractRecordMatcher.java:167) issue4: change the text field ""Max buffer size"" show its border issue5: when i select hide chart from the preference page, the chart in the match analysis doesn't follow this",20 TDQ-9272,"""Phone Number Statistics"" indicator can not get result show.","1. create a column analysis. add two columns (one int, one varchar) 2. set java engine, add ""Phone Number Statistics"" 3. run the analysis. Expected Result: analysis run success. and show result pic correctly. Actual Result: on top can show result for varchar type but can not for int type on tdq can not show any result. {code} java.lang.reflect.InvocationTargetException org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:477) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:121) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:103) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.createPreviewCharts(ColumnMasterDetailsPage.java:423) org.talend.dataprofiler.core.ui.editor.analysis.ColumnMasterDetailsPage.refresh(ColumnMasterDetailsPage.java:448) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.refresh(ColumnAnalysisResultPage.java:180) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisResultPage.fireRuningItemChanged(AbstractAnalysisResultPage.java:204) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:252) org.eclipse.ui.internal.UILockListener.doPendingWork(UILockListener.java:164) org.eclipse.ui.internal.UISynchronizer$3.run(UISynchronizer.java:158) org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134) org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:155) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) Caused by: java.lang.ClassCastException: org.jfree.chart.plot.PiePlot cannot be cast to org.jfree.chart.plot.CategoryPlot org.jfree.chart.JFreeChart.getCategoryPlot(JFreeChart.java:830) org.talend.dataprofiler.core.ui.utils.AnalysisUtils.createDynamicModel(AnalysisUtils.java:267) org.talend.dataprofiler.core.ui.editor.analysis.MasterPaginationInfo.createChart(MasterPaginationInfo.java:159) org.talend.dataprofiler.core.ui.editor.analysis.MasterPaginationInfo.render(MasterPaginationInfo.java:113) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) ... 37 more {code}",3 TDQ-9276,"Create version 5.6.0M3 in Babili and populate it",NULL,2 TDQ-9282,"Support new hadoop distributions",NULL,8 TDQ-9283,"rename dbconneciton when match analysis editor open, get error.","1. create a dbconnection. 2. create a match analysis. 3. when match analysis editor open, rename dbconnection. THIS issue also show on 551 build. Expected Result: should rename correctly. Actual Result: get error in error log and a dialog pop up. {code} java.lang.NullPointerException org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.reloadDataproviderAndFillConnCombo(Unknown Source) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor$3.handle(Unknown Source) org.talend.dataprofiler.core.ui.events.EventManager.publish(Unknown Source) org.talend.dataprofiler.core.ui.utils.WorkbenchUtils.nodifyDependedAnalysis(Unknown Source) org.talend.dataprofiler.core.ui.editor.connection.ConnectionEditor.doSave(Unknown Source) org.eclipse.ui.internal.SaveableHelper$2.run(SaveableHelper.java:151) org.eclipse.ui.internal.SaveableHelper$5.run(SaveableHelper.java:277) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:464) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:372) org.eclipse.jface.window.ApplicationWindow$1.run(ApplicationWindow.java:759) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.jface.window.ApplicationWindow.run(ApplicationWindow.java:756) org.eclipse.ui.internal.WorkbenchWindow.run(WorkbenchWindow.java:2600) org.eclipse.ui.internal.SaveableHelper.runProgressMonitorOperation(SaveableHelper.java:285) org.eclipse.ui.internal.SaveableHelper.runProgressMonitorOperation(SaveableHelper.java:264) org.eclipse.ui.internal.SaveableHelper.savePart(SaveableHelper.java:156) org.eclipse.ui.internal.EditorManager.savePart(EditorManager.java:1369) org.eclipse.ui.internal.WorkbenchPage.savePart(WorkbenchPage.java:3334) org.eclipse.ui.internal.WorkbenchPage.saveEditor(WorkbenchPage.java:3347) org.eclipse.ui.internal.SaveAction.run(SaveAction.java:76) org.eclipse.jface.action.Action.runWithEvent(Action.java:498) org.eclipse.jface.commands.ActionHandler.execute(ActionHandler.java:119) org.eclipse.core.commands.Command.executeWithChecks(Command.java:476) org.eclipse.core.commands.ParameterizedCommand.executeWithChecks(ParameterizedCommand.java:508) org.eclipse.ui.internal.handlers.HandlerService.executeCommand(HandlerService.java:169) org.eclipse.ui.internal.keys.WorkbenchKeyboard.executeCommand(WorkbenchKeyboard.java:468) org.eclipse.ui.internal.keys.WorkbenchKeyboard.press(WorkbenchKeyboard.java:786) org.eclipse.ui.internal.keys.WorkbenchKeyboard.processKeyEvent(WorkbenchKeyboard.java:885) org.eclipse.ui.internal.keys.WorkbenchKeyboard.filterKeySequenceBindings(WorkbenchKeyboard.java:567) org.eclipse.ui.internal.keys.WorkbenchKeyboard.access$3(WorkbenchKeyboard.java:508) org.eclipse.ui.internal.keys.WorkbenchKeyboard$KeyDownFilter.handleEvent(WorkbenchKeyboard.java:123) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.filterEvent(Display.java:1253) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1052) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) org.eclipse.swt.widgets.Widget.sendKeyEvent(Widget.java:1103) org.eclipse.swt.widgets.Text.sendKeyEvent(Text.java:1427) org.eclipse.swt.widgets.Widget.sendKeyEvent(Widget.java:1099) org.eclipse.swt.widgets.Widget.wmChar(Widget.java:1508) org.eclipse.swt.widgets.Control.WM_CHAR(Control.java:4268) org.eclipse.swt.widgets.Text.WM_CHAR(Text.java:2175) org.eclipse.swt.widgets.Control.windowProc(Control.java:4160) org.eclipse.swt.widgets.Text.windowProc(Text.java:2170) org.eclipse.swt.widgets.Display.windowProc(Display.java:4873) org.eclipse.swt.internal.win32.OS.DispatchMessageW(Native Method) org.eclipse.swt.internal.win32.OS.DispatchMessage(OS.java:2459) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3655) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) {code} ",5 TDQ-9284,"Always compute the group quality in tMatchGroup (mr and standard)","The group quality is not correctly computed when doing multiple passes. The chosen way to fix this issue is to always compute the group quality column. no select ""separate"" option on the 1st tMatchGroup ,select ""separate"" on the 2nd tMatchgroup. the result of GRP_QUALITY is incorrect.it doesn't consider the 1st tMatchGroup. ",8 TDQ-9287,"Export babili translations into git on master branch",NULL,2 TDQ-9291,"Let the installer add semantic indexes to ElasticSearch","How to setup the semantic repositories: # Use ElasticSearch provided in the unified platform (default installation with the installer) The main task is to provide the indexes into the ES server provided by TAC. And test that everything works fine. TAC will upgrade ES that is used in TAC. We need to sync with them. ",3 TDQ-9294,"Business rule anaysis do a redundant row count query for each Sql rule.","1. create a Business rule analysis 2. add more than one sql rule 3. run it, after finished check the error log, for each rule we have a query like-->SELECT COUNT(*) from tableName. in fact we have a row count indicator to execute this. refer to log attached. also show on 551",5 TDQ-9391,"Error occurred when finish editing connection using by a job ",NULL,3 TDQ-9297,"Set the default value of ""hide groups less than"" to 2 instead of 1","Set this value to 2 instead of 1 in the match wizard and in the match analysis editor. Most of the time, users only care about duplicates. ",3 TDQ-9300,"issue for dynamic show result of analysis","issue1 (about Dq Rule analysis). table rule analysis, add one table, 6 rules and set ""Number of connections per analysis""=2. ""Business Rules per page""=5 (set in preference) but I get the 6 rules at same time issue2 (about Column analysis). when we focus on ""Analysis Results"" page, run analysis with benford law indicator, the blue pot will lose after run finished, the can not back anymore. issue3 (about Column analysis). when create a new analysis, before run it, both table chart and pic chart all is empty,what about re-run analysis? after click run (1). Summary indicator will set value in table chart NAN,pic chart empty, Simple/Text indicator only pic chart empty, then show result from empty then dynamic show it, table chart refresh from the current existing status. (2). for [pattern]Frequency indicator, soundex indicator, benford law indicator both table chart and pic chart only do refresh--not from empty then dynamic show it. issue4 (about Column analysis). during running, benford law indicator bar chart will small and at the bottom show redundant words",8 TDQ-9320,"Fix the out of memory issue when running match analysis","Implement RecordIterator for database resultset and file delimited, use iterator instead of java collection when running the analysis in both VSR and swoosh algorithm. SKype discussion: {quote} [5:47:09 PM] Sebastiao Correia: oh, I see that VSR has also the same issue [5:47:29 PM] Sebastiao Correia: maybe, we don't need François [5:48:03 PM] 刘心泉: yes, when I test on my computer, vsr have the same issue with t-swoosh [5:49:54 PM] Mingli Zhao: There are two kind of tests till now (with Liu's help) 1. Set memory limit in studio launch configuration (-Xmx 1024), there will be out of memory issue, after analyzed with MAT, Liu summarized the place where the problem is on JIRA. this issue happens both on VSR and T-Swoosh 2. NOT setting the memory limit in studio launch configuration, it will be ""GC overhead limit exceeded"" like I wrote on JIRA. In this case the MAT cannot profile the file which is about 6 GM size . [5:50:28 PM] Sebastiao Correia: ok [5:50:43 PM] Sebastiao Correia: the error does not seem related to the algorithms here [5:50:56 PM] 刘心泉: yes, there a point need to be attention, my computer is windows it maybe different with linux(mzhao's computer) [5:51:14 PM] Sebastiao Correia: it rather seems to appear when we read the result set of a database connection [5:51:52 PM] 刘心泉: for test 1: handleRow(oneRow); [5:52:06 PM] 刘心泉: will have problem: [5:52:09 PM] Sebastiao Correia: ah yes [5:52:16 PM] Sebastiao Correia: it will store all rows in memory [5:52:24 PM] Sebastiao Correia: in dataFromTable [5:52:30 PM] 刘心泉: protected void handleRow(Object[] oneRow) throws Exception { if (storeOnDisk) { storeOnDiskHandler.handleRow(oneRow); } else { dataFromTable.add(oneRow); } } [5:52:31 PM] 刘心泉: yes [5:52:38 PM] 刘心泉: store in a List [5:54:30 PM] Mingli Zhao: yes, that's the current way we compute it. [5:55:05 PM] Mingli Zhao: maybe we can improve it by handle row by row without store it when run the analysis. [5:55:37 PM] Mingli Zhao: but we have to consider the case when ""block key"" is set. [5:56:11 PM] Sebastiao Correia: yes, I think it can be improved [5:56:48 PM] Sebastiao Correia: the component had been improved a lot some time ago in order to avoid storing everything in memory [5:56:58 PM] Sebastiao Correia: I think we should at least do the same [5:57:17 PM] Sebastiao Correia: If I remember well, Yin had worked on the component optimization [5:58:44 PM] 尹悦燕(YinYueyan.talendbj): :P the last component optimization was different with this case [6:01:08 PM] 尹悦燕(YinYueyan.talendbj): agree with zhao's suggestion [6:01:30 PM] Mingli Zhao: (note that if we want to handle it row by row, we need to refactoring the way blocking key computation done, from BlockingKeyHandler.run()) [6:02:05 PM] 尹悦燕(YinYueyan.talendbj): oh, if one block is very big... [6:02:17 PM] Mingli Zhao: we can see now the data is set once by ""setInputData(List inputData)"" in BlockingKeyHandler [6:02:36 PM] Mingli Zhao: we can handle row by row here maybe [6:02:50 PM] 尹悦燕(YinYueyan.talendbj): ;) maybe, we can try [6:03:20 PM] Mingli Zhao: then we don't need the list property dataFromTable then in SQLExecutor. [6:04:16 PM] Sebastiao Correia: François used an iterator in the t-swoosh algorithm [6:04:39 PM] Sebastiao Correia: I don't know if we can also use an iterator here... [6:04:53 PM] Sebastiao Correia: but we should avoid to have all data in a list for sure [6:05:29 PM] Mingli Zhao: Yes, in MFB: execute(Iterator sourceRecords) [6:08:48 PM] Sebastiao Correia: maybe that is too big a refactor now [6:09:30 PM] Mingli Zhao: yes, i think so. [6:09:36 PM] Sebastiao Correia: I advise to work on a branch for this issue and only push on 5.6 if we are really sure not to introduce regressions [6:11:34 PM] Sebastiao Correia: I suggest to try and find a possible solution first. Then we can decide whether we have the time to implement it. [6:12:37 PM] Mingli Zhao: ok, this is for the memory issue of 1st test. [6:12:43 PM] Mingli Zhao: about 2nd: [6:12:50 PM] Mingli Zhao: we need to find the root cause still [6:13:24 PM] Sebastiao Correia: I think the cause is the same [6:13:45 PM] Mingli Zhao: actually the ""Iterator"" itself requires the data store in memory first, no? [6:14:44 PM] Sebastiao Correia: ""GC overhead limit exceeded"" may happen when the garbage collector is trying to free memory too often. [6:15:15 PM] Sebastiao Correia: in our case, because the memory is full or almost full because of the list, the GC will try to free other objects [6:15:31 PM] Sebastiao Correia: at one point, it cannot free the memory, hence this exception [6:16:06 PM] Sebastiao Correia: in the first case, we run out of memory immediately because the GC has not even the time to try and free the memory [6:16:19 PM] Sebastiao Correia: [12:13:46 PM] Mingli Zhao: actually the ""Iterator"" itself requires the data store in memory first, no? [6:16:24 PM] Sebastiao Correia: not necessarily [6:16:46 PM] Sebastiao Correia: when you iterate over a sql.ResultSet, not all rows are loaded. [6:16:57 PM] Sebastiao Correia: they are loaded in a lazily manner [6:17:46 PM] Sebastiao Correia: here, if I understand, we have all the rows in memory. Am I right? Or do we have only one block of rows in memory? [6:18:04 PM] Sebastiao Correia: (by block, I mean a block created by the blocking key) [6:18:17 PM] Mingli Zhao: all rows in memory [6:18:52 PM] Sebastiao Correia: ok, this needs to be changed somehow [6:20:05 PM] Sebastiao Correia: when we use the store on disk option, do we have this memory issue? [6:20:50 PM] Mingli Zhao: i didn't test this case but i think it will be. [6:21:11 PM] Mingli Zhao: because the MFB algorithm accept a iterator [6:21:30 PM] Mingli Zhao: currently I use the List as the collection where iterator iterates . [6:21:50 PM] Mingli Zhao: how can we construct a java.util.Iterator in order to pass this param to MFB algorithm (not use java collection)? [6:23:10 PM] Mingli Zhao: http://docs.oracle.com/javase/1.5.0/docs/api/java/util/Iterator.html [6:23:30 PM] Mingli Zhao: it works only in the java collections framework probably [6:24:40 PM] Sebastiao Correia: RecordIterator ? [6:25:20 PM] Sebastiao Correia: François implemented his own iterator [6:25:30 PM] Sebastiao Correia: I don't know whether we could reuse it [6:26:02 PM] Sebastiao Correia: otherwise, we are now expert in MapDB ;-) that could be a way to solve it [6:26:25 PM] Sebastiao Correia: but, I recommend you to first look at what did François [6:27:38 PM] Mingli Zhao: in RecordIterator , there is a list as well: List rcdGenerators [6:29:20 PM] Mingli Zhao: ok, maybe I got a idea now to wapper the jdbc resultset into RecordIterator .... [6:29:42 PM] Mingli Zhao: when iterator iterates a row, we call resultSet.next()... [6:30:12 PM] Sebastiao Correia: yes, that could be a solution [6:30:33 PM] Sebastiao Correia: finally, don't hesitate to contact François about this. [6:30:33 PM] Mingli Zhao: this requires the interator strictly ""bound"" to the data source we profiling [6:31:05 PM] Sebastiao Correia: yes, I think this should be ok with MFB. [6:31:17 PM] Sebastiao Correia: I'm wondering whether we can simply do the same for VSR... [6:32:16 PM] Mingli Zhao: it could be [6:33:16 PM] Mingli Zhao: ok, let me summarize the discussion tomorrow on JIRA for this performance issue. [6:33:26 PM] Mingli Zhao: but we may have no enough time to accomplish it in M4. [6:33:49 PM] Sebastiao Correia: ok [6:34:16 PM] Sebastiao Correia: don't start big changes now. Let's see if we can first find a good solution {quote}",5 TDQ-9322,"items not be divide into groups correctly",NULL,5 TDQ-9344,"ERROR org.talend.core.model.metadata.DBConnectionFillerImpl","java.sql.SQLException: Invalid argument: unknown column name REMARKS org.talend.commons.utils.database.AS400ResultSet.getString(Unknown Source) org.talend.core.model.metadata.DBConnectionFillerImpl.fillTables(Unknown Source) org.talend.core.model.metadata.MetadataFillFactory.fillTables(Unknown Source) org.talend.core.model.metadata.builder.database.DqRepositoryViewService.loadTables(Unknown Source) org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getTables(Unknown Source) org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getTables(Unknown Source) org.talend.dq.nodes.DBTableFolderRepNode.createRepositoryNodeTableFolderNode(Unknown Source) org.talend.dq.nodes.DBTableFolderRepNode.getChildren(Unknown Source) org.talend.dataprofiler.core.ui.views.provider.ResourceViewContentProvider.getRepositoryNodeChildren(Unknown Source) org.talend.dataprofiler.core.ui.views.provider.ResourceViewContentProvider.getChildren(Unknown Source) org.eclipse.ui.internal.navigator.extensions.SafeDelegateTreeContentProvider.getChildren(SafeDelegateTreeContentProvider.java:96) org.eclipse.ui.internal.navigator.extensions.SafeDelegateTreeContentProvider.getChildren(SafeDelegateTreeContentProvider.java:275) org.eclipse.ui.internal.navigator.extensions.SafeDelegateTreeContentProvider.getChildren(SafeDelegateTreeContentProvider.java:94) org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider$1.run(NavigatorContentServiceContentProvider.java:150) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.internalGetChildren(NavigatorContentServiceContentProvider.java:137) org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.getChildren(NavigatorContentServiceContentProvider.java:123) org.eclipse.jface.viewers.AbstractTreeViewer.getRawChildren(AbstractTreeViewer.java:1348) org.eclipse.jface.viewers.TreeViewer.getRawChildren(TreeViewer.java:391) org.eclipse.jface.viewers.StructuredViewer.getFilteredChildren(StructuredViewer.java:896) org.eclipse.jface.viewers.AbstractTreeViewer.getSortedChildren(AbstractTreeViewer.java:601) org.eclipse.jface.viewers.AbstractTreeViewer$1.run(AbstractTreeViewer.java:799) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:778) org.eclipse.jface.viewers.TreeViewer.createChildren(TreeViewer.java:644) org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:749) org.eclipse.jface.viewers.AbstractTreeViewer.handleTreeExpand(AbstractTreeViewer.java:1444) org.eclipse.jface.viewers.TreeViewer.handleTreeExpand(TreeViewer.java:952) org.eclipse.jface.viewers.AbstractTreeViewer$4.treeExpanded(AbstractTreeViewer.java:1455) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:132) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) org.eclipse.swt.widgets.Tree.wmNotifyChild(Tree.java:7408) org.eclipse.swt.widgets.Control.wmNotify(Control.java:5096) org.eclipse.swt.widgets.Composite.wmNotify(Composite.java:1887) org.eclipse.swt.widgets.Control.WM_NOTIFY(Control.java:4726) org.eclipse.swt.widgets.Control.windowProc(Control.java:4215) org.eclipse.swt.widgets.Display.windowProc(Display.java:4873) org.eclipse.swt.internal.win32.OS.CallWindowProcW(Native Method) org.eclipse.swt.internal.win32.OS.CallWindowProc(OS.java:2362) org.eclipse.swt.widgets.Tree.callWindowProc(Tree.java:1536) org.eclipse.swt.widgets.Control.windowProc(Control.java:4251) org.eclipse.swt.widgets.Tree.windowProc(Tree.java:5844) org.eclipse.swt.widgets.Display.windowProc(Display.java:4873) org.eclipse.swt.internal.win32.OS.DispatchMessageW(Native Method) org.eclipse.swt.internal.win32.OS.DispatchMessage(OS.java:2459) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3655) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) ",3 TDQ-9355,"report can not run when use oracle 12 as datamart( except report with column analysis)","1. create a report, add some analysis, 2. set report as oracle 12 datamart(sid or service name) 3. try to run report. Actual Result: report generate failed note: only report with column analysis can run well. Expected Result: report with any kind of analysis should works {code} 2014-08-20 14:59:52,161 ERROR org.talend.dq.persistence.handlertype.AbstractPersistenceHandler - Could not get the date row corresponding to 8/20/14 6:59 AM. Check that the calendar table is correctly filled with data. org.hibernate.PropertyValueException: not-null property references a null or transient value: org.talend.dataprofiler.datamart.hibernate.TdqMatchIndValue.tdqDayTime at org.hibernate.engine.Nullability.checkNullability(Nullability.java:72) at org.hibernate.event.def.AbstractSaveEventListener.performSaveOrReplicate(AbstractSaveEventListener.java:284) at org.hibernate.event.def.AbstractSaveEventListener.performSave(AbstractSaveEventListener.java:180) at org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:121) at org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:186) at org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:175) at org.hibernate.event.def.DefaultSaveOrUpdateEventListener.performSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:98) at org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:70) at org.hibernate.impl.SessionImpl.fireSaveOrUpdate(SessionImpl.java:507) at org.hibernate.impl.SessionImpl.saveOrUpdate(SessionImpl.java:499) at org.hibernate.engine.CascadingAction$1.cascade(CascadingAction.java:218) at org.hibernate.engine.Cascade.cascadeToOne(Cascade.java:268) at org.hibernate.engine.Cascade.cascadeAssociation(Cascade.java:216) at org.hibernate.engine.Cascade.cascadeProperty(Cascade.java:169) at org.hibernate.engine.Cascade.cascade(Cascade.java:130) at org.hibernate.event.def.AbstractSaveEventListener.cascadeBeforeSave(AbstractSaveEventListener.java:412) at org.hibernate.event.def.AbstractSaveEventListener.performSaveOrReplicate(AbstractSaveEventListener.java:261) at org.hibernate.event.def.AbstractSaveEventListener.performSave(AbstractSaveEventListener.java:180) at org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:121) at org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:186) at org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:33) at org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:175) at org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:27) at org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:70) at org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:535) at org.hibernate.impl.SessionImpl.save(SessionImpl.java:523) at org.hibernate.impl.SessionImpl.save(SessionImpl.java:519) at org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:140) at org.talend.dataquality.reporting.engine.ReportDocGenerator.historizeData(ReportDocGenerator.java:494) at org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:269) at org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generate(LocalReportDocGenerator.java:130) at org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$2.run(GenerateReportFileAction.java:334) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) {code}",8 TDQ-9357,"when download jdbc dirver get an error in error log","issue 1 1. try to create a mysql connection on TOP 2. when click ""check"" on the wizard, get the jdbc driver download dialog popup, and get an error in error log. Expected Result: should not get any error Actual Result: when jdbc driver download dialog popup, also get an error. issue 2 on this build, when create analysis, not need to download any jars(except glazedlists_java15-1.9.0.jar), but for earlier build should to download jcommon-1.0.15.jar, jfreechart-1.0.12.jar and several others. error for issue1 {code} java.io.FileNotFoundException: F:\560\TOS_DQ-20140820_1932-V5.6.0SNAP_a\configuration\librariesIndex.xml (The system cannot find the file specified) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.(FileInputStream.java:146) at org.eclipse.emf.ecore.resource.impl.FileURIHandlerImpl.createInputStream(FileURIHandlerImpl.java:105) at org.eclipse.emf.ecore.resource.impl.ExtensibleURIConverterImpl.createInputStream(ExtensibleURIConverterImpl.java:301) at org.eclipse.emf.ecore.resource.impl.ResourceImpl.load(ResourceImpl.java:1254) at org.talend.librariesmanager.model.service.LibrariesIndexManager.loadResource(Unknown Source) at org.talend.librariesmanager.model.service.LocalLibraryManager.retrieve(Unknown Source) at org.talend.librariesmanager.model.service.LocalLibraryManager.retrieve(Unknown Source) at org.talend.librariesmanager.model.service.LocalLibraryManager.retrieve(Unknown Source) at org.talend.core.model.metadata.builder.database.ExtractMetaDataUtils.connect(Unknown Source) at org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.createConnection(Unknown Source) at org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.createConnection(Unknown Source) at org.talend.core.model.metadata.builder.util.MetadataConnectionUtils.createConnection(Unknown Source) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.isSchemaHasChildren(Unknown Source) at org.talend.dq.nodes.DBViewFolderRepNode.hasChildrenInDataBase(Unknown Source) at org.talend.dq.nodes.DBViewFolderRepNode.hasChildren(Unknown Source) at org.talend.dataprofiler.core.ui.views.provider.ResourceViewContentProvider.hasChildren(Unknown Source) at org.eclipse.ui.internal.navigator.extensions.SafeDelegateTreeContentProvider.hasChildren(SafeDelegateTreeContentProvider.java:110) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.callNormalHasChildren(NavigatorContentServiceContentProvider.java:428) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.access$4(NavigatorContentServiceContentProvider.java:423) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider$3.run(NavigatorContentServiceContentProvider.java:393) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.hasChildren(NavigatorContentServiceContentProvider.java:379) at org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.hasChildren(NavigatorContentServiceContentProvider.java:420) at org.eclipse.jface.viewers.AbstractTreeViewer.isExpandable(AbstractTreeViewer.java:2082) at org.eclipse.jface.viewers.TreeViewer.isExpandable(TreeViewer.java:588) at org.eclipse.jface.viewers.AbstractTreeViewer.isExpandable(AbstractTreeViewer.java:2112) at org.eclipse.jface.viewers.AbstractTreeViewer.updatePlus(AbstractTreeViewer.java:2794) at org.eclipse.jface.viewers.TreeViewer.updatePlus(TreeViewer.java:852) at org.eclipse.jface.viewers.AbstractTreeViewer.createTreeItem(AbstractTreeViewer.java:830) at org.eclipse.jface.viewers.AbstractTreeViewer$1.run(AbstractTreeViewer.java:804) at org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) at org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:778) at org.eclipse.jface.viewers.TreeViewer.createChildren(TreeViewer.java:644) at org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:749) at org.eclipse.jface.viewers.AbstractTreeViewer.handleTreeExpand(AbstractTreeViewer.java:1444) at org.eclipse.jface.viewers.TreeViewer.handleTreeExpand(TreeViewer.java:952) at org.eclipse.jface.viewers.AbstractTreeViewer$4.treeExpanded(AbstractTreeViewer.java:1455) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:132) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) at org.eclipse.swt.widgets.Tree.wmNotifyChild(Tree.java:7408) at org.eclipse.swt.widgets.Control.wmNotify(Control.java:5096) at org.eclipse.swt.widgets.Composite.wmNotify(Composite.java:1887) at org.eclipse.swt.widgets.Control.WM_NOTIFY(Control.java:4726) at org.eclipse.swt.widgets.Control.windowProc(Control.java:4215) at org.eclipse.swt.widgets.Display.windowProc(Display.java:4873) at org.eclipse.swt.internal.win32.OS.CallWindowProcW(Native Method) at org.eclipse.swt.internal.win32.OS.CallWindowProc(OS.java:2362) at org.eclipse.swt.widgets.Tree.callWindowProc(Tree.java:1536) at org.eclipse.swt.widgets.Tree.WM_LBUTTONDOWN(Tree.java:6303) at org.eclipse.swt.widgets.Control.windowProc(Control.java:4195) at org.eclipse.swt.widgets.Tree.windowProc(Tree.java:5844) at org.eclipse.swt.widgets.Display.windowProc(Display.java:4886) at org.eclipse.swt.internal.win32.OS.DispatchMessageW(Native Method) at org.eclipse.swt.internal.win32.OS.DispatchMessage(OS.java:2459) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3655) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.dataprofiler.rcp.intro.Application.start(Unknown Source) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) {code}",3 TDQ-9360,"Build file org.talend.dataprofiler.persistence/build_datamart.xml refers to SVN location","The build file org.talend.dataprofiler.persistence/build_datamart.xml refers to relative paths based on SVN, such as: See: https://github.com/Talend/tdq-studio-ee/blob/7d40de3ac4e194535c71139cb7831579a1c37ee7/main/plugins/org.talend.dataprofiler.persistence/build_datamart.xml These need to be updated to be able built based on Git. I believe the relative paths should actually just be ""../"", as is the case in org.talend.dataprofiler.datamart/build_datamart_init.xml.",2 TDQ-9364,"no ""Generate job"" selection for dq rule analysis when db is ""oracle service name"" and ""oracle oci""","1. create a dq rule analysis about ""oracle service name"" or ""oracle oci"" connection. 2. run it. 3. turn to result page, try to generate a job about the rule Expected Result: should get this menu Actual Result: no this menu.",5 TDQ-9365,"remove duplidate job and pattern ETL job can not transfer DB type when connection is oracle service name","issue1: 1. create an ""oracle service name"" connection, create a column analysis about it, 2. add simple indicator, add a pattern, run 3. turn to result page, try to generate Remove Duplicate job. and on Pattern try to generate get Valid/Invalid rows job Expected Result: job should get correct db information Actual Result: for Remove duplicate job, the output can not get correct db type. for pattern Valid/Invalid row job, for input component can not get correct db type Issue 2: about issue1, when db is ""oracle oci"" remove duplicate job and pattern's job can not generated {code} ERROR org.talend.datacleansing.core.ui.actions.IndicatorJobAction - UnSupport Database Component Exception java.lang.NullPointerException org.talend.datacleansing.core.ui.jobs.template.ADatabaseJobAction.extractDBProductInfo(ADatabaseJobAction.java:70) org.talend.datacleansing.core.ui.actions.IndicatorJobAction.(IndicatorJobAction.java:86) org.talend.datacleansing.core.ui.actions.pattern.PatternIndicatorJobAction.(PatternIndicatorJobAction.java:44) org.talend.datacleansing.core.ui.actions.pattern.PatternRowsJobAction.(PatternRowsJobAction.java:50) org.talend.datacleansing.core.ui.actions.ui.pattern.PatternJobSelectWizardPage.getJobAction(PatternJobSelectWizardPage.java:128) org.talend.datacleansing.core.ui.actions.ui.pattern.PatternJobSelectWizard.performFinish(PatternJobSelectWizard.java:62) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:811) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:430) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.jface.window.Window.runEventLoop(Window.java:825) org.eclipse.jface.window.Window.open(Window.java:801) org.talend.datacleansing.core.ui.service.DatabaseJobService.createJobActon(DatabaseJobService.java:97) org.talend.datacleansing.core.ui.service.DatabaseJobService.executeJob(DatabaseJobService.java:77) org.talend.dataprofiler.core.ui.editor.preview.model.ChartTableFactory$1.widgetSelected(ChartTableFactory.java:158) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) org.talend.rcp.intro.Application.start(Application.java:155) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) org.eclipse.equinox.launcher.Main.run(Main.java:1407) {code}",5 TDQ-9846,"Use Existing Connection option of tMatchGroupHadoop component is not working","I've created a HDFS connection using tHDFSConnection and use it in tMatchGroupHadoop, it's not working out.",5 TDQ-9367,"in mr job, two tMatchGroup both checked ""Sort the output data by GID"", job can not run finished.","1. create a mr job, add component like: input+tGenkey+tMatchGroup+tMatchGroup + output. configure tGenkey and two tMatchGroup(set matching key, and first tMatchGroup set blocking key T_GEN_KEY) for the two tMatchGroup both checked ""Sort the output data by GID"". Actual Result: job can not run. Expected Result: job should run correctly, no matter check sort function or not. {code} java.lang.IllegalArgumentException: The Mapper output key class does not match the previous Mapper input key class org.talend.hadoop.mapred.lib.Chain.addMapper(Chain.java:195) org.talend.hadoop.mapred.lib.ChainMapper.addMapper(ChainMapper.java:45) test1.copy_of_mr_1_0_1.Copy_of_mr_1$2.run(Copy_of_mr_1.java:13649) test1.copy_of_mr_1_0_1.Copy_of_mr_1$2.run(Copy_of_mr_1.java:1) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:415) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136) test1.copy_of_mr_1_0_1.Copy_of_mr_1.tMRInput_tSortRowAfter_tMatchGroup_10Process(Copy_of_mr_1.java:13596) test1.copy_of_mr_1_0_1.Copy_of_mr_1.tJDBCInput_1Process(Copy_of_mr_1.java:5565) test1.copy_of_mr_1_0_1.Copy_of_mr_1.run(Copy_of_mr_1.java:25142) org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) test1.copy_of_mr_1_0_1.Copy_of_mr_1.runJobInTOS(Copy_of_mr_1.java:25117) test1.copy_of_mr_1_0_1.Copy_of_mr_1.main(Copy_of_mr_1.java:25103) {code}",5 TDQ-9847,"tMatchGroupHadoop component is throwing an error when using with Hive2 - Different versions of sl4j-log4j jar","In Talend studio, configure tHiveInput component with hive2 in Standalone mode. add tMatchgroupHadoop component to the job and configure it to Cloudera CHD4.X MR1 mode. While running the job it is throwing below error SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/H:/TalendWrkSpc_Ravi/.Java/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/H:/TalendWrkSpc_Ravi/.Java/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. Exception in thread ""main"" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.addDeprecations([Lorg/apache/hadoop/conf/Configuration$DeprecationDelta;)V each component is loading different versions of slf4j-log4j jar. ",5 TDQ-9373,"Create version 5.6.0M4 in Babili and populate it",NULL,2 TDQ-9382,"create a mysql connection, can not get catalogs directly, need to reload it.","1. create a mysql connection, set parameters, 2. click ""check"" on the wizard, pop up download mysql driver dialog, download it. 3. mysql connection created successfully, but can not get catalogs Expected Result: get structure successfully. Actual Result: can not get catalogs, and get error in error log. NOTE: reload database list can show the catalog Before reload , check detail view, type: mysql, it is correct. error: ERROR org.talend.cwm.management.api.SoftwareSystemManager - null database type:mysqldb_1",3 TDQ-9388,"in report doc Percentage value in table for benford law different with other indicator's formart ","1. create a column analysis, add benford law indicator. 2. create a report with the analysis. 3. generate report file, check the generated doc. Actual Result: Percentage value is different with other indicator values' format Expected Result: should show with same format NOTE: same with 551",1 TDQ-9392,"Rename the tCloudAddressRow component to tAddressRowCloud","Due to naming restrictions (tCloud* is reserved for iPaaS components), we must rename this component. ",1 TDQ-9394,"Manage deprecation of old version of EMF Compare","Remove the use of EMF compare. Replace the reload function with a home made function that compares the structures and handles the deletion of items used in analyses. # implement a comparison function that compares two lists of DQ items (Catalogs, tables, or columns). This gives some differences between the two input lists. # implement a way to copy the differences from one list (remote items) to the other list (local items) # implement a UI on top of the previous function. When the output differences are not empty, we can display them. And that can also apply the copy. ",3 TDQ-9405,"improve about MapDB mode","1.The folder ""Work_MapDB"" should be start by ""."" 2.sourceforge.sqlexplor plugin don't should contain ""MapDB"" libraries,try to move the wizard to ""common.ui"" plugin. 3.CsvExportOptionsDlg need to change group name. 4.ColumnSetIndicatorEvaluator.handleObjects method is very long should try to extract method for different if clause. 5.same to issue 4 executeSqlQuery method is too long. 6.From ColumnSetResultPage and DrillDownEditor class extract pagination Table. 7.TupleArray class is not useful again. 8.IndicatorImpl.saveTempDataToFile should change to useMapDBMode. 9.ColumnSetMultiValueIndicatorImpl.ConvertToStringArray should be remove. 10.FrequencyIndicatorImpl add commont on this class for some new method. 11.IndicatorImpl.getMapDB method can extract same part. 12.Write junit for Soundex.handle method and refactor this method make it more clear. 13.Try to change folder name to UUID",20 TDQ-9415,"issues about import rule in match analysis and some other improvements for match analysis.","issue1, if a vsr/t-swoosh match analysis import a t-swoosh/vsr rule, analysis will turn to t-swoosh/vsr type we'd better can not import the rule or give some warning if rule type is different with analysis. issue2, on the import dialog, it is not case sensitive, but in analysis editor, it is case sensitive, refer to pic. issue3, when import a t-swoosh rule, if analysis has exist same ""Match Key Name"" key, we will get inform information, if import a vsr rule, we can not get it. issue 4(from TDQ-9270), open preference page, click Talend->Profiling->Editor, on the right pane click ""Hide graphics in analysis result page"". back to match analysis editor, run it, on result page, pic chart still there. issue 5 (from TDQ-9270) in the ""Match and Survivor"" section, select varchar type column as ""Input column"", select ""Largest (for numbers)"" as ""Function"", click ""chart"" button, no atction, just get error in error log, should we pop up an error dialog? {code} java.lang.NumberFormatException at java.math.BigDecimal.(Unknown Source) at java.math.BigDecimal.(Unknown Source) at org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.parseNumberValue(MFBRecordMerger.java:208) at org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.createMergeValue(MFBRecordMerger.java:121) at org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.merge(MFBRecordMerger.java:62) {code} ",3 TDQ-9423,"Export babili translations into git on master branch",NULL,2 TDQ-9438,"Handle the closure of mapDB when running the analysis and drilling down.","In the preference , create a page for mapDB parameter settings.",20 TDQ-9453,"Can't import because 'check item conflict failed'","Customer try to import the old project from v5.3.1 to v5.5.1, firstly, he import the DI's items, when he try to import DQ's items, he got 'check item conflict failed' warning even ticked the 'Overwrite' option, this block the import process and customer can't import DQ items into the new project.",3 TDQ-9459,"Create version 5.6.0RC1 in Babili and populate it",NULL,2 TDQ-9484,"remove MapDBDrillDown and DataValidation interface from indicator class",NULL,8 TDQ-9485,"Remove % symbol from i18n","The property key MatchAnalysisConstant.Percentage should be deleted. No need to translate the ""%"" symbol",3 TDQ-9489,"Export babili translations into git on 5.6 and master branches",NULL,2 TDQ-9495,"TOP：Import Item:Able to detect report and do import action","1.Logon TOP build ,try to import a Report item (able to use data from attachment) 2.able to detect the import items and ""finish"" button is available 3.Click finish button Actual Result: no item import in studio , there is an error log {noformat} 2014-09-25 11:11:53,565 ERROR org.talend.dq.helper.SqlExplorerUtils - Missing the plugin net.sourceforge.sqlexplorer! {noformat} Expect Result: TOP not support report , maybe give user some friendly info when try to import report",1 TDQ-9498,"out of memory issue in column analysis with Java engine","got gc overhead limit exceeded when running a column analysis on 30 columns with 500 000 rows. Used java engine. Allowed drill down with no limit. Then I'm asked to restart the studio. ",13 TDQ-9525,"Handle the exception when studio is closed abnormally","1.Here should have a error log to record the issue. 2.When restart the stdio if find out some mapDB is not close Then delete old mapDb file.",5 TDQ-9526,"job tdqReportRun use mysql as the datamart will get exception",NULL,5 TDQ-9561,"User customisable input / output schemas for tQASBatchAddressRow","At the current time, the tQASBatchAddressRow component is hard coded to a single input column (Address) and a fixed output schema, determined by the country selected. This means that the component needs to be manually altered in the tQASBatchAddressRow_java.xml to match the customers desired output from QAS, with all the support issues that implies. It would be much better if the component worked like tLoqateAddressRow, with customizable input / output schemas. The output of QAS is positional, so we should not hard code in any column names at all. TODO: Have the same UI as tLoqateAddressRow for the standard settings. No Advanced settings. ",8 TDQ-9571,"code refactor:Remove some unuseful classes and functions","After some code refactor,there are some functions are deprecated. 1.Currently,we reuse DI code to create database.we could remove these unuseful classes: - org.talend.dataprofiler.core.ui.wizard.database.DatabaseConnectionWizard - org.talend.dataprofiler.core.ui.wizard.database.DatabaseMetadataWizardPage - org.talend.dataprofiler.core.ui.wizard.database.DatabaseWizardPage 2. in org.talend.cwm.db.connection.ConnectionUtils.java,we can remove these functions: - existTable(String url, String driver, Properties props, String tableName, String schema);(it is't called) - checkConnection(String url, String driverClassName, Properties props) - createConnection(String url, String driverClassName, Properties props) - createConnectionWithTimeout(Driver driver, String url, Properties props) - getClassDriverFromSQLExplorer(String driverClassName, Properties props) There isn't any palce call them: - fillConnectionInformation(List conns) - fillDbConnectionInformation(DatabaseConnection dbConn) - fillAttributeBetweenConnection(Connection target, Connection source) 3.in plugin net.sourceforge.sqlexplorer - SqlExplorerUtils.getClassDriverFromSQLExplorer(String driverClassName, Properties props) - ISqlexplorerService.getClassDriverFromSQLExplorer(String driverClassName, Properties props) - SqlexplorerService.getClassDriverFromSQLExplorer(String driverClassName, Properties props) - SqlexplorerService.loadDriverByLibManageSystem(String dbType, String dbVersion, String driverClassName) ",5 TDQ-9578,"Add support of new databases for the data mart and the DQ portal - Part 1","This implies: # adapt the jasper reports # adapt the hibernate configuration # adapt the database creation and initialisation script # adapt the data mart API # adapt the installer (new pages) # adapt the reports in DQ portal # adapt QBE in DQ portal # tests the other DQ portal features The requirements are, in this order of priority: - Align with the database versions for the databases we already support (confirm that they are fully supported): -- MySQL 5.6 -- Oracle 12 See also DOCT-3867",20 TDQ-9586,"Create version 5.6.0 in Babili and populate it",NULL,2 TDQ-9588,"Export babili translations into git on 5.6 and master branches",NULL,2 TDQ-9598,"Support Java 8",NULL,5 TDQ-9605,"Simplify HDFS file Profiling with Hive - step 1","Aim: The user should be able to run an analysis on an HDFS file. When the user can create a Hive connection when he selects an HDFS file to profile. See subtask for the DDL statement to create a hive table over a file.",20 TDQ-9607,"Use smart sampling in the match analysis","Add an option to choose how to extract the sample of the data. this option is either: # n first rows # n random rows # x percent of rows (maybe look at the tSampleRow component implementation) # n last rows Use the reservoir sampling algorithm to select 10 000 rows. This can be done with the *java engine*. The sampling methods must be packaged in an API that will be reused at different places in the DQ project. -For the *SQL engine*, only the first two options will be available : top n rows, bottom n rows.- In column analysis, we extract a sample of data to display them, but we don't apply any indicator on this data sample. There is no need to distinguish between java and sql engine here. The analysis execution is always done on the full data set. The other analysis (column analysis...) that display the data also need this same feature. ",13 TDQ-9617,"need DQ support for MS SQL Server to match MySQL &/or Oracle","Partner needs DQ support for MS SQL Server to be as mature as that for MySQL and/or Oracle, e.g., there are tMySqlInvalidRow and tOracleInvalidRow components but no tMSSQLServerInvalidRow component. activate related menus that generate jobs with these components (business rule analysis).",5 TDQ-9622,"Remove org.talend.rcp.branding.top plugin if possible","We currently use org.talend.dataprofiler.rcp to launch TOS_DQ, This plugin is not really useful.",1 TDQ-9626,"Change null verification level to be Unverified when the address provider is google.","The verification level for Google provider is not correct when set address to be AAABBBCCCAAAAAAAAAAAAAAA, the status is ZERO_RESULTS.the verification level is NULL.",3 TDQ-9650,"vsr match analysis import vsr match rule, when same name items exist, can not get correct inform message.",NULL,1 TDQ-9663,"Allow scroll down and copy/paste of the error in tmatchgroup","enable scroll down and copy/paste of the java error in tmatchgroup to reproduce the error, see below: -created a job with multiple matchgroups (see attached job) -used the replicate component to duplicate the flow and show the difference in the results when we use one matchgroup and two matchgroups -the jobs runs correctly -but when i double-click the first tmatchgroup in the upper part of the job, i got an error message (see attached). The matchgroup configuration wizard opens, but when i click ""chart"", i got the same error.",1 TDQ-9714,"wrong column header for column correlation results","When running SOME column correlation analyses, on Results tab, under Data section, column headers in table are sometimes incorrect.",3 TDQ-9716,"remove init**Map or init**Set in DistinctCount Duplicate and unique indicator","DistinctCount Duplicate and unique indicator contain some init method which has exist on the indicatorImpl, the different is we need to support old hashMap or hashSet in those indicator.Should remove those method and instead of it with super one.",5 TDQ-9725,"Selection of Indicators does not display well with large fonts","I use large fonts (150%) with a screen resolution of 1920x1080. This helps prospects see/read my screen over WebEx and on Projectors (well, the resolution often has to go down for projectors so I have my own no instead!) Is it possible to render the selection grid based on the system font size?",5 TDQ-9730,"No value shows for UDI frequency in the generated document after run report.",NULL,1 TDQ-9736,"Automatically create the data mart database from the installer","Once issue often happens that people don't create the talend_dq database before they run the installer. Therefore, when they configure the datamart, they got an error message. In order to avoid that, we will now create the datamart (if it does not exist) within the datamart.init API. ",8 TDQ-9742,"Create version 5.6.1 in Babili and populate it",NULL,2 TDQ-9750,"Remove unused feature org.talend.rcp.branding.tdqsa-feature","The org.talend.rcp.branding.tdqsa-feature has the same id as the feature org.talend.rcp.branding.tdq-feature. If tdqsa is no longer being used, it should be removed, otherwise it needs to be renamed as it interferes with the Tycho build migration.",1 TDQ-9757,"match analysis with special operations, ""chart"" result in table chart and pic chart are different.","1. create a match analysis set vsr algorithm, set matching key 2. click ""chart"" in ""Matching key"" section, 3. change the value for ""hide groups less than"" to ""3"" 4. both table chart and pic chart result show correctly. 5. change algorithm to ""t-swoosh"", the ""hide groups less than"" value also change to 2 automatic. 6. save analysis, click ""chart"" under ""Match and survivor"" section. 7. check the Result and pic chart, they are different. on table chart show the result of group size less than 3 but not 2. Expected Result: both table chart and pic chart can show correctly. Actual Result: only pic chart show result correctly. ",1 TDQ-9764,"Export babili translations into git on 5.6",NULL,2 TDQ-9780,"import Survivorship Rules, ""Rules Management"" can not show node name correctly--no function affected","1. in DI perspective import the zip file AccountDedupe_tRuleSurvivorship.zip 2. open the imported job ""AccountDedupe_tRuleSurvivorship"", focus on the ""Component"" tab of ""tRuleSurvivorship"" click ""Generate rules and survivorship flow "" then on the Repository Metadata->Rules Management->Survivorship Rules, we get a folder named ""AccountDedupe"". 3. export(by click ""Export Items"") the job and file generated on step 2. 4. delete the job and file generated on step 2. 5. import (by click ""Import Items"") the file exported on step 3 Actual Result: on the step 5, the import dialog can not show the node name correctly. NOTE: no function affected. Expected Result: should show the name node correctly. ",2 TDQ-9784,"Add support to Melissadata in tBatchAddressRowCloud","Information about Melissadata WS is available at http://wiki.melissadata.com/index.php?title=Global_Address_Verification See also http://wiki.melissadata.com/index.php?title=Global_Address_Verification%3AGetting_Started and the best practices http://wiki.melissadata.com/index.php?title=Web_Service%3ABest_Practices For documentation purpose, information is available about address verification codes at http://wiki.melissadata.com/index.php?title=Global_Address_Verification%3AFAQ The global Reference guide is at http://wiki.melissadata.com/images/8/8e/DQT_WS_Global_RG.pdf Result codes: http://wiki.melissadata.com/index.php?title=Returned_Result_Codes%3AWeb_Services#Global_Address_Verification A sample of Java code with xml is at ftp://ftp.melissadata.com/SampleCodes/Current/DQWS3/International/International_XML_Java.zip Some code from the first Address API that we developed can probably be reused because the json returned by the batch API is a list of json objects (records) that have the same structure as for the transactional API (one record). ",3 TDQ-9788,"Email validation component - Step 1","What is an email: http://en.wikipedia.org/wiki/Email_address Create an API and a component called *tVerifyEmail* under Data_Quality By default, this component will check a generic email regex: {noformat}""^\s*(([^\s\p{Cntrl}\(\)<>@,;:'\\\""\.\[\]]|')+|(""[^""]*""))(\.(([^\s\p{Cntrl}\(\)<>@,;:'\\\""\.\[\]]|')+|(""[^""]*"")))*$"" {noformat} In the advanced setting, this regex can be edited. Parameters in the component will help the user to specify further the email format. The user will be able to specify the local part (string before the '@' sign). Either by writting a simplified expression such as - w that means there is a word - a.a that means ""letter\.letter"" - a.w that means ""letter\.letter+"" - 1.w that means a digit followed by dot followed by a word. - w1.w means word followed by one digit followed by dot followed by a word - wN means word followed by a numeric - w[-_]w means word followed by either - or _ then word - a* means any number of characters after a letter. An option (checkbox) enables the user to decide whether the local part can be case sensitive or not (the domain part is never case sensitive). When this option is checked, then we must distinguish between ""Aw"" which means one word starting with an upper case and ""aw"" which is equivalent to ""w"" and means a word in lower case. the user must be able to define a list of valid domains or a list of invalid domains (he can't define both at the same time). The domain is the string after the '@' sign. A black list is the list of all domains that are not valid: every email with a domain from the blacklist must be invalid In the case of blacklist, when the TLD is invalid, then no need to check other conditions, the email is invalid A white list is the list of all acceptable domains: every email with a domain NOT in the list is invalid In the case of the whitelist, there is no need to check the TLD (it's up to the user to provide the correct domain part of the email) Optionally, this component will reuse code from the email UDI to check the email via socket queries. Think about the reusability of the API in some Java DQ indicator (later). _(it has been suggested to reuse the same syntax as the one used in tStandardizeRow, but it's more readable to have something like aw than LETTER WORD and it's clear that there is no space in aw whereas it's not so clear in ""LETTER WORD"". Therefore, I suggest we keep the above syntax or a similar one. )_ In this first step, the output schema will have only one fixed columns: ""VERIFICATION"" The content of the VERIFICATION column can be: - verified (meaning that the email complies to the given rules) - invalid (meaning that the email does not comply to the rules) See some existing code at http://leshazlewood.com/2006/11/06/emailaddress-java-class/ http://commons.apache.org/proper/commons-validator/apidocs/org/apache/commons/validator/routines/EmailValidator.html These codes may have performance issues or other problems that the TLD list is not complete. We should provide an option for the user to choose whether the algorithm must validate TLD names or not. Or maybe, we need to allow the user to add his own valid TLD names. See https://data.iana.org/TLD/tlds-alpha-by-domain.txt ",40 TDQ-9810,"The ""org.talend.dataquality.reporting.JasperReportBuilder - java.util.Date cannot be cast to java.sql.Timestamp""error shows after run tDqReportRun job with Pivotal HD2.","1.Start studio and create Pivotal db connection. 2.Create column analysis and report with analysis. 3.Select Launch a report by right clicking report. 4.Run job. Expected result: The document should be generated, no error shows for job. Actual result: The error shows. see attachment. ",5 TDQ-9819,"Email validation component - Step 2","This is step 2 of the email validation component. The user will be able to specify the local part (string before the '@' sign) by writing an expression built from other columns of the schema such as - first character of firstname - n first characters of - n last characters - all characters of lastname - pick n first characters and m last characters of the column (2 parameters here: n and m) The output schema will have two fixed columns: ""VERIFICATION"", SUGGESTED_EMAIL. The content of the VERIFICATION column can be: - verified (meaning that the email complies to the given rules) - corrected (meaning that the email has been corrected) - invalid (meaning that the email does not comply to the rules) The email can be corrected when some rules are defined from other columns, such as first character of column Firstname and all characters of column LastName. The email formed by these rules will be output in the SUGGESTED_EMAIL column. We should also think about a way to refresh the TLD list from https://data.iana.org/TLD/tlds-alpha-by-domain.txt ",20 TDQ-9820,"Add support of new databases for the data mart and the DQ portal - Part 2","This implies: # adapt the jasper reports # adapt the hibernate configuration # adapt the database creation and initialisation script # adapt the data mart API # adapt the installer (new pages) # adapt the reports in DQ portal # adapt QBE in DQ portal # tests the other DQ portal features The requirements are, in this order of priority: - Cover the missing databases we keep getting demands for which are, by order of priority: -- SQL Server --> version 2012 -- PostgreSQL --> version 9.3 If time allows, check with the other databases we support in the UP for consistency. For instance TAC will also support MariaDB. See also DOCT-3867",13 TDQ-9838,"problems about Eclipse 4.4 migration and change to Maven",NULL,3 TDQ-9840,"Support for ""multi-level"" jdbc schemas, such as denodo","In denodo it's possible to have the following type of format: database.schema.tablename In DI, with generic JDBC it generates statements such as: select * from database.tablename; While in DQ it's generating things such as: select count(*) from database.shema.tablename; The first is correct, while the second throws the error: ""Select count(*) from database.schema.tablename; is an invalid statement."" We should change the behavior of DQ to mirror DI's behavior, or provide an option to do so. ",13 TDQ-9845,"""pattern frequency indicator"" result for db2 connection varchar type column have some redudant character.","1. create a db2connection, create a column analysis about the connection, add a varchar type column 2. add Pattern Frequency indicator to this column. 3. run it. 4. turn to analysis result page check the result, there are some redundant character. Expected Result: should show the result correctly.",1 TDQ-9872,"Change the column analysis editor to display the data - Step 2","See attached Mockup.",8 TDQ-9874,"Port tBatchAddressRowCloud to 5.6","As this component is required by TIC, we must port it to the 5.6 branch. ",5 TDQ-9894,"Improvements of the tBatchAddressRowCloud component","See subtasks",8 TDQ-9896,"Download net.sourceforge.sqlexplorer.nl after installation","In the p2 build, including the NL fragment net.sourceforge.sqlexplorer.nl in org.talend.top.feature pulls net.sourceforge.sqlexplorer into the TOS DQ product. Since we cannot include net.sourceforge.sqlexplorer at installation, we need to exclude net.sourceforge.sqlexplorer.nl and find another way to fetch it.",1 TDQ-9908,"Cannot add connections in Data Explorer","In my integration or my profiler perspective, I have the metadata Db Connections available, but in my Data Explorer perspective, I don't have any connections and I cannot even add connections. I have moved my workspace to a different folder (C:\TOS_jobs\workspace)when installing the new version. For every new version, I had to import the projects again before.",3 TDQ-9911,"design a prototype with the new version of SpagoBI","use the last stable version of SpagoBi and import the reports and other objects (dashboards, QBE,...) from an old DQ portal. Try different layouts in SpagoBI...",8 TDQ-9919,"Update some tdq system routines file"," Update some tdq system routines file : now we parser the routines function parameter from the annotation on studio side. for example : code\routines\system\Numeric_0.1.item {code} /** * return numbers using an implied decimal format. * * {Category} Numeric * * {talendTypes} float | Float * * {param} String(""9V99"") format: float pointing format. * * {param} String(""123"") toConvert: read this value. * * {example} convertImpliedDecimalFormat(""9V99"", ""123"") result: 1.23 ... * */ public static Float convertImpliedDecimalFormat(String format, String toConvert) { {code} => we parser "" format: ""and ""toConvert:"" as param , but now some dq routines file not keep the same rule ,it is a wrong format. like this files : \code\routines\system\DQTechnical_0.1.item , \code\routines\system\DataQuality_0.1.item , {code} /** * isNameStringValid: Returns true or false if the string is a valid formed name: [Initial] Firstname [Initial] * Lastname * * {talendTypes} Boolean * * {Category} Data Quality * * {param} string(""Mrs. Marty Smith"") the string to be processed * * {example} isNameStringValid(""Mrs. Marty Smith "") # returns true */ public static boolean isNameStringValid(String inStr) { {code} ==> The old string : {param} string(""Mrs. Marty Smith"") the string to be processed The new string need add the parameters : {param} string(""Mrs. Marty Smith"") inStr: the string to be processed",3 TDQ-9924,"improve call back option on tVerifyEmail","we need to be able to configure the callback parameters such as the sender (qiongli@talend.com) (check other parameters in the indicator) - The callback should throw exceptions when invalid configuration (wrong parameters set) log level to discuss again. IMO because the callback takes time, it's good to keep the info level here (the user may still decide to hide the logs with log4j). ",8 TDQ-9929,"Upgrade Drools to the lastest stable version (Step 2)","Lastest Drools version is 6.2.0Final.",10 TDQ-9942,"tdqReportRun component exist compile error on the 6.0","StandaloneRepositoryContextService class has been move to package ""org.talend.core.repository.services"" instead of old one ""org.talend.repository"" PreferenceInitializer line:92 there should be a OS path rather than common path string mean ""\"" will be used in this case. It will cause compile error on the code of component",8 TDQ-9943,"the remain issues after TDQ-9820 we support of new databases for the data mart and the DQ portal",NULL,8 TDQ-9946,"Automatically create the data mart database from the installer - Part 2","Automatically create the data mart database from the installer - -oracle- (For Oracle, the schema must exist before the installation) - ms sql server - postgresql This means that: - a DB user having the appropriate permissions to create a database can use the installer to create the data mart (no prerequisite except setting the permissions of this user). - the user does not need to manually create the database before running the installer - for each database, list the prerequisites (creation of user statement, grant of permissions, ...) - a DB user that does not have the appropriate permissions won't be able to create the database and there should appear an exception to the user of the installer explaining why the installation failed. - if the database already exists, then the installer will simply populate it (as it's already done) The change only needs to be done in the installer. No change required in the studio.",8 TDQ-9952,"The chart doesn't show in the ""Analysis Results"" page after running analysis in studio.",NULL,5 TDQ-9953,"Column analysis improved editor","for detail issue refer to the sub-task.",13 TDQ-9957,"API for discovering data semantic","Based on regex, dictionnaries and lucene indexes, define an API that take a data flow and returns expected data semantic. See Aicha's code base about the category indicators. ",20 TDQ-9967,"got NPE when run Match analysis without jfreechart","{code} org.eclipse.swt.SWTException: Failed to execute runnable (java.lang.NullPointerException) org.eclipse.swt.SWT.error(SWT.java:4441) org.eclipse.swt.SWT.error(SWT.java:4356) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:139) org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4147) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3764) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:78) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) Caused by: java.lang.NullPointerException org.talend.dataquality.record.linkage.ui.composite.chart.DuplicateRecordPieChart.refreshChart(DuplicateRecordPieChart.java:64) org.talend.dataquality.record.linkage.ui.section.DuplicateRecordStatisticsSection.refreshChart(DuplicateRecordStatisticsSection.java:203) org.talend.dataprofiler.core.ui.editor.analysis.MatchAnalysisResultPage.refresh(MatchAnalysisResultPage.java:94) org.talend.dataprofiler.core.ui.editor.analysis.MatchMasterDetailsPage.fireRuningItemChanged(MatchMasterDetailsPage.java:1446) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:252) org.eclipse.ui.internal.UILockListener.doPendingWork(UILockListener.java:167) org.eclipse.ui.internal.UISynchronizer$3.run(UISynchronizer.java:165) org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:136) ... 23 more {code}",2 TDQ-9973,"on TOS_DQ ""Additional Talend Packages"" can not list the chart.jar, manually install it, cannot pop up dialog to install necessary jars","issue1 start TOS_DQ build, on the ""Additional Talend Packages"" dialog can not list chart.jar to download. issue 2. manually put chart.jar to plugins folder, when re-run analysis can not pop up dialog to download the jars necessary for chart.jar. but we can on M1 build(attached the pic needed by chart.jar)",3 TDQ-9984,"Plugin org.talend.libraries.jfreechart is not included in any features in TOS_DQ","The plugin org.talend.libraries.jfreechart is required by org.talend.dataprofiler.top.chart, but as it is not included in any SE features, it is not included in any SE products.",2 TDQ-9985,"issue for tVerifyEmail(black list, white list, checked entire email with regular expression)","*issue1* 1. import the job attached, run it. -- all item are verified. 2. add black list ""cc.zbzz13"" run the job again. Expected Result: only item 5 should be invalid, for its domain in the black list. Actual Result: item 2,3,5 are invalid. *ISSUE 2:* when check with white list, but white list is empty, should we treat all email as VERIFIED or invalid, now all treat as VERIFIED. *issue 3*: the ""Check the entire email with regular expression"" doesn't works on my side 1. set input as 2@qq.com 2. checked ""use standard regular expression"" as -->""^\\d$"" 3. checked ""Check the entire email with regular expression"" and set value-->""^\w+([-+.]\w+)+@\w+([-.]\w+)*\.\w+([-.]\w+)*$"" run the job, still treat input as VERIFIED, should not.",8 TDQ-9997,"right click on a pattern or a rule in table rule analysis, job can generated but dialog can not close","1. create a column analysis, add a pattern, run the analysis 2. turn to ""Analysis Results"" page, right click on the pattern -->Generate job 3. on the pop up dialog select one options and click ""Ok"" Expected Result: job generate without error and dialog close. Actual Result: job can generate but the pop up dialog on step3 can not close, and error log get error. same issue when right click on the rules in table Rule analysis to generate job(dialog can not close, get error) for other generate job operation will also get error in error log: 1. right click report-->Generate jobs-->Launch a report/Alter threshold violation 2. generate the remove duplicate job {code}java.lang.IllegalArgumentException: Argument not valid org.eclipse.swt.SWT.error(SWT.java:4422) org.eclipse.swt.SWT.error(SWT.java:4356) org.eclipse.swt.SWT.error(SWT.java:4327) org.eclipse.swt.graphics.Image.init(Image.java:1557) org.eclipse.swt.graphics.Image.(Image.java:180) org.talend.designer.core.ui.editor.AbstractTalendEditor.saveOutlinePicture(AbstractTalendEditor.java:1083) org.talend.designer.core.ui.editor.AbstractTalendEditor.savePreviewPictures(AbstractTalendEditor.java:1154) org.talend.designer.core.ui.editor.AbstractTalendEditor.doSave(AbstractTalendEditor.java:518) org.talend.designer.core.ui.AbstractMultiPageTalendEditor.doSave(AbstractMultiPageTalendEditor.java:975) org.talend.designer.core.ui.MultiPageTalendEditor.doSave(MultiPageTalendEditor.java:176) org.talend.datacleansing.core.ui.jobs.template.AJobAction.checkAndSave(AJobAction.java:316) org.talend.datacleansing.core.ui.jobs.template.AJobAction.addTemplateNodes(AJobAction.java:297) org.talend.datacleansing.core.ui.jobs.template.AJobAction.doRun(AJobAction.java:153) org.talend.repository.ui.actions.AContextualAction$2.run(AContextualAction.java:635) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:93) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:237) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3205) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1977) org.talend.repository.ui.actions.AContextualAction.run(AContextualAction.java:641) org.talend.datacleansing.core.ui.actions.IndicatorJobAction.run(IndicatorJobAction.java:338) org.talend.datacleansing.core.ui.service.DatabaseJobService.executeJob(DatabaseJobService.java:79) org.talend.dataprofiler.core.ui.editor.preview.model.ChartTableFactory$1.widgetSelected(ChartTableFactory.java:149) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:162) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code} ",3 TDQ-10000,"The sections do not fold for column analysis and match analysis when check ""Fold all sections"" in the Preference page.",NULL,1 TDQ-10005,"upgrade libphonenumber in tStandardizePhoneNumber and studio","Current version of the library is 7.3.0 provided by https://github.com/googlei18n/libphonenumber http://repo1.maven.org/maven2/com/googlecode/libphonenumber/libphonenumber/",5 TDQ-10022,"Wrong null result on tRuleSurvivorship ","We want to create a golden record with the tRuleSurvivorship. The address of the golden records needs to be the address of the most complete record in the matchgroup. => function most complete. When we use the function most complete we got the following output (see attached) As you can see in the screenshot the function only seems to be working for the first matchgroup. The other matchgroups get NULL values in the fields. We've tested this in a studio which has been patched and we've also tested in a non-patched studio. ",2 TDQ-10028,"Profiling / Analysis results on MacOS / N-1 entries in the Result versus N bars in Result graph","Profiling / Analysis results on MacOS / N-1 entries in the Result table versus N bars in the Result graph. Example in attached screensho: there are 3 bars in the graph and only 2 entries in the table. 1st is missing... The problem appears initially. Selecting the first table entry row and then scrolling or pressing the top arrow key shows all expected entries.",2 TDQ-10032,"Drill down not working with custom REGEX","I have created a custom REGEX and added it to a column in a column analysis. When I run the analysis, I get the correct results. However, when I try to drill down (right mouse click) I get a SQL error (see attached screenshot). Here is the SQL that's generated. For some reason, it's adding an extra $' at the end of the REGEX. SELECT * FROM `crm`.`clients` WHERE ( `idState` NOT REGEXP BINARY '^(A[KLRZ]|C[AOT]|D[CE]|FL|GA|HI|I[ADLN]|K[SY]|LA|M[ADEINOST]|N[CDEHJMVY]|O[HKR]|P[AR]|RI|S[CD]|T[NX]|UT|V[AIT]|W[AIVY])$' $' OR `idState` IS NULL ) Here's another custom one that works. No extra $; on this one. SELECT * FROM `crm`.`cust` WHERE ( `Code` NOT REGEXP BINARY '^[A-Za-z]+$' OR `Code` IS NULL ) My REGEX looks correct, so I'm not sure why there is a difference. This is for a POC that I'm having next week. I've attached the custom REGEX. States_check is the one I'm having a problem with.",5 TDQ-10039,"tMatchGroup issue in a joblet ","When using a tMatchGroup component in a joblet it's not possible to open the wizard of that component. When we try to configure the tMatchGroup component beforehand, and refactor it to a joblet, the configuration is lost and the job does not work. Is this meant to work that way? The same error occurs when copying a tMatchGroup component from one job to another; only the blocking key definition is kept, but the rules are gone. ",2 TDQ-10042,"Add ""Minimum verification level"" option for 'loqate' of Address Provider when test ""tAddressRowCloud"" component job. ","The Reverted verification level can be shown when add minimum verification level for loqate. https://www.everythinglocation.com/server-options/ [17:35:36] Wei.zhaojun.talendbj(魏招君): http://www.loqate.com/wp-login.php?redirect_to=/support/fielddescrip/address-verification-code/ [17:38:52] Wei.zhaojun.talendbj(魏招君): The verification status “C” (Conflict) is for future expansion, and currently it is unused. The verification status “R” (Reverted) will be returned, if the address could not be verified to the specified criteria level, e.g., MinimumVerificationLevel, MinimumMatchscore. For example, 999 Baker Way, San Mateo, 94404, CA, US. During verification, a “V4” is returned as we can see below. However, if we set the option “MinimumVerificationLevel” to 5, which is higher than the verification level 4 that the address gets, then the address will be reverted with a “R4” returned. Please refer to the screenshots below, MinimumMatchscore Used to specify the minimum matchscore a record must reach in order to avoid reversion. Default is 0 (zero), valid values are 0-100 MinimumVerificationLevel Used to specify the minimum verification level a record must reach in order to avoid reversion. Default is 0 (zero), valid values are 0-5",5 TDQ-10044,"Profiling: Analysis - Number of results shown ","When changing the parameter 'number of results shown' in a column>pattern freaquency table analysis, the pattern is lost, instead it's replaced by the individual values from the source file. see attached document. This is just happened on File Delimited Connection, in my testing, it's Ok on Database connection.",2 TDQ-10066,"fail to copy sub process if tRowGenerator exist.","fail to copy sub process if tRowGenerator exist in the TOS_DI-20150305_0334-V5.6.2SNAP product.",2 TDQ-10088,"upload a correct ""org.talend.dataprofiler.top.chart_6.0.0.jar"" file to the server after resolve this issue","Jar will be automatically published on nexus from now on: http://newbuild.talend.com:8081/nexus/content/repositories/TalendOpenSourceRelease/org/talend/studio/ Thanks Irene for https://github.com/Talend/tdq-studio-se/commit/fed43e50c52f4d6e42cb4d34e06aaeb105b02b53 We still need to provide them to Mike after they are built so that they appear at https://talend-update.talend.com/nexus/content/repositories/libraries/org/talend/libraries/",3 TDQ-10089,"Port the tVerifyEmail to 5.6 branch","This component is required by TIC.",5 TDQ-10091,"Enrich with results of analysis","After the execution of the analysis, the results should be stored in the ontology. Results like min, max are important to define a domain on numeric data. (only for numeric columns, not for dates) Thresholds set by the user are already stored in the ontology. Some thresholds can be computed from results of analysis. Rules: Attribute domain (defined by Min and Max Indicators thresholds) min and max values are updated according to the following rules: - if there is no threshold on the min (max) indicator, and if the min (max) indicator value is less (greater) than the attribute domain min (max) value, then the domain min (max) value is updated with the new value of the min indicator - if the indicator has some thresholds set, then the min (and/or max) threshold will update the domain min (and/or max) value every time. Use WARN instead of ERROR for the message saying that ""Failed to connect to the Semantic Repository Server. Please check your settings and make sure the server is up..."" Store min/max indicator percentage threshold information into ontology repository and reuse for analysis generation. (TDQ-10952) ",5 TDQ-10094,"improve the tdqportal after upgrade to spagobi 5.1",NULL,8 TDQ-10097,"Email validation component - Step 3 - Auto-refresh TLD list","This is step 3 of the email validation component. We need a way to refresh the TLD list from https://data.iana.org/TLD/tlds-alpha-by-domain.txt ",20 TDQ-10098,"Can't use context in PREVIEW dialog on tMatchGroup","I encounter a problem with tMatchGroup component in version 5.6.1. During my test, I try to set a context variable for the __INTERVAL_RULE__ (as a Double). On execution, I have the error below. I'm a little bit bored, because I have a customer who uses a context variable without any problem in version 5.3.1 and I guess a potential migration problem here. Exception in component tMatchGroup_1_GroupIn java.lang.NumberFormatException: For input string: ""context.INTERVAL_RULE"" at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1250) at java.lang.Double.valueOf(Double.java:504) at org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.createRecordMatcher(AbstractRecordGrouping.java:541) at org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.initialize(AbstractRecordGrouping.java:508) at di_demo.testmatchgroup_0_1.TestMatchGroup.tFixedFlowInput_1Process(TestMatchGroup.java:1655) at di_demo.testmatchgroup_0_1.TestMatchGroup.runJobInTOS(TestMatchGroup.java:2183) at di_demo.testmatchgroup_0_1.TestMatchGroup.main(TestMatchGroup.java:2030) [statistics] disconnected ",5 TDQ-10102,"Create version 5.6.2 in Babili and populate it",NULL,2 TDQ-10123,"start tdqportal can not show the login page--installed by installer","1. install dqportal by installer build. successfully 2. start it by click ""start_tdqp.bat"" 3. try to visit web page by ""http://IP:8580/tdqportal"" Expected Result: show the logon page correctly. Actual Result: can not show the logon page, and errors show. NOTE: we have ""hsqldb1_8_0_2.jar"" and ""mysql-connector-java-5.0.8-bin.jar"" in tomcat/lib",5 TDQ-10129,"job about tBatchAddressRowCloud + MelissaData get NPE when input data more than 100 rows","1. import the job , set license for melissadata try to run it. *NOTE* : the ""query"" in the input component controls the input rows. Expected Result: can get result correctly. Actual Result: get NPE directly. {code} [ERROR]: org.talend.dataquality.address.api.AsyncAddressObjectHandler - java.lang.NullPointerException java.util.concurrent.ExecutionException: java.lang.NullPointerException at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.talend.dataquality.address.api.AsyncAddressObjectHandler$AsynchronizedOutputRunnable.run(AsyncAddressObjectHandler.java:100) at java.lang.Thread.run(Thread.java:724) Caused by: java.lang.NullPointerException at org.talend.dataquality.address.melissaData.batch.BatchMelissaQueryCallable.parseJsonResult(BatchMelissaQueryCallable.java:108) at org.talend.dataquality.address.melissaData.batch.BatchMelissaQueryCallable.call(BatchMelissaQueryCallable.java:67) at org.talend.dataquality.address.melissaData.batch.BatchMelissaQueryCallable.call(BatchMelissaQueryCallable.java:41) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ... 1 more {code}",5 TDQ-10130,"Export babili translations into git (for 6.0.0M5)",NULL,2 TDQ-10140,"Upgrade Drools Guvnor (KIE Drools Workbench) to 6.2 ",NULL,10 TDQ-10141,"The result is not correct when set ""9a*"" for "" Simplified Pattern"".",NULL,2 TDQ-10142,"Export babili translations into git on 5.6",NULL,2 TDQ-10144,"Create version 6.0.0M4 in Babili and populate it",NULL,2 TDQ-10146,"add MariaDB driver in driver list for DQ components","Refer to TDI-30249. Need update DQ components too. tMySQLInvalidRows tMySQLValidRows",5 TDQ-10147,"Update jar version for Postgresql on the component of DQ",tPostgresqlInvalidRows,3 TDQ-10148,"Allow store analysis data into datamart without generating report","Sometimes customer only want to store analysis data, and use dqportal to generate report later, but currently you have to generate the report with the store process, it's better to allow this feature to enhance usability. Attached screen capture for the UI part of this feature. A question mark icon appears after the checkbox with a tooltip: ""The results of the analysis will be stored into the data mart. No output (pdf, html, xls) file will be generated when not checked"". When the user opens the editor, the checkbox is checked (default behavior). When the checkbox is checked, the behavior is like in previous versions. When the checkbox is NOT checked, the user wants to run the report execution, but does not want to get a pdf (or html, xls) report: so no pdf report will be generated, but the analysis results are nevertherless stored in the data mart. When the checkbox is NOT checked, all fields are grayed out When the checkbox is NOT checked, the information in these fields is not taken into account (but may still be stored in EMF file). The label of the checkbox is: ""Generate output file"". Change the ""generate a single file"" label for ""with timestamp"" -- by default, now this checkbox is checked -- technically, the logic inverted (with timestamp = ! generate single file) -- don't change the EMF variables (keep GEN_SINGLE_REPORT = ""Single output"") The tooltip of this checkbox can be improved: ""when checked, the file name will get a timestamp and the generated file will be not overwritten at each time a report is generated"" ",8 TDQ-10173,"Improve the way we use regexes","Currently there is one validator class for one regex. As the validator not only validates regexes, we want to keep them, but the design is not scalable when we want to add more regexes. We will use a json file to store the additional regexes and their name, (and description?). Aicha had about 30 regexes (if I remember). See in the indicators. ",8 TDQ-10182,"Simplify HDFS file Profiling with Hive - step 2","See subtasks below",20 TDQ-10189,"UX : new icon set","integrate the new icons in the studio (data-profiling.zip) These icons come from https://github.com/Talend/tdq-studio-se/tree/master/main/plugins/org.talend.dataprofiler.core/icons and integrate the new icons of components: Data_Quality v1.zip ",5 TDQ-10216,"redundant characters show for value in ""tdq_indicator_definition"" (datamart)table","1. check the value in datamart -tdq_indicator_definition, there are some value surrounded by !!! refer to the pic attached, also in dqportal. Expected Result: show the value correctly both in datamart and dqportal.",1 TDQ-10246,"Create back thread to load data on the preview table of column analysis","1.reopen analysis editor 2.right click to create new column analaysis editor. 3.create column analysis by the menu and select columns on the wizard. Those action only open the preview table and not load data. Because we don't want to waitting it. Create a back ground thread to load data. ",5 TDQ-10251,"Create Semantic Discovery UI","Attached pictures show some ideas of this UI. This wizards opens after a right click on a table (or a set of columns) in the repository view and select the menu ""Suggest analysis"". Three steps. # finding semantic names of each column using the semantic categorization API # finding the concept mapping using the semantic mapping API # the last step is the metadata page of the new analysis creation wizard In the first page, the user can edit the semantic names. These semantic names created by the user are kept during the second step. The second steps lists all concepts that matched and display on a chart the number of matched columns (number of columns in common in the semantic schema and the concept). ",20 TDQ-10263,"check in DQ side for TDI-32272","Since MDM components has a new drop-down list:""MDM Version""with 2 options: ""5.6 server"" and ""6.0 server"", Need gui team to add the same drop-down list for mdm repository",2 TDQ-10270,"Deduplicate lucene dependency","remove lucene-core-3.0.1 from library plugin, update component reference to 3.0.3",1 TDQ-10275,"run column analysis focus on ""Analysis Result"" page get many errors in error log--for some frequency indicators(analysis can run successfully)","1. create a column analysis, set sql engine, add int, date, varchar columns 2. add all available System indicators for the three columns. 3. run the analysis when focus on ""Analysis Settings"" page, successfully 4. turn to ""Analysis Results"" page. re-run it by click ""Run"" icon. Expected Result: analysis run without error. Actual Result: analysis can run successfully(check by Execution Status, and Last Successful Execution), but get errors in error log. {code} org.eclipse.swt.SWTException: Failed to execute runnable (java.lang.ClassCastException: org.jfree.data.category.DefaultCategoryDataset cannot be cast to org.talend.dataprofiler.common.ui.editor.preview.ICustomerDataset) org.eclipse.swt.SWT.error(SWT.java:4441) org.eclipse.swt.SWT.error(SWT.java:4356) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:139) org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4147) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3764) org.eclipse.jface.window.Window.runEventLoop(Window.java:832) org.eclipse.jface.window.Window.open(Window.java:808) org.eclipse.ui.internal.views.log.EventDetailsDialog.open(EventDetailsDialog.java:181) org.eclipse.ui.internal.views.log.EventDetailsDialogAction.run(EventDetailsDialogAction.java:98) org.eclipse.ui.internal.views.log.LogView$15.doubleClick(LogView.java:537) org.eclipse.jface.viewers.StructuredViewer$1.run(StructuredViewer.java:831) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.ui.internal.JFaceUtil$1.run(JFaceUtil.java:50) org.eclipse.jface.util.SafeRunnable.run(SafeRunnable.java:178) org.eclipse.jface.viewers.StructuredViewer.fireDoubleClick(StructuredViewer.java:828) org.eclipse.jface.viewers.AbstractTreeViewer.handleDoubleSelect(AbstractTreeViewer.java:1472) org.eclipse.jface.viewers.StructuredViewer$4.widgetDefaultSelected(StructuredViewer.java:1237) org.eclipse.jface.util.OpenStrategy.fireDefaultSelectionEvent(OpenStrategy.java:252) org.eclipse.jface.util.OpenStrategy.access$0(OpenStrategy.java:249) org.eclipse.jface.util.OpenStrategy$1.handleEvent(OpenStrategy.java:311) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:197) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) Caused by: java.lang.ClassCastException: org.jfree.data.category.DefaultCategoryDataset cannot be cast to org.talend.dataprofiler.common.ui.editor.preview.ICustomerDataset org.talend.dataprofiler.core.ui.events.FrequencyDynamicChartEventReceiver.handle(FrequencyDynamicChartEventReceiver.java:57) org.talend.dataprofiler.core.ui.events.EventManager.publish(EventManager.java:123) org.talend.dataprofiler.core.service.TOPRepositoryService.publishDynamicEvent(TOPRepositoryService.java:656) org.talend.dq.analysis.ColumnAnalysisSqlExecutor$1.run(ColumnAnalysisSqlExecutor.java:1383) org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:136) ... 43 more {code}",1 TDQ-10280,"Move sampling plugin from EE to SE",NULL,2 TDQ-10281,"Find a way to resolve the lucene dependency in sampling project","for 6.0.0M5, the Function SYNONYM_REPLACE is deactivated in the API, in order to remove the dependency on org.talend.dataquality.standardization plugin, which we don't want to include in TOS_DQ. For related compoenent (tDuplicateRow), the dependency jar is created during each build, so the Function is not available in this M5 release either. We will need to split this dependency from the sampling feature.",5 TDQ-10284,"Create version 6.0.0M5 in Babili and populate it",NULL,2 TDQ-10286,"Export babili translations into git (for 6.0.0RC1)",NULL,2 TDQ-10298,"Survivorship rule doesn't appear in studio GUI metadata if the rule name contains ""_""","If we put ""_"" in the tRuleSurvivorship component-Rule package name(see image RulePackageName_ContainsCharacter.png); it can generate well under ""workspace\MDM541\metadata\survivorship"" and job runs well(see image Generated.png); but it doesn't appear in the Repository-Metadata-Rules Management-Survivorship Rules(see image RulePackageName_ContainsCharacter.png). If we delete the ""_"", it appears in GUI.(see image RulePackageName_WithoutCharacter.png)",5 TDQ-10299,"UI improvements in Indicator selection dialog","See subtasks",13 TDQ-10315,"[DQ Portal] - rename QBE to ""Custom Reports""","rename ""Reporting"" to ""Reports"" too",1 TDQ-10325,"Support MariaDB well in Studio(include datamart) and DQ portal","for the data mart because the mariadb is similiar to mysql, the only differences with mysql as follows: driverClassName=""org.mariadb.jdbc.Driver"" url=""jdbc:mariadb://..."" and the jar as the attachment file so in our studio, we can add a mariadb version when create datamart as mysql(like components) and the same in the installer and dqportal ",20 TDQ-10328,"Allow the user to create a column analysis with a right-click on an HDFS file","A new analysis can be applied on an HDFS file. When the user wants to analyze an HDFS file, the analysis is actually done on the related Hive columns. When the user right-clicks on a HDFS file in the repository view, a new wizard is launched with the following pages: - Hive table creation pages like in TDQ-9605 - new column analysis page (all columns are preselected with simple statistics indicators) ",8 TDQ-10331," tRule job doesn't work on 6.0M5","run the job with tRule on M5. it doesn't work and get an error: -------------------------------------------------------------------------------------------------------------------------------------------------------- Exception in thread ""main"" java.lang.NoClassDefFoundError: org/eclipse/core/runtime/Plugin java.lang.ClassLoader.defineClass1(Native Method) java.lang.ClassLoader.defineClass(ClassLoader.java:792) java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) java.net.URLClassLoader.defineClass(URLClassLoader.java:449) java.net.URLClassLoader.access$100(URLClassLoader.java:71) java.net.URLClassLoader$1.run(URLClassLoader.java:361) java.net.URLClassLoader$1.run(URLClassLoader.java:355) java.security.AccessController.doPrivileged(Native Method) java.net.URLClassLoader.findClass(URLClassLoader.java:354) java.lang.ClassLoader.loadClass(ClassLoader.java:424) sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) java.lang.ClassLoader.loadClass(ClassLoader.java:357) org.codehaus.jdt.groovy.integration.LanguageSupportFactory.tryInstantiate(LanguageSupportFactory.java:140) org.codehaus.jdt.groovy.integration.LanguageSupportFactory.getLanguageSupport(LanguageSupportFactory.java:125) [statistics] disconnected org.codehaus.jdt.groovy.integration.LanguageSupportFactory.getParser(LanguageSupportFactory.java:54) org.eclipse.jdt.internal.compiler.Compiler.initializeParser(Compiler.java:743) org.eclipse.jdt.internal.compiler.Compiler.(Compiler.java:298) org.eclipse.jdt.internal.compiler.Compiler.(Compiler.java:164) org.drools.compiler.commons.jci.compilers.EclipseJavaCompiler.compile(EclipseJavaCompiler.java:412) org.drools.compiler.commons.jci.compilers.AbstractJavaCompiler.compile(AbstractJavaCompiler.java:49) org.drools.compiler.rule.builder.dialect.java.JavaDialect.compileAll(JavaDialect.java:402) org.drools.compiler.compiler.DialectCompiletimeRegistry.compileAll(DialectCompiletimeRegistry.java:46) org.drools.compiler.compiler.PackageRegistry.compileAll(PackageRegistry.java:123) org.drools.compiler.builder.impl.KnowledgeBuilderImpl.compileAll(KnowledgeBuilderImpl.java:1255) org.drools.compiler.builder.impl.KnowledgeBuilderImpl.compileAllRules(KnowledgeBuilderImpl.java:901) org.drools.compiler.builder.impl.KnowledgeBuilderImpl.addPackage(KnowledgeBuilderImpl.java:892) org.drools.compiler.builder.impl.KnowledgeBuilderImpl.addPackageFromDrl(KnowledgeBuilderImpl.java:433) org.drools.compiler.builder.impl.KnowledgeBuilderImpl.addKnowledgeResource(KnowledgeBuilderImpl.java:653) org.drools.compiler.builder.impl.KnowledgeBuilderImpl.add(KnowledgeBuilderImpl.java:2164) org.drools.compiler.builder.impl.KnowledgeBuilderImpl.add(KnowledgeBuilderImpl.java:2153) demodrools.t_0_1.T$1KnowledgeBase_tRules_1.readKnowledgeBaseDRL(T.java:716) demodrools.t_0_1.T$1KnowledgeBase_tRules_1.readKnowledgeBase(T.java:699) demodrools.t_0_1.T.tFileInputDelimited_1Process(T.java:777) demodrools.t_0_1.T.runJobInTOS(T.java:1327) demodrools.t_0_1.T.main(T.java:1184) Caused by: java.lang.ClassNotFoundException: org.eclipse.core.runtime.Plugin java.net.URLClassLoader$1.run(URLClassLoader.java:366) java.net.URLClassLoader$1.run(URLClassLoader.java:355) java.security.AccessController.doPrivileged(Native Method) java.net.URLClassLoader.findClass(URLClassLoader.java:354) java.lang.ClassLoader.loadClass(ClassLoader.java:424) sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) java.lang.ClassLoader.loadClass(ClassLoader.java:357) ",13 TDQ-10381,"Add a feature to delete existing report in datamart in DQPortal","Now we don't have a way to delete the existing report in datamart, we can't truncate database each time, it's better to add a featue in DQPortal to do this.",13 TDQ-10382,"Create version 6.0.0RC1 in Babili and populate it",NULL,2 TDQ-10405,"No related hadoop cluster information shows in the ""Export Items"" dialog.","No hadoop cluster item display in the dialog, another issue is the Import Items still shows for The import Items still shows for hdoop cluster, hdfs and hive link.",13 TDQ-10417,"Oracle has totally stopped to support ODBC in Java 8","- display an error on ODBC connections in the DQ repository view when JDK >= 8 - add an error when the user tries to run an analysis with an ODBC connection. (maybe it's already ok)",8 TDQ-10435,"file connection has a redundant level --Metadata in its structure ","create a fileDelimited connection, unfold it to show its columns, we get two Metadata level, in fact the second is redundant",5 TDQ-10437,"icon issues for match rule, file connection, hadoop cluster","1. try to create a new Match Rule by, the icon for the context menu is not correct. 2. try to import/export file Delmited connnection, the icon for it is not correct. 3. in DQ Repository, the Hadoop cluster node' s icon seems to change to same with DI. details refer to the pic attached.",3 TDQ-10440,"after restart TOS_DQ , items in Recycle Bin should manually refresh to show ","1. create two analysis, delete one to Recycle Bin. 2. restart TOS_DQ 3. check the Recycle Bin, the deleted analysis can not show, need to manually refresh it. ",1 TDQ-10442,"Export babili translations into git (for 6.0.0)",NULL,2 TDQ-10447,"the description for ""Chart for Data Quality"" is not correct in the ""Additional Talend Package"" dialog","check the message for ""Chart for Data Quality"" in ""Additional Talend Package"" dialog. the message is not correct. refer to the pic attached.",2 TDQ-10452,"incorrect modules","Charts can't display in RC1 build. See attached screenshot",8 TDQ-10458,"The sql UDI is grey and can not be choosed after clicking ""Select indicators"" button in the column analysis with sql engine.",NULL,5 TDQ-10473,"Semantic discovery wizard improvements","The following is just for reference. The updated descriptions are in the subtasks. {quote} Email discussion summary: h3. Page 1: - -disable finish button (same for page 2)- (we can keep the ability to finish the wizard with all the default values) - -BUG: edit semantic category works but if user puts a blank value, the first value of the combo list will come back (same for page 2). The user must be able to set an empty category.- (this issue has been fixed) - if UNKNOWN (shown as blank) is not the dominant category, there’s no need to display it in the combo list (same for page 2)(TDQ-10503) - use text instead of the a number as row header of semantic category row(same for page 2). Use ""Semantic Name"" on two rows if possible.(TDQ-10503) - increase the height of the separator between the two parts inside the nattables (TDQ-10503) - data preview table: increase the height of the separator between the semantic category row and the raw data (same for page 2)(TDQ-10503) - add the matched percentage after the category name in the combo list (TDQ-10484) - data preview table: disable selection in raw data section (same for page 2)(TDQ-10503) - data preview table: when click at a semantic category, only add yellow background, do not decrease the font size or make it italic (also for page 2). Use the exact same color as in the indicator selection dialog for the background highlight. (TDQ-10503) - refresh action very slow, to be optimized (TDQ-10508) - Use a random seed or the seed set in the preference page for the reservoir sampling algorithm (see TDQ-10474) - Remove the help button - add a text field for the ""threshold"". This threshold will be used by the API to return a list of categories that are above the threshold. (TDQ-10488) h3. Page 2: - -disable Next button before one of the concept is selected- I don't agree: the first concept should be selected by default. - show the selected Concept with a different color (use the yellow color for the selection?) (TDQ-10504) - Re-process Ontology Mapping button is too wide, decrease the width and push it to the right top corner or somewhere else. Call it ""Refresh"" simply. (TDQ-10504) - BUG: need to highlight not only the columns whose names match attributes, but also the columns whose semantic categories match attributes (TDQ-10489) - Remove white line effect in the chart. We should have the same kind of chart as in the frequency table of the profiler. Use the red color too. (TDQ-10504) - -merge the similar concepts from different business standards, ex: INFOR_Person & OAGI_Person & UBL_Person- This is TDQ-10241 - -use normalized matching scores in the chart ? (the current scores are the elastic search score multiplied by 1000, which are not very meaningful. we may normalize them to values between 0 and 100 for example and use different colors according to the score, Green for concepts having 80+ points, Orange for 60-80)- I don't think it's easy to compute a normalized score. (we already had this issue with tSynonymSearch). Let me know if I'm wrong. - -merge page 1 and page 2 ?? (as we share the same data preview table)- No, we actually need the categories computed by the first page (and the edition done by the user) in order to suggest a better ontology match in the second page. h3. Page 3: - use the same horizontal layout as previous pages: (TDQ-10505) -- header 1: column name (do not show this text in the table header) -- header 2: semantic name -- highlight edited names -- header 3: action combo list -- main table: display the data just like the previous two pages - use ""do nothing"" as the default value (TDQ-10505) - find a way to better organize the Actions(TDQ-10505) - when the Semantic Name of a column is empty, which means no mapping exists between the metadata column and any attribute of the concept. In this case, we can only add this column as a new attribute, so we should disable all the ADD_AS_SYNONYM actions (TDQ-10514) h3. Page 4: - pre-fill a generated name to the analysis(TDQ-10505) - -use this page as the starting page of the wizard like the other wizards generating analyses ?- no, because we can simply finish before this page and the analysis will be generated with a default name. (that's less click for the user) {quote}",20 TDQ-10474,"Create a preference page to configure ES installation for semantic discovery","Add Preference Page called ""Semantic Discovery"" in the ""profiling"" folder. The parameters to set are - ES host = localhost - ES port = 9300 - ES cluster name =talend-log-central - use fixed seed for sampling (checkbox: when checked, an editable text field appears and the user can set the seed.) By default, it's unchecked. port and seed text field can only input numbers. The preference can be implemented in the ontology.ui plugin. Need to change the logic: When init the SemanticDiscoreryWizard, need to read the value from the preference page, if the current values can not be used, need to popup an error to tell the user to change the values. (current just throw exception and can not show the wizard, if the host/port are wrong) . Also need to move all cluster name into config, to read it from the config, but not use a string directly. ",8 TDQ-10479,"for column/match analysis about File connection --Sampling algorithm items status are not same before and after reopen analysis.","1. create a new column analysis about file connection. 2. check the Sampling algorithm item, it is available. 3. reopen analysis, re-check it. it is disable now. Expected Result: it should be same status.",3 TDQ-10493,"Remove previously deprecated features","*Components* # delete tGenKeyHadoop # delete tMatchGroupHadoop # delete tdqprovider/tMahoutClustering from the standard palette (don't delete the Big Data tMahoutClustering) Display an error message when importing a job with one of these components: The deprecated component ""xxxx"" has been removed from the Studio since 6.0 version. ",5 TDQ-10510,"DEMO DASHBOARD","this feature is only for demo of jira dashboard.",24 TDQ-10516,"java engine ""column set"" drill down result is not correct when studio language is French","1. set studio language is French 2. create a column set analysis about tbi-->employee, add columns ""education_level"" and ""position_id"", set java engine run it. 3. turn to analysis result page, try to check the ""view value"" result of indicators. the result can not show correctly, should only show the columns which selected in analysis, but now it show all, when studio language is English , it is correct.",1 TDQ-10528,"No related error dialog popped after selecting ""Select Data"" button when set a wrong value where clause for column analysis","1.Start top product. 2.Create db connection and column analysis. 3.Set wrong value for set a wrong where clause 4.Save it. 5.Reopen analysis and selecte""Select Data"" button Expected result: The error dialog should be popped. Actual results: No dialog popped. the Column Selection dialog shows.",1 TDQ-10540,"Create version 6.0.0 in Babili and populate it",NULL,2 TDQ-10544," some Links in help content for Regex Pattern doesn't get to the correct destination","1. right click on ""Regex""-->New Regex Pattern, 2. check the content on the right pane of the wizard. 3. the links, for oracle can not found the page, for sqlserver, the linked page doesn't contains Regex information. for informix copy the links to browser, url changes to --> http://www.ibm.com/developerworks/data/zones/informix/library/techarticle/db_regexp.html ,may we change to it directly. for db2 copy the links to browser, url changes to--> http://www.ibm.com/developerworks/data/library/techarticle/0301stolze/0301stolze.html , may we change to it directly. may be we can change it to this one directly.",5 TDQ-10547,"Year /Quarter/Month/Week/Date Low Frquency indicators should show result with count asc","1. create a column analysis , add a date type column. 2. add all date indicators under Advanced Statictics. 3. run the analysis, go to ""Analysis Results"" page to check the result Expected Result: Frequency Indicators should show result with count desc, Low Frequency Indicators should show result with count asc. Actual Result: Low Frequency Indicators show result with count desc. NOTE: in report it is correct.",1 TDQ-10552,"Reorganize the ""new analysis"" wizard layout","From my point of view, there are the following levels of profiling: - column analysis: all indicators are computed against a single column (our editor helps the user to do this on several columns, but each column is analyzed separately and independently). In an analogy with an excel file, I'd say that we focus on a column and analyze each cell of the column. - Table analysis: the analysis grain is the row. We want to know whether several rows are identical or similar for instance. This groups all the analyses below the ""Table analysis"" folder. -- A row is a set of cells that belong to all columns. In this kind of analysis, the row is the indivisible element that we analyze. -- In our studio, we allow the user to choose which columns to focus on. We do a ""partial"" table analysis in the sense that the indivisible element is not a full row, but a set of cells (belonging to several columns, but not all columns). - Cross table analysis: this kind of analysis looks into several tables. The redundancy analysis is an example where you want to check the relationship between two tables (can be used also as foreign key discovery). - Structural analysis In the ""New Analysis"" wizard, here is a cleaner way to present things: - Structural Analysis -- Connection Overview Analysis -- Catalog Overview Analysis -- Schema Overview Analysis - Cross Table Analysis -- Redundancy Analysis - Table Analysis -- Business Rule Analysis -- {color:blue}Match Analysis {color} -- {color:blue}Functional Dependency Analysis {color} -- {color:blue}Column Set Analysis {color} - Column Analysis -- Semantic Discovery Analysis (or Semantic-Aware Analysis) -- Empty Single Column Analysis -- Nominal Values Analysis -- Pattern Frequency Analysis -- Discrete Data Analysis -- Summary Statistics Analysis - Correlation Analysis -- {color:blue}Numerical Correlation Analysis {color} -- {color:blue}Time Correlation Analysis {color} -- {color:blue}Nominal Correlation Analysis {color} The blue analyses can apply to a subset of columns (partial table analysis). In the UI, don't use colors, we don't need to distinguish these analyses. The blue color is only here to highlight the fact that these analyses will now be in only one folder (some of them were in two folders before). Note: the Semantic analysis must not appear in TOS DQ. ",13 TDQ-10555,"Activate Exchange indicators and regexes and rules for 6.1","Upgrade the following extensions in Talend Exchange. the list of Exchange comes from https://jira.talendforge.org/browse/TDQ-9003 Exchange * {color:red} 14 Indicators{color} ** Duplicate Rows (x) ** EMail validation via mail server (x) ** Frequency table of hours (/) ** ISO Week Number Frequency (/) ** Length Range Frequency (/) ** Order of Magnitude (/) ** Sample Standard Deviation (/) ** -Not Trimmed Text- (x) -> incompatible ** Trimmed (/) ** US_customers_count (/) ** Variance (/) ** Week Frequency (/) ** email_indicator (/) ** phone_area_code_freq (/) ** udi_average_yearly_income (/) * {color:red} 1 ParserRule{color} ** Tweets (/) * {color:red} 5 Regexes{color} ** Only alphabetical characters not empty ** Repeated Character ** Unaccented Words ** Words ** Text ** Email Address (with list of top-level domains) ** Regular Text ** FR Phone Number (parenthesis allowed) ** Names_with_unicode_characters ** Dutch_Phone_Number_(_Local_or_International_) ** Dutch_Postal_Code ** Minutes:Seconds ** Temperature in Celsius (/) * {color:red} SQL{color} ** hotmail email (/) means: tested with 6.0 and was ok (x) means: not tested with 6.0. To be tested ",3 TDQ-10557,"Allow set threshold option on UDI","Current user defined indicator can't set options like threshold value, it's useful to allow this.",8 TDQ-10571,"Export babili translations into git (for 6.0.1)",NULL,2 TDQ-10614,"Improve robustness of the matching algorithm in tMatchGroup and match analysis","tMatchGroup: store the key of the master on the disk. Also, adapt the match analysis to this new feature.",8 TDQ-10641,"Semantic Discovery Wizard Improvements (Step 1)","The Semantic Discovery Wizard contains many settings / options / definitions. We had to get Sebastiao to explain the purpose of each of these. Customers will need tooltips / help icons to explain how to use / understand the wizard . This is important from a usability perspective. - ""Meaning"" should be replaced by ""category"". Tooltip on the meaning cell: content analysis categorization ",13 TDQ-10690,"Create new Pattern frequency indicators for Japanese characters","h3. high level description of the feature A new ""East Asia Pattern frequency"" indicator will be added to the system indicators in the pattern finder folder. Actually, two new indicators must be created: - the regular top n frequency indicator - and the low frequency indicator This indicator gives the same results as the Pattern Frequency indicator when the characters are latin characters. When values contain Japanese character, there is distinction between Hiragana, Katagana and Kanji characters. These characters are represented by H,K,C for uppercase characters, respectively and h,k,c for lowercase characters. This indicator is primarily a java indicator. As a system indicator, it will appear in the DQ repository view and in the indicator selection dialog. h3. technical information We currently use a pattern 'language' to describe the alpha chars with an 'a' and numerics with a '9'. We need to extend this language for: ||Character Type||Unicode Range||Replacement|| |Hiragana|\u3040-\u309F|use 'H' for regular chars, and 'h' for small chars| |Katakana|\u30A0-\u30FF|use 'K' for regular chars, and 'k' for small chars| |Katakana Phonetic Extensions|\u31F0-\u31FF|all of them are small chars, use 'k'| |Halfwidth Katakana|\uFF66-\uFF9F|use 'K' for regular chars, and 'k' for small chars| |Fullwidth Latin Numbers|\uFF10-\uFF19|use '9'| |Fullwidth Latin Uppercased Letters|\uFF21-\uFF3A|use 'A'| |Fullwidth Latin Lowercased Letters|\uFF41-\uFF5A|use 'a'| |Kanji|\u4E00-\u9FFF|use the letter 'C' for chinese, since 'k' is already taken| |Hangul|\uAC00-\uD7AF|use the letter 'G' for hangul, since 'H' is already taken| In case there are regular and small chars, one possible implementation is to use the range to determine the type firstly, and then use a static string which lists all small chars to see if the input char can be found in it, use the small h or k if found and big H or K if not found. This would be faster than using a replacement table, and make the code easier to maintain. However, for Fullwidth Latin Numbers and Letters, it looks better to use a simple replacement table as before. * We would keep ** 'a' for ascii latin chars ** 9 for ascii digits ** any other char/symbol will be kept as it is Useful links: https://gist.github.com/terrancesnyder/1345094 http://stackoverflow.com/questions/10809176/regular-expressions-regex-in-japanese http://www.localizingjapan.com/blog/2012/01/20/regular-expressions-for-japanese-text/ http://stackoverflow.com/questions/6787716/regular-expression-for-japanese-characters In Java, we can use the regex replace function to replace all characters. {code:java} public static void main(String[] args) { String value = ""salut, comment ça va! 1 rue ""; String regex = ""[a-z]""; Matcher lowercase = Pattern.compile(regex).matcher(value); Matcher numeric = Pattern.compile(""cat"").matcher(value); System.out.println(numeric.replaceAll(lowercase.replaceAll(""a""))); } {code} In SQL, we need to search in the document of each database whether they natively support the replace function or not. It seems that MysQL does not, but needs a UDF instead. ",20 TDQ-10718,"Semantic analysis improvements","h3. add checks with wordnet before adding attributes into the ontology (UI interaction required) See some existing code https://github.com/Talend/tdq-siq/blob/master/JenaSemProject/src/org/talend/ontology/matching/WorNetVerification.java -- add a new wizard page after the action page and before the new analysis page (see mockup) -- move the ""run enrichment"" button to this page -- move the ""enrichment report"" to this page too. -- the new page will list all actions with a validation status --- the user must confirm each action with the ""run enrichment"" button --- when we switch from the action page to this page, the status of each action is computed as follows: ---- when the field words to add in the ontology do not exist in wordnet, then the status is invalid with a warning icon. ---- when the field words exist in wordnet and does not exist already in the ontology repository, then the status is valid. ---- when the field words exist in wordnet and already exist in the ontology repository, then the status is invalid (with a red cross icon). --- By default, the confirmation checkboxes of all valid actions are checked and those of the invalid actions are unchecked. --- the user can confirm the addition of fields with an invalid status if he wants to force the addition of this field into the ontology (except when the attribute name already exists in the ontology - invalid with red cross - In this case, the checkbox must be disabled). --- the enrichment (with all confirmed actions) happens when the user clicks on the ""run enrichment"" button. --- after the enrichment, a log is written to the ""enrichment report"" --- the table can be sorted when click on the header (action column, ""validation status"" column or the ""confirm"" column) h4. Tooltips: -- on the valid icon, add the following tooltip text: ""This attribute can be added to the selected concept in the ontology repository. Use the checkbox to confirm."" -- on the triangle icon (invalid wordnet validation), add the following tooltip text: ""This attribute name may not be correct. Please, make sure it's correctly written. Use the checkbox if you still want to add it to the selected concept in the ontology repository."" -- on the invalid icon (red cross), add the following tooltip text: ""This attribute already exists in the selected concept in the ontology repository. "" ",20 TDQ-10723,"Support Git Repository","See TDI-24786 and impacts on the DQ repository",13 TDQ-10734,"Support semantic discovery on file delimited","As a user, I want to have the exact same ""Semantic Discovery"" menus on a table or a set of columns in a file delimited connection. The behavior will be the same as on a database. ",8 TDQ-10746,"start TOS_DQ get errors in error log","1. start TOP build. do nothing just click ""File""-->exit. 2. start the studio again, on welcome page click ""Start Now"". 3. on the cheat sheet close ""x"" to close it. check the error log, there is errors about org.talend.dataprofiler.core.ui.editor.PartListener - java.lang.NullPointerException and java.lang.NullPointerException refer to the file attached ",2 TDQ-10754,"run Column Content Comparison analysis successfully, but run report failed, show exceptions","- create a Column Content Comparison analysis - select a PK as the column - select the same column in ColumnSetA and ColumnSetB - run analysis successfully - run report failed, got the following exception {code} java.lang.NullPointerException net.sf.jasperreports.engine.JRAbstractExporter.setJasperPrint(JRAbstractExporter.java:862) net.sf.jasperreports.engine.JRAbstractExporter.setInput(JRAbstractExporter.java:930) net.sf.jasperreports.engine.export.JRPdfExporter.exportReport(JRPdfExporter.java:293) org.talend.dataquality.reporting.JasperReportBuilder.run(JasperReportBuilder.java:300) org.talend.dataquality.reporting.engine.ReportDocGenerator.generateReport(ReportDocGenerator.java:672) org.talend.dataquality.reporting.engine.ReportDocGenerator.generateDoc(ReportDocGenerator.java:406) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generateDocInternal(LocalReportDocGenerator.java:172) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.access$1(LocalReportDocGenerator.java:171) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator$2.run(LocalReportDocGenerator.java:160) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:93) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:256) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3210) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1977) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generateDoc(LocalReportDocGenerator.java:165) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:287) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generate(LocalReportDocGenerator.java:130) org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$2.run(GenerateReportFileAction.java:336) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) net.sf.jasperreports.engine.fill.JRExpressionEvalException: Error evaluating expression : Source text : $V{tableNameList}.get($V{COLUMN_COUNT}-1) net.sf.jasperreports.engine.fill.JREvaluator.evaluate(JREvaluator.java:203) net.sf.jasperreports.engine.fill.JRCalculator.evaluate(JRCalculator.java:591) net.sf.jasperreports.charts.fill.JRFillCategorySeries.evaluate(JRFillCategorySeries.java:149) net.sf.jasperreports.charts.fill.JRFillCategoryDataset.customEvaluate(JRFillCategoryDataset.java:115) net.sf.jasperreports.engine.fill.JRFillElementDataset.evaluate(JRFillElementDataset.java:148) net.sf.jasperreports.engine.fill.JRCalculator.calculateVariables(JRCalculator.java:160) net.sf.jasperreports.engine.fill.JRVerticalFiller.fillDetail(JRVerticalFiller.java:765) net.sf.jasperreports.engine.fill.JRVerticalFiller.fillReportContent(JRVerticalFiller.java:308) net.sf.jasperreports.engine.fill.JRVerticalFiller.fillReport(JRVerticalFiller.java:155) net.sf.jasperreports.engine.fill.JRBaseFiller.fill(JRBaseFiller.java:909) net.sf.jasperreports.engine.fill.JRBaseFiller.fill(JRBaseFiller.java:822) net.sf.jasperreports.engine.fill.JRFiller.fill(JRFiller.java:61) net.sf.jasperreports.engine.JasperFillManager.fill(JasperFillManager.java:446) net.sf.jasperreports.engine.JasperFillManager.fillReport(JasperFillManager.java:849) org.talend.dataquality.reporting.JasperReportBuilder.createSubReport(JasperReportBuilder.java:433) org.talend.dataquality.reporting.JasperReportBuilder.run(JasperReportBuilder.java:242) org.talend.dataquality.reporting.engine.ReportDocGenerator.generateReport(ReportDocGenerator.java:672) org.talend.dataquality.reporting.engine.ReportDocGenerator.generateDoc(ReportDocGenerator.java:406) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generateDocInternal(LocalReportDocGenerator.java:172) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.access$1(LocalReportDocGenerator.java:171) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator$2.run(LocalReportDocGenerator.java:160) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:93) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:256) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3210) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1977) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generateDoc(LocalReportDocGenerator.java:165) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:287) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generate(LocalReportDocGenerator.java:130) org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$2.run(GenerateReportFileAction.java:336) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1 java.util.ArrayList.rangeCheck(ArrayList.java:653) java.util.ArrayList.get(ArrayList.java:429) b07_match_basic_1438248718130_500771.evaluate(b07_match_basic_1438248718130_500771:414) net.sf.jasperreports.engine.fill.JREvaluator.evaluate(JREvaluator.java:190) ... 29 more {code}",2 TDQ-10795,"""Deploy Jar"" dialog set wrong username/password click ""..."", set correct one pop up ""Password Required"" dialog doesn't work","1. create a job, add tBRMS component. 2. set drools server information, make sure username or password is not correct. 3. click ""..."" for ""Module List"" 4. on the pop up ""Deploy Jar"" dialog click ""..."" 5. get error dialog ""Authentication failed"", click ""OK"" on it. 6. get ""Password Required"" dialog , set correct information, but pop up the ""Password Required"" dialog again. Expected Result: ""Password Required"" dialog should works or remove it or make it work workaround: click ""cancel"" on the ""Password Required"" dialog, and set correct one on the ""Deploy Jar""(set here will not reflect to component tab TDQ-8418) dialog or component tab.",2 TDQ-10803,"The ""Select Indicators"" dialog can not be opened when set correct context value for Where Clause ","1.Create column analysis.(do not add indicator first) 2.Create context variable name and set correct value for it. 3.Add context value in the Where clause. 4.Select ""Select Indicators"" button. Expected result: The dialog should be opened. Actual result: The error message dialog shows.see attachment.",1 TDQ-10804,"improve patterns IPv6 and ISBN-13","after TDQ-10686 , 1. the new pattern ""IPv6"" doesn't work with oracle. it will pop an error . it works well on mySql/postgreSql/Java 2.ISBN_13 isn't added. {code} '^ISBN(?:-13)?:?\\ *(97(?:8|9)([ -]?)(?=\\d{1,5}\\2?\\d{1,7}\\2?\\d{1,6}\\2?\\d)(?:\\d\\2*){9}\\d)$'. {code} This regex doesn't work for Mysql/oracle/postgresql.",8 TDQ-10806,"users shouldn't see a plethora of internal TODO Tasks","The final exercise in the DQ Basics class, i.e., Managing Tasks, directs the student to open the Tasks view saying: ""Here is where you can view and act on all tasks in this project. Note that the tasks you just created appear here."", however, the tasks the student just created are riddled with tasks the student did not just create labelled as TODO and appear as a side affect of the state of some internal objects. Michaël Hirt indicated to me on 15Jun2015 that Tasks are only used in the DQ product where it's silly to not pre-filter them so that users do not see the internal TODO Tasks. He further indicated he would ""handle that with DQ team"", however, 2MOS later, I see no evidence of such action being taken, therefore, I'm doing the responsible thing and creating a DQ Work Item. I'm giving this a Priority of Major as it doesn't look good to DQ Basics Students. If no development action will be taken, this needs to be handed off to training development to remove the exercise.",8 TDQ-10840,"with a new studio, report can not run before restart the studio(TP_All license)","1. start a new studio which never used before--use TP_All license. 2. create a report with a mysql column analysis. set report mysql datamart, create a new datamart. 3. generate report. Expected Result: report can not run. {code} java.lang.NullPointerException net.sf.jasperreports.engine.JRAbstractExporter.setJasperPrint(JRAbstractExporter.java:862) net.sf.jasperreports.engine.JRAbstractExporter.setInput(JRAbstractExporter.java:930) net.sf.jasperreports.engine.export.JRPdfExporter.exportReport(JRPdfExporter.java:293) org.talend.dataquality.reporting.JasperReportBuilder.run(JasperReportBuilder.java:300) org.talend.dataquality.reporting.engine.ReportDocGenerator.generateReport(ReportDocGenerator.java:672) org.talend.dataquality.reporting.engine.ReportDocGenerator.generateDoc(ReportDocGenerator.java:406) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generateDocInternal(LocalReportDocGenerator.java:172) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.access$1(LocalReportDocGenerator.java:171) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator$2.run(LocalReportDocGenerator.java:160) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:93) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:256) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3227) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1994) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generateDoc(LocalReportDocGenerator.java:165) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:287) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generate(LocalReportDocGenerator.java:130) org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$2.run(GenerateReportFileAction.java:342) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) java.lang.ClassCastException: org.apache.xerces.util.XMLGrammarPoolImpl cannot be cast to org.apache.xerces.xni.grammars.XMLGrammarPool org.apache.xerces.impl.xs.XMLSchemaLoader.reset(Unknown Source) org.apache.xerces.impl.xs.XMLSchemaValidator.reset(Unknown Source) org.apache.xerces.parsers.XML11Configuration.configurePipeline(Unknown Source) org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) org.apache.xerces.parsers.XMLParser.parse(Unknown Source) org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) org.apache.commons.digester.Digester.parse(Digester.java:1892) net.sf.jasperreports.engine.xml.JRXmlLoader.loadXML(JRXmlLoader.java:243) net.sf.jasperreports.engine.xml.JRXmlLoader.loadXML(JRXmlLoader.java:230) net.sf.jasperreports.engine.xml.JRXmlLoader.load(JRXmlLoader.java:218) net.sf.jasperreports.engine.xml.JRXmlLoader.load(JRXmlLoader.java:172) net.sf.jasperreports.engine.xml.JRXmlLoader.load(JRXmlLoader.java:156) org.talend.dataquality.reporting.JasperReportBuilder.createSubReport(JasperReportBuilder.java:396) org.talend.dataquality.reporting.JasperReportBuilder.run(JasperReportBuilder.java:242) org.talend.dataquality.reporting.engine.ReportDocGenerator.generateReport(ReportDocGenerator.java:672) org.talend.dataquality.reporting.engine.ReportDocGenerator.generateDoc(ReportDocGenerator.java:406) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generateDocInternal(LocalReportDocGenerator.java:172) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.access$1(LocalReportDocGenerator.java:171) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator$2.run(LocalReportDocGenerator.java:160) org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:93) org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:256) org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3227) org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:1994) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generateDoc(LocalReportDocGenerator.java:165) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:287) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generate(LocalReportDocGenerator.java:130) org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$2.run(GenerateReportFileAction.java:342) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) {code} ",1 TDQ-10844,"Improve charts look & feel","Aim: use Talend colors in the statistical charts See the palette at https://jira.talendforge.org/secure/attachment/85353/chart-palette.png The colors must be taken in order (blue, green, red...). This means: - Default bar charts that were red must be blue now (frequency tables, blocking key distribution, ...) - The benford law chart should have blue bars and green dots. - the Box plot should be blue (keep average and median in black or try green if not visible enough - please screen capture each solution in order to compare them) - for the duplicate statistics, the matched records should be blue, the suspects records red, the unique records green - the match analysis group frequency chart should display all colors of the palette in the given order - the same chart of the tMatchGroup component should have the same display - the key frequency profile in the tGenKey component must use the blue color. - for pattern matching charts (and similar indicators like redundancy or functional dependencies): the matching percentage should be green and the non matching percentage should be red. - make sure to check UDI charts too and all other chart I may have forgotten",8 TDQ-10848,"Enable Semantic Discovery on Hive","Enable Semantic Discovery wizard on Hive tables",5 TDQ-10854,"command line project import the attached items(report about java udi, pattern) can not run","1. start a command line project. 2. import the attached project: importItems H:/aa/pattern_udi_2.zip -o issue 1. after import finished in the zip file path, get a folder ""pattern_udi_2"" same with the zip file name.-- should not(studio import no this folder at the end, import a zip file only have a job, no this issue.) issue 2. if import items from an project: studioPath/workspace/project1 in command line project will get an temp folder will not delete 3. try to run the imported report, can not, get error refer to the pic attached. NOTE: if report about analysis only contains simple indicators, can run well. Expected Result: after import finished the temp folder should be delete-- issue 1 and issue2 report imported should run well---step 3 ERROR org.talend.datacleansing.core.service.TDQReportService - INFO org.talend.datacleansing.core.service.TDQReportService - Generated successfully, the report document is store in null ",2 TDQ-10858,"Match Data job and Deduplicate Data job in cheat sheet can not select output as some dbs--can not show db parameters","1. try to follow the wizard ""Match Data"" to create job but issue 1. when select file for lookup, select create new file connection and dbconnection , after connection created get error in error log. besides if select dbconnection will close the cheat sheet. org.talend.datacleansing.core.ui.jobs.dynamic.DynamicJobBuilder - Command Create Node can't be executeable! issue 2. for output if select Database, can not show the database parameter as before, and get error in error log. {code} org.eclipse.swt.SWTException: Failed to execute runnable (java.lang.NullPointerException) org.eclipse.swt.SWT.error(SWT.java:4441) org.eclipse.swt.SWT.error(SWT.java:4356) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:139) org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4147) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3764) org.eclipse.jface.window.Window.runEventLoop(Window.java:832) org.eclipse.jface.window.Window.open(Window.java:808) org.talend.datacleansing.core.ui.actions.match.MatchDataJobAction.run(MatchDataJobAction.java:97) org.talend.datacleansing.core.ui.jobs.dynamic.ADynamicJobAction.run(ADynamicJobAction.java:47) org.eclipse.ui.internal.cheatsheets.ActionRunner.runAction(ActionRunner.java:86) org.eclipse.ui.internal.cheatsheets.data.Action.execute(Action.java:100) org.eclipse.ui.internal.cheatsheets.views.CoreItem.runExecutable(CoreItem.java:506) org.eclipse.ui.internal.cheatsheets.views.CoreItem.runExecutable(CoreItem.java:501) org.eclipse.ui.internal.cheatsheets.views.CheatSheetViewer.runPerformExecutable(CheatSheetViewer.java:1046) org.eclipse.ui.internal.cheatsheets.views.CoreItem$1.linkActivated(CoreItem.java:89) org.eclipse.ui.forms.widgets.AbstractHyperlink.handleActivate(AbstractHyperlink.java:233) org.eclipse.ui.forms.widgets.ImageHyperlink.handleActivate(ImageHyperlink.java:199) org.eclipse.ui.forms.widgets.AbstractHyperlink.handleMouseUp(AbstractHyperlink.java:327) org.eclipse.ui.forms.widgets.AbstractHyperlink.access$2(AbstractHyperlink.java:311) org.eclipse.ui.forms.widgets.AbstractHyperlink$4.handleEvent(AbstractHyperlink.java:125) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:168) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) Caused by: java.lang.NullPointerException org.talend.datacleansing.core.ui.jobs.dynamic.ui.AOutputPropertyPage$2$1.run(AOutputPropertyPage.java:325) org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:136) ... 43 more {code}",2 TDQ-10862,"Proxy Configuration on Additional Talend Packages screen does not go to Proxy Configuration","On the Additional Talend Packages screen, there is a button that has ""Proxy Configuration"". When you click on the button, it takes you to the General Preferences. This is for TOS DQ. ================================== what need to do: in TOS DQ, in the ""Additional Talend Packages"" dialog, when user click ""Proxy configuration..."" button, should open Preferences dialog and show ""General->Network Connections"" page, just like TalendAll.png",1 TDQ-10869,"Create unit tests for each function in EcosystemService","EcosystemServiceTest must test all methods of EcosystemService. ",5 TDQ-10880,"Create version 6.0.1 in Babili and populate it",NULL,2 TDQ-10882,"Export babili translations into git (for 6.0.2)",NULL,2 TDQ-10884,"Export babili translations into git (for 6.1.0M2)",NULL,2 TDQ-10886,"Create version 6.1.0M1 in Babili and populate it",NULL,2 TDQ-10888,"DQ libraries refactoring","The current dependencies must be cleansed: org.talend.datascience.common depends currently on too many projects: dataquality.semantics (which depends itself on dataquality.sampling) and record.linkage. To do : - -Create a folder called ""libraries"" below tdq-studio-se/main/ and tdq-studio-ee/main/- -These folders will contains- DQ libraries: -- org.talend.dataquality.common (should we rename datascience.common?) -- org.talend.dataquality.statistics -- org.talend.dataquality.semantics -- org.talend.dataquality.sampling -- org.talend.dataquality.record.linkage -Each of these library can be built and have a lifecycle independent of the studio lifecycle.- -These libraries will be deployed to nexus and the studio will use them just like external jar files.- - datascience.common should be the lowest level library and depend on very commonly used libraries only. Therefore, -- the SemanticAnalyzer should not appear in this project but it's should be moved into the dataquality.semantics project instead. -- the StringsClusterAnalyzer must be moved to the record.linkage library. - record.linkage should depend on datascience.common - dataquality.semantics must depend on datascience.common - dataquality.sampling have unused dependencies: remove the csv and googlephone library dependencies. ",8 TDQ-10890,"The ""Engines management"" menu can NOT be seen for the tdq_admin user for dqportal",NULL,5 TDQ-10901,"Some labels are not readable in the semantic wizard","See attached screen capture. Environment: - linux opensuse - build : 6.0.1.20150827_1701 - license TP_BD",5 TDQ-10911,"Create version 6.1.0M2 in Babili and populate it",NULL,2 TDQ-10913,"Export babili translations into git (for 6.1.0RC1)",NULL,2 TDQ-10926,"Activate Exchange indicators and regexes and rules for 6.2","Upgrade interesting extensions in Talend Exchange. the list of Exchange from https://jira.talendforge.org/browse/TDQ-9003 Exchange * {color:red} 14 Indicators{color} ** Duplicate Rows (x) ** EMail validation via mail server (x) ** Frequency table of hours (/) ** ISO Week Number Frequency (/) ** Length Range Frequency (/) ** Order of Magnitude (/) ** Sample Standard Deviation (/) ** Trimmed (/) ** US_customers_count (/) ** Variance (/) ** Week Frequency (/) ** email_indicator (/) ** phone_area_code_freq (/) ** udi_average_yearly_income (/) * {color:red} 1 ParserRule{color} ** Tweets (/) * {color:red} 5 Regexes{color} ** Only alphabetical characters not empty ** Repeated Character ** Unaccented Words ** Words ** Text ** Email Address (with list of top-level domains) ** Regular Text ** FR Phone Number (parenthesis allowed) ** Names_with_unicode_characters ** Dutch_Phone_Number_(_Local_or_International_) ** Dutch_Postal_Code ** Minutes:Seconds ** Temperature in Celsius (/) * {color:red} SQL{color} ** hotmail email ",3 TDQ-10931,"Could we consider making the tMatchGroup component more user-friendly?","Would it be possible to edit the rules of a tMatchGroup-component without having to open the preview? For example, when using the tRecordMatching-component(see image tRecordMatching.png), we can edit the rules in the basic settings-tab of the component. We have to wait a very long time (multiple minutes) for the preview to open and during that time we cannot do anything else in studio. When we double click the tMatchGroup-component to open the wizard, it will take some time to open, we could click on the ""Cancel"" button, which will stop the data flow used in the tMatchGroup and will directly open the configuration wizard. If we click ""Cancel"", it stops and don't display charts and we can edit the rules.(see image Image1.png and Image2.png) It would be great if we could make it more user friendly just as tRecordMatching-component(see image tRecordMatching.png) instead of pushing a ""Cancel"" button to avoid the waiting time. ",3 TDQ-10932,"All occurences of the word ""Guvnor"" needs to be deleted from the BRMS wizard and the components","the word ""Guvnor"" has bee removed from Drools UI in TAC. some occurrences of Guvnor are still present in the wizard used to create BRMS from the studio + and in the basic settings of tBRMS component",3 TDQ-10933,"Hide the Exchange node","when the system property ""talend.hide.exchange=true"", the ""Exchange"" node in the DQ repository view must not be visible. also will not show in the import/export dialog and the toolbar See https://in.talend.com/1646519",5 TDQ-10961,"""generate an ETL Job to handle rows"" generated job can not run directly(inform no database set, in fact it set), need to reopen it","1. create a mysql connection set database filter. 2. create a column analysis about the connection, add a pattern, run analysis. 3. on analysis Result page, right click on pattern-->Generate Job on pop up dialog select ""generate an ETL Job to handle rows"" the job generated but can not run directly. reopen it works Expected Result: job should run without reopen it. {code} Starting job PatternRows_1441789279042 at 17:01 09/09/2015. [statistics] connecting to socket on port 3899 [statistics] connected Exception in component tMysqlInput_1 java.sql.SQLException: No database selected com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1074) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4096) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4028) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2490) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2651) com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2728) com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2678) com.mysql.jdbc.StatementImpl.executeQuery(StatementImpl.java:1612) test5.patternrows_1441789279042_0_1.PatternRows_1441789279042.tMysqlInput_1Process(PatternRows_1441789279042.java:389) test5.patternrows_1441789279042_0_1.PatternRows_1441789279042.runJobInTOS(PatternRows_1441789279042.java:705) test5.patternrows_1441789279042_0_1.PatternRows_1441789279042.main(PatternRows_1441789279042.java:539) [FATAL]: test5.patternrows_1441789279042_0_1.PatternRows_1441789279042 - tMysqlInput_1 No database selected [statistics] disconnected Job PatternRows_1441789279042 ended at 17:01 09/09/2015. [exit code=1] {code}",1 TDQ-10982,"run column analysis on file connection will show several warning dialogs and these dialog close quickly","run one file connection on the column analysis will have some dialog close auto. 1.the column type should be int. 2.the indicator should be mean or other frequency indicator. when execute the analysis will have a warnning dialog display and close at once ",5 TDQ-11000,"the display of x axis label is not aligned","- Match Analysis - tGenKey",5 TDQ-11007,"Create version 6.1.0RC1 in Babili and populate it",NULL,2 TDQ-11014,"Export babili translations into git (for 6.1.0)",NULL,2 TDQ-11028,"right click on more than one table/view, should not show ""Semantic Discovery"" menu","1. create a connection unfold to show its tables,view. right click on more than one table/view show the Semantic Discovery menu should not, now on the pop up wizard only show columns from one table/view, but we'd better not show this menu.",2 TDQ-11036,"Remove the ""Exchange"" node from the export items wizard","check also the import items. There is no need to have this node appearing in the ""export items"" wizard",1 TDQ-11037,"Report editor improvements","# Change the ""Generate Report File"" to ""Execute Report"" in the tooltip of the button in the report editor toolbar. Do this at the other existing places: contextual menu on the report item. # update the tooltip of the question mark: switch the 2 sentences. # replace ""no report file to be previewed."" with ""There is no report to see. You must select the ""Generate output file"" and execute the report. """,1 TDQ-11039,"Replace ""Cancel"" by ""Stop"" in the progress dialog of Reservoir sampling",NULL,1 TDQ-11040,"Semantic discovery wizard headers","Improve the descriptions given in the wizard pages of the semantic discovery wizard. See subtasks",1 TDQ-11058,"New analysis wizard issue","*Help content issue:* issue 1 step 1 . click ""Column Analysis"" folder check help content: The analyses in this folder enables you ... step 2. click ""Correlation Analysis"" folder check help content: The analyses in this folder are exploratory analyses.... the two sentence use ""enables"" and ""are"" , should unify them, change ""enables"" to ""enable"" ? issue 2. click ""Nominal Values Analysis"" check help content: This analysis analyzes enables you to analyze nominal data. should remove ""analyzes "" in this sentence ? *Analysis editor title issue * for ""Business Rule Analysis"" still show ""Table Analysis"" in analysis editor. *Next, Finish status issue* issue 1. for ""Nominal Value analysis, Discrete Data analysis and Summary Statistics Analysis"" must select analyzed columns, should ""Pattern Frequency Analysis"" do same, now after set analysis name can click ""Finish"" directly. issue 2 when analysis type select ""Semantic Discovery Analysis"" (1). second page --set analysis name page, before/after set analysis name ""Finish"" should not be available. (2). third page---select analyzed columns page, before/after select analyzed columns, ""Finish"" should not be available (3). fourth page-- get category page, ""Finish"" should not be available. (4). sixth page--page of set action for each column when all action set ""Do nothing"" ""Next"" should not be available ",3 TDQ-11059,"TOS_DQ also show Semantic Discovery help content.","1. check the analysis wizard, click ""Column Analysis"" folder or ""Blank Column Analysis” check help content, there is link to ""Semantic Discovery Analysis"", click it will show content of it. should not show this on TOS_DQ.",3 TDQ-11082,"re-created semantic analysis can not open if create one and add all indicators for all columns first.","1. create a mysql connection about tbi database. 2. right click on table ""employee""-->Semantic Discovery 3. on the first page for employee_id column set ""Address"" as category, goes to second page, Person concept selected as default. and for ""employee_id"" semantics set ""Address"", go to third page, click ""Finish"" analysis create successfully. 4. in the created analysis make sure employee_id column set ""Datamining Type"" as ""Interval"" , add all available indicators for the columns. run the analysis. 5. re-do step 2 and step3. analysis created but can not open correctly. {code} java.lang.NullPointerException org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.dispose(AnalysisEditor.java:567) org.eclipse.ui.internal.e4.compatibility.CompatibilityPart.createPartControl(CompatibilityPart.java:147) org.eclipse.ui.internal.e4.compatibility.CompatibilityEditor.createPartControl(CompatibilityEditor.java:99) org.eclipse.ui.internal.e4.compatibility.CompatibilityPart.create(CompatibilityPart.java:327) sun.reflect.GeneratedMethodAccessor77.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.e4.core.internal.di.MethodRequestor.execute(MethodRequestor.java:55) org.eclipse.e4.core.internal.di.InjectorImpl.processAnnotated(InjectorImpl.java:888) org.eclipse.e4.core.internal.di.InjectorImpl.processAnnotated(InjectorImpl.java:869) org.eclipse.e4.core.internal.di.InjectorImpl.inject(InjectorImpl.java:120) org.eclipse.e4.core.internal.di.InjectorImpl.internalMake(InjectorImpl.java:337) org.eclipse.e4.core.internal.di.InjectorImpl.make(InjectorImpl.java:258) org.eclipse.e4.core.contexts.ContextInjectionFactory.make(ContextInjectionFactory.java:162) org.eclipse.e4.ui.internal.workbench.ReflectionContributionFactory.createFromBundle(ReflectionContributionFactory.java:104) org.eclipse.e4.ui.internal.workbench.ReflectionContributionFactory.doCreate(ReflectionContributionFactory.java:73) org.eclipse.e4.ui.internal.workbench.ReflectionContributionFactory.create(ReflectionContributionFactory.java:55) org.eclipse.e4.ui.workbench.renderers.swt.ContributedPartRenderer.createWidget(ContributedPartRenderer.java:127) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.createWidget(PartRenderingEngine.java:983) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.safeCreateGui(PartRenderingEngine.java:662) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.safeCreateGui(PartRenderingEngine.java:766) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.access$2(PartRenderingEngine.java:737) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$7.run(PartRenderingEngine.java:731) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.createGui(PartRenderingEngine.java:715) org.eclipse.e4.ui.workbench.renderers.swt.StackRenderer.showTab(StackRenderer.java:1250) org.eclipse.e4.ui.workbench.renderers.swt.LazyStackRenderer$1.handleEvent(LazyStackRenderer.java:68) org.eclipse.e4.ui.services.internal.events.UIEventHandler$1.run(UIEventHandler.java:40) org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:187) org.eclipse.ui.internal.UISynchronizer.syncExec(UISynchronizer.java:156) org.eclipse.swt.widgets.Display.syncExec(Display.java:4734) org.eclipse.e4.ui.internal.workbench.swt.E4Application$1.syncExec(E4Application.java:218) org.eclipse.e4.ui.services.internal.events.UIEventHandler.handleEvent(UIEventHandler.java:36) org.eclipse.equinox.internal.event.EventHandlerWrapper.handleEvent(EventHandlerWrapper.java:197) org.eclipse.equinox.internal.event.EventHandlerTracker.dispatchEvent(EventHandlerTracker.java:197) org.eclipse.equinox.internal.event.EventHandlerTracker.dispatchEvent(EventHandlerTracker.java:1) org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230) org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:148) org.eclipse.equinox.internal.event.EventAdminImpl.dispatchEvent(EventAdminImpl.java:135) org.eclipse.equinox.internal.event.EventAdminImpl.sendEvent(EventAdminImpl.java:78) org.eclipse.equinox.internal.event.EventComponent.sendEvent(EventComponent.java:39) org.eclipse.e4.ui.services.internal.events.EventBroker.send(EventBroker.java:81) org.eclipse.e4.ui.internal.workbench.UIEventPublisher.notifyChanged(UIEventPublisher.java:59) org.eclipse.emf.common.notify.impl.BasicNotifierImpl.eNotify(BasicNotifierImpl.java:374) org.eclipse.e4.ui.model.application.ui.impl.ElementContainerImpl.setSelectedElement(ElementContainerImpl.java:171) org.eclipse.e4.ui.internal.workbench.ModelServiceImpl.showElementInWindow(ModelServiceImpl.java:488) org.eclipse.e4.ui.internal.workbench.ModelServiceImpl.bringToTop(ModelServiceImpl.java:454) org.eclipse.e4.ui.internal.workbench.PartServiceImpl.delegateBringToTop(PartServiceImpl.java:694) org.eclipse.e4.ui.internal.workbench.PartServiceImpl.bringToTop(PartServiceImpl.java:387) org.eclipse.e4.ui.internal.workbench.PartServiceImpl.showPart(PartServiceImpl.java:1134) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditor(WorkbenchPage.java:3210) org.eclipse.ui.internal.WorkbenchPage.access$23(WorkbenchPage.java:3125) org.eclipse.ui.internal.WorkbenchPage$9.run(WorkbenchPage.java:3107) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:3102) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:3066) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:3047) org.talend.dataprofiler.core.CorePlugin.openEditor(CorePlugin.java:245) org.talend.dataquality.ontology.ui.wizard.SemanticDiscoveryWizard.openEditor(SemanticDiscoveryWizard.java:243) org.talend.dataquality.ontology.ui.wizard.SemanticDiscoveryWizard.performFinish(SemanticDiscoveryWizard.java:218) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:853) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:438) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:619) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.jface.window.Window.runEventLoop(Window.java:832) org.eclipse.jface.window.Window.open(Window.java:808) org.talend.dataquality.ontology.service.SemanticStudioServiceImpl.openSemanticDiscoveryWizard(SemanticStudioServiceImpl.java:43) org.talend.dataprofiler.core.ui.action.actions.predefined.SemanticDiscoveryAction.run(SemanticDiscoveryAction.java:54) org.eclipse.jface.action.Action.runWithEvent(Action.java:519) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:595) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:511) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:420) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:183) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) java.lang.NullPointerException org.talend.dataprofiler.core.model.impl.ModelElementIndicatorImpl.fillCategoryIndicators(ModelElementIndicatorImpl.java:381) org.talend.dataprofiler.core.model.impl.ModelElementIndicatorImpl.fillCategoryIndicators(ModelElementIndicatorImpl.java:362) org.talend.dataprofiler.core.model.impl.ModelElementIndicatorImpl.setIndicators(ModelElementIndicatorImpl.java:244) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisDetailsPage.recomputeIndicators(ColumnAnalysisDetailsPage.java:208) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisDetailsPage.initialize(ColumnAnalysisDetailsPage.java:171) org.eclipse.ui.forms.editor.FormPage.(FormPage.java:67) org.talend.dataprofiler.core.ui.editor.AbstractFormPage.(AbstractFormPage.java:52) org.talend.dataprofiler.core.ui.editor.AbstractMetadataFormPage.(AbstractMetadataFormPage.java:145) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.(AbstractAnalysisMetadataPage.java:141) org.talend.dataprofiler.core.ui.editor.analysis.DynamicAnalysisMasterPage.(DynamicAnalysisMasterPage.java:82) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisDetailsPage.(ColumnAnalysisDetailsPage.java:164) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.addPages(AnalysisEditor.java:134) org.talend.dataprofiler.core.ui.editor.CommonFormEditor.createPages(CommonFormEditor.java:125) org.eclipse.ui.part.MultiPageEditorPart.createPartControl(MultiPageEditorPart.java:362) org.eclipse.ui.internal.e4.compatibility.CompatibilityPart.createPartControl(CompatibilityPart.java:141) org.eclipse.ui.internal.e4.compatibility.CompatibilityEditor.createPartControl(CompatibilityEditor.java:99) org.eclipse.ui.internal.e4.compatibility.CompatibilityPart.create(CompatibilityPart.java:327) sun.reflect.GeneratedMethodAccessor77.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.e4.core.internal.di.MethodRequestor.execute(MethodRequestor.java:55) org.eclipse.e4.core.internal.di.InjectorImpl.processAnnotated(InjectorImpl.java:888) org.eclipse.e4.core.internal.di.InjectorImpl.processAnnotated(InjectorImpl.java:869) org.eclipse.e4.core.internal.di.InjectorImpl.inject(InjectorImpl.java:120) org.eclipse.e4.core.internal.di.InjectorImpl.internalMake(InjectorImpl.java:337) org.eclipse.e4.core.internal.di.InjectorImpl.make(InjectorImpl.java:258) org.eclipse.e4.core.contexts.ContextInjectionFactory.make(ContextInjectionFactory.java:162) org.eclipse.e4.ui.internal.workbench.ReflectionContributionFactory.createFromBundle(ReflectionContributionFactory.java:104) org.eclipse.e4.ui.internal.workbench.ReflectionContributionFactory.doCreate(ReflectionContributionFactory.java:73) org.eclipse.e4.ui.internal.workbench.ReflectionContributionFactory.create(ReflectionContributionFactory.java:55) org.eclipse.e4.ui.workbench.renderers.swt.ContributedPartRenderer.createWidget(ContributedPartRenderer.java:127) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.createWidget(PartRenderingEngine.java:983) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.safeCreateGui(PartRenderingEngine.java:662) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.safeCreateGui(PartRenderingEngine.java:766) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.access$2(PartRenderingEngine.java:737) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$7.run(PartRenderingEngine.java:731) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.createGui(PartRenderingEngine.java:715) org.eclipse.e4.ui.workbench.renderers.swt.StackRenderer.showTab(StackRenderer.java:1250) org.eclipse.e4.ui.workbench.renderers.swt.LazyStackRenderer$1.handleEvent(LazyStackRenderer.java:68) org.eclipse.e4.ui.services.internal.events.UIEventHandler$1.run(UIEventHandler.java:40) org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:187) org.eclipse.ui.internal.UISynchronizer.syncExec(UISynchronizer.java:156) org.eclipse.swt.widgets.Display.syncExec(Display.java:4734) org.eclipse.e4.ui.internal.workbench.swt.E4Application$1.syncExec(E4Application.java:218) org.eclipse.e4.ui.services.internal.events.UIEventHandler.handleEvent(UIEventHandler.java:36) org.eclipse.equinox.internal.event.EventHandlerWrapper.handleEvent(EventHandlerWrapper.java:197) org.eclipse.equinox.internal.event.EventHandlerTracker.dispatchEvent(EventHandlerTracker.java:197) org.eclipse.equinox.internal.event.EventHandlerTracker.dispatchEvent(EventHandlerTracker.java:1) org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230) org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:148) org.eclipse.equinox.internal.event.EventAdminImpl.dispatchEvent(EventAdminImpl.java:135) org.eclipse.equinox.internal.event.EventAdminImpl.sendEvent(EventAdminImpl.java:78) org.eclipse.equinox.internal.event.EventComponent.sendEvent(EventComponent.java:39) org.eclipse.e4.ui.services.internal.events.EventBroker.send(EventBroker.java:81) org.eclipse.e4.ui.internal.workbench.UIEventPublisher.notifyChanged(UIEventPublisher.java:59) org.eclipse.emf.common.notify.impl.BasicNotifierImpl.eNotify(BasicNotifierImpl.java:374) org.eclipse.e4.ui.model.application.ui.impl.ElementContainerImpl.setSelectedElement(ElementContainerImpl.java:171) org.eclipse.e4.ui.internal.workbench.ModelServiceImpl.showElementInWindow(ModelServiceImpl.java:488) org.eclipse.e4.ui.internal.workbench.ModelServiceImpl.bringToTop(ModelServiceImpl.java:454) org.eclipse.e4.ui.internal.workbench.PartServiceImpl.delegateBringToTop(PartServiceImpl.java:694) org.eclipse.e4.ui.internal.workbench.PartServiceImpl.bringToTop(PartServiceImpl.java:387) org.eclipse.e4.ui.internal.workbench.PartServiceImpl.showPart(PartServiceImpl.java:1134) org.eclipse.ui.internal.WorkbenchPage.busyOpenEditor(WorkbenchPage.java:3210) org.eclipse.ui.internal.WorkbenchPage.access$23(WorkbenchPage.java:3125) org.eclipse.ui.internal.WorkbenchPage$9.run(WorkbenchPage.java:3107) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:3102) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:3066) org.eclipse.ui.internal.WorkbenchPage.openEditor(WorkbenchPage.java:3047) org.talend.dataprofiler.core.CorePlugin.openEditor(CorePlugin.java:245) org.talend.dataquality.ontology.ui.wizard.SemanticDiscoveryWizard.openEditor(SemanticDiscoveryWizard.java:243) org.talend.dataquality.ontology.ui.wizard.SemanticDiscoveryWizard.performFinish(SemanticDiscoveryWizard.java:218) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:853) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:438) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:619) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.jface.window.Window.runEventLoop(Window.java:832) org.eclipse.jface.window.Window.open(Window.java:808) org.talend.dataquality.ontology.service.SemanticStudioServiceImpl.openSemanticDiscoveryWizard(SemanticStudioServiceImpl.java:43) org.talend.dataprofiler.core.ui.action.actions.predefined.SemanticDiscoveryAction.run(SemanticDiscoveryAction.java:54) org.eclipse.jface.action.Action.runWithEvent(Action.java:519) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:595) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:511) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:420) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:183) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code}",3 TDQ-11087," Running Job with exception occured and the Job was Generated by ""generate an ETL job to handle rows""","1 Running Job failed and The Job was Generated by ""generate an ETL job to handle rows"" 2.After generate the job, If lick the ""Guess query"" button in component panel first, then run the job, there is no Exception when launch job",1 TDQ-11102,"TOP can not create hive2 standalone cdh54/HDP22/mapr connection","1. try to create a cdh54 hive2 standalone connection, after set parameters, click ""check"" failed with same configuration, TDQ can check successfully. {code} Connection failure. You must change the Database Settings. java.sql.SQLException: java.lang.NullPointerException at org.talend.metadata.managment.connection.manager.HiveConnectionManager.createHive2StandaloneConnection(HiveConnectionManager.java:214) at org.talend.metadata.managment.connection.manager.HiveConnectionManager.createHiveStandloneConnection(HiveConnectionManager.java:154) at org.talend.metadata.managment.connection.manager.HiveConnectionManager.checkConnection(HiveConnectionManager.java:375) at org.talend.metadata.managment.repository.ManagerConnection.checkHiveConnection(ManagerConnection.java:163) at org.talend.repository.ui.wizards.metadata.connection.database.DatabaseForm$30.runWithCancel(DatabaseForm.java:2665) at org.talend.repository.ui.wizards.metadata.connection.database.DatabaseForm$30.runWithCancel(DatabaseForm.java:1) at org.talend.repository.ui.dialog.AProgressMonitorDialogWithCancel$1.runnableWithCancel(AProgressMonitorDialogWithCancel.java:77) at org.talend.repository.ui.dialog.AProgressMonitorDialogWithCancel$ARunnableWithProgressCancel$1.call(AProgressMonitorDialogWithCancel.java:161) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NullPointerException at org.talend.metadata.managment.connection.manager.HiveConnectionManager.createHive2StandaloneConnection(HiveConnectionManager.java:207) ... 9 more {code}",2 TDQ-11103,"Add Chart and SQLexplorer jar files to the service",NULL,1 TDQ-11105,"Fix issue with tDataMasking TUJ","job 'tDataMasking_TDQ10455' is currently failing due to compilation errors. http://192.168.11.10/colibri/job_details.php?id_job=3078&id_exec=61616 {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GENERATE_PHONE_NUMBER cannot be resolved or is not a field p_java_8024.tdatamasking_tdq10455_0_1.tDataMasking_TDQ10455.tFileInputDelimited_1Process(tDataMasking_TDQ10455.java:2495) p_java_8024.tdatamasking_tdq10455_0_1.tDataMasking_TDQ10455.tFileInputDelimited_5Process(tDataMasking_TDQ10455.java:1421) p_java_8024.tdatamasking_tdq10455_0_1.tDataMasking_TDQ10455.runJobInTOS(tDataMasking_TDQ10455.java:12414) p_java_8024.tdatamasking_tdq10455_0_1.tDataMasking_TDQ10455.main(tDataMasking_TDQ10455.java:12244) {code} Check that the TUJ is correctly running in a recent studio. Then the reason is probably the maven cache on the TUJ server. See with Pierre how to resolve it. ",1 TDQ-11121,"Create version 6.1.0 in Babili and populate it",NULL,2 TDQ-11124,"investigate more for ""createStatement(...)""","After TDQ-10991 ,Email from Sebastiao: ResultSetHelper has several methods to get a result set. But when we call them, we don't know whether it will call createStatementOnlyForwardAndFetchSize or simply createStatement. That's why I ask why we don't use the same method in all methods of ResultSetHelper. From the caller perspective, it's not clear. can you find who used these options in the analysis and see why? According to the documentation, TYPE_SCROLL_INSENSITIVE means that the resultset is not updated whatever happens in the database. That's what we want in the analysis and that's probably what we want also in the reservoir sampling algorithm. What I'd like to see is a unified way to retrieve the result set. I don't see any good reason why we would need a different way for the analysis and for the sample. Can you investigate this a bit more? ",13 TDQ-11133,"Export babili translations into git (for 6.1.1)",NULL,2 TDQ-11188,"Can't have two data masking components within one subjob","Can't have two data masking components within one subjob see Job attached",2 TDQ-11192,"Update description in routine generation dialog of tStandardizeRow","The last sentence is not meaningful and confusing. Remove it. Steps to reproduce: - Click on generate routine in the tStandardizeRow component. - It creates the routine. - Click again to generate again the routine, this message will show up. ",1 TDQ-11230,"Allow to add custom date pattern at runtime","Currently, if the date pattern used is not in our shortlist, we're stuck. Idea is to be able to manage a pattern defined by the user.",13 TDQ-11238,"can not re-create analysis with semantic wizard with same column","com.hp.hpl.jena.rdf.model.LiteralRequiredException: http://www.w3.org/2000/01/rdf-schema#Class com.hp.hpl.jena.rdf.model.impl.ResourceImpl.asLiteral(ResourceImpl.java:119) org.talend.dataquality.ontology.model.TdOntologyModel.getLowerThreshold(TdOntologyModel.java:408) org.talend.dataquality.ontology.recommendation.MultiColumnAnalysisRecommender.addSemanticSuggestions(MultiColumnAnalysisRecommender.java:169) org.talend.dataquality.ontology.recommendation.MultiColumnAnalysisRecommender.suggestAnalyses(MultiColumnAnalysisRecommender.java:109) org.talend.dataquality.ontology.ui.wizard.SemanticDiscoveryWizard.performFinish(SemanticDiscoveryWizard.java:163) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:853) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:438) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:619) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.jface.window.Window.runEventLoop(Window.java:832) org.eclipse.jface.window.Window.open(Window.java:808) org.talend.dataquality.ontology.service.SemanticStudioServiceImpl.openSemanticDiscoveryWizard(SemanticStudioServiceImpl.java:41) org.talend.dataprofiler.core.ui.action.actions.predefined.SemanticDiscoveryAction.run(SemanticDiscoveryAction.java:54) org.eclipse.jface.action.Action.runWithEvent(Action.java:519) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:595) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:511) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:420) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:183) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) org.eclipse.equinox.launcher.Main.main(Main.java:1438) ",2 TDQ-11246,"Amazon Redshift Data Profiling ""missing system catalog data"" error","When connecting to an Amazon Redshift database using the built in Postgres driver, it is not possible to perform column analysis in Data Profiling. When I click on ""Select Indicators"" I receive the below error after a long delay. This appears to be related to a PSQL indexing feature that is not supported in Redshift. This PSQL error seems to cause Talend to go into a loop followed by a Java Heap Error Note that this does not occur on smaller Redshift tables, but does occur 100% reproducibly on one of our larger tables. {code} !STACK 0 org.postgresql.util.PSQLException: Unable to determine a value for MaxIndexKeys due to missing system catalog data. at org.postgresql.jdbc2.AbstractJdbc2DatabaseMetaData.getMaxIndexKeys(AbstractJdbc2DatabaseMetaData.java:64) at org.postgresql.jdbc2.AbstractJdbc2DatabaseMetaData.getImportedExportedKeys(AbstractJdbc2DatabaseMetaData.java:3134) at org.postgresql.jdbc2.AbstractJdbc2DatabaseMetaData.getImportedKeys(AbstractJdbc2DatabaseMetaData.java:3464) at org.talend.metadata.managment.model.DBConnectionFillerImpl.fillPkandFk(DBConnectionFillerImpl.java:1767) at org.talend.metadata.managment.model.DBConnectionFillerImpl.fillColumns(DBConnectionFillerImpl.java:1679) at org.talend.metadata.managment.model.MetadataFillFactory.fillColumns(MetadataFillFactory.java:331) at org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getColumns(DqRepositoryViewService.java:355) at org.talend.dq.nodes.DBColumnFolderRepNode.loadColumns(DBColumnFolderRepNode.java:215) at org.talend.dq.nodes.DBColumnFolderRepNode.getChildren(DBColumnFolderRepNode.java:193) at org.talend.dataprofiler.core.ui.dialog.ColumnsSelectionDialog$ModelElementContentProvider.getChildren(ColumnsSelectionDialog.java:523) at org.eclipse.ui.model.BaseWorkbenchContentProvider.getElements(BaseWorkbenchContentProvider.java:76) at org.eclipse.jface.viewers.StructuredViewer.getRawChildren(StructuredViewer.java:999) at org.eclipse.jface.viewers.ColumnViewer.getRawChildren(ColumnViewer.java:699) at org.eclipse.jface.viewers.AbstractTableViewer.getRawChildren(AbstractTableViewer.java:1043) at org.eclipse.jface.viewers.StructuredViewer.getFilteredChildren(StructuredViewer.java:905) at org.eclipse.jface.viewers.StructuredViewer.getSortedChildren(StructuredViewer.java:1057) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefreshAll(AbstractTableViewer.java:667) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefresh(AbstractTableViewer.java:615) at org.eclipse.jface.viewers.AbstractTableViewer.internalRefresh(AbstractTableViewer.java:607) at org.eclipse.jface.viewers.AbstractTableViewer$1.run(AbstractTableViewer.java:567) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1436) at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1397) at org.eclipse.jface.viewers.CheckboxTableViewer.preservingSelection(CheckboxTableViewer.java:344) at org.eclipse.jface.viewers.AbstractTableViewer.inputChanged(AbstractTableViewer.java:564) at org.eclipse.jface.viewers.ContentViewer.setInput(ContentViewer.java:292) at org.eclipse.jface.viewers.StructuredViewer.setInput(StructuredViewer.java:1675) at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog.setOutput(TwoPartCheckSelectionDialog.java:263) at org.talend.dataprofiler.core.ui.dialog.ColumnsSelectionDialog.selectionChanged(ColumnsSelectionDialog.java:408) at org.eclipse.jface.viewers.Viewer$2.run(Viewer.java:163) at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) at org.eclipse.ui.internal.JFaceUtil$1.run(JFaceUtil.java:50) at org.eclipse.jface.util.SafeRunnable.run(SafeRunnable.java:178) at org.eclipse.jface.viewers.Viewer.fireSelectionChanged(Viewer.java:160) at org.eclipse.jface.viewers.StructuredViewer.updateSelection(StructuredViewer.java:2171) at org.eclipse.jface.viewers.StructuredViewer.handleSelect(StructuredViewer.java:1202) at org.eclipse.jface.viewers.CheckboxTreeViewer.handleSelect(CheckboxTreeViewer.java:298) at org.eclipse.jface.viewers.StructuredViewer$4.widgetSelected(StructuredViewer.java:1231) at org.eclipse.jface.util.OpenStrategy.fireSelectionEvent(OpenStrategy.java:242) at org.eclipse.jface.util.OpenStrategy.access$4(OpenStrategy.java:236) at org.eclipse.jface.util.OpenStrategy$1.handleEvent(OpenStrategy.java:408) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) at org.eclipse.jface.window.Window.runEventLoop(Window.java:832) at org.eclipse.jface.window.Window.open(Window.java:808) at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog.open(TwoPartCheckSelectionDialog.java:313) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisDetailsPage.openColumnsSelectionDialog(ColumnAnalysisDetailsPage.java:813) at org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisDetailsPage$6.mouseDown(ColumnAnalysisDetailsPage.java:474) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:192) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) at org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) at org.talend.dataprofiler.rcp.intro.Application.start(Application.java:78) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) at org.eclipse.equinox.launcher.Main.run(Main.java:1465) !ENTRY org.eclipse.ui 4 0 2015-11-12 11:31:39.052 !MESSAGE Unhandled event loop exception !STACK 0 java.lang.OutOfMemoryError: GC overhead limit exceeded !ENTRY org.eclipse.core.jobs 4 2 2015-11-12 11:31:39.060 !MESSAGE An internal error occurred during: ""Compacting resource model"". !STACK 0 java.lang.OutOfMemoryError: GC overhead limit exceeded !ENTRY org.eclipse.core.jobs 4 2 2015-11-12 11:31:39.062 !MESSAGE An internal error occurred during: ""Periodic workspace save."". !STACK 0 java.lang.OutOfMemoryError: GC overhead limit exceeded {code} I have retried using the latest Redshift drivers, downloaded from here: http://docs.aws.amazon.com/redshift/latest/mgmt/configure-jdbc-connection.html#download-jdbc-driver With either the 4.0 or the 4.1 driver, I receive a different error: ""\[Amazon\]\[JDBC\](10220) Driver not capable"" I have not been able to find any information about this error on existing tickets or forums.",3 TDQ-11293,"Enhance email masking in tDataMasking","h2. new functions for email masking. The masking of the domain with or without the TLD can use the following methods: - mask with a character (use X by default, but the user can set another character like ""A"") - mask with a list of values (default parameter is the empty string and the domain is then replaced by the empty string: j@gmail.com -> j@ ) -- separated by , when the parameter is a list of values separated by a comma -- coming from a file when the parameter is a file path In general, any inappropriate parameter is not taken into account and the default parameter is used instead. h2. Original request: {quote} The current behavior of tDataMasking for the email addresses is to replace those addresses with XXXXXXX@domain.com (where ""domain.com"" corresponds to the original domain name). It would be nice to replace the XXXX with some random names (from a list? EDIT: it's already possible) and to be able to mask the domain name (either with XXX or with a list of choices). Other ways to mask the emails: - keep first character and replace remaining local part with fixed length XXXX string {quote}",2 TDQ-11312,"change dbconnection name get error dialog when editor is open by double click task, also for analysis Unknown Label issue ","1. create a dbconnection, close its editor. 2. right click on the connection, select ""Add task ..."" to add a task. 3. in the task view double click the added the task, then the dbconnection editor open. at the same time get error in error log--issue 1. 4. change the connection name, save it. get error dialog popup --issue2. 5. create a column analysis , add task about the analysis. closet its editor. 6. double click the task about the analysis open analysis editor, save name, in the repository name change, but the editor label changed to ""Unknown Label"" close the editor get error in error log--issue 3 reopen it works. ",2 TDQ-11339,"The ""String index out of range: -1"" shows when the function is Keep n last digits and replace previous ones and parameter is 1 for tDataMasking","1.Design one job such as tFixFlowInput->tDataMasking->tLogrow 2.Add varchar column and set the function is Keep n last digits and replace previous ones and parameter is 1 3.Run job Expected result: It run well Actual result: The error shows. {code} Exception in component tDataMasking_1 java.lang.StringIndexOutOfBoundsException: String index out of range: -1 java.lang.String.charAt(String.java:646) org.talend.dataquality.datamasking.Functions.KeepLastAndGenerateString.generateMaskedRow(KeepLastAndGenerateString.java:39) org.talend.dataquality.datamasking.Functions.KeepLastAndGenerateString.generateMaskedRow(KeepLastAndGenerateString.java:21) ss.data_0_1.data$2.modifyOutput(data.java:822) ss.data_0_1.data$2.generateOutput(data.java:811) ss.data_0_1.data$2.generateOutput(data.java:1) org.talend.dataquality.datamasking.DataMasker.process(DataMasker.java:43) ss.data_0_1.data.tFixedFlowInput_1Process(data.java:921) ss.data_0_1.data.runJobInTOS(data.java:1344) ss.data_0_1.data.main(data.java:1178) [FATAL]: ss.data_0_1.data - tDataMasking_1 String index out of range: -1 {code}",2 TDQ-11350,"Install new software should not be in TOS_DQ","this function already disabled on TOS_DI,TOS_BD,TOS_MDM,TOS_ESB",2 TDQ-11355,"when first perspective is dq, logon a svn project (Custome log checked), can not get indicators and patterns in Repository","1. configure studio and tac with TP_DM license, in tac create a dq project. 2. logon on local project, turn perspective to dq 3. logon the remote project 4. during the startup, get ""Commit changes on server"" dialog, click ok 5. check the dq repository. Expected Result both system indicator and patterns show well in repository. Actual Result: can not show system indicator and pattern. NOTE: 1. if logon a remote project, first perspective is DI, then turn to dq it is ok 2. some times can get sub folder under ""Indicators"" ",8 TDQ-11384,"Export babili translations into git (for 6.1.2)",NULL,2 TDQ-11386,"Export babili translations into git (for 6.2.0M2)",NULL,2 TDQ-11388,"Create version 6.1.1 in Babili and populate it",NULL,2 TDQ-11390,"Create version 6.2.0M2 in Babili and populate it",NULL,2 TDQ-11425,"The ""Could not build next result"" dialog shows after running match analysis","1.Create match analysis with custom table. 2.Run analysis. Expected results: The analysis can be run well. Actual results: It can not run well.see attachment {code} java.lang.RuntimeException: Could not build next result org.talend.dataquality.record.linkage.iterator.ResultSetIterator.next(ResultSetIterator.java:100) org.talend.dataquality.record.linkage.iterator.ResultSetIterator.next(ResultSetIterator.java:33) org.talend.dq.analysis.match.BlockAndMatchManager.run(BlockAndMatchManager.java:86) org.talend.dq.analysis.MatchAnalysisExecutor.execute(MatchAnalysisExecutor.java:174) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:149) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1.runInWorkspace(RunAnalysisAction.java:224) org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.sql.SQLException: Value '0000-00-00 00:00:00' can not be represented as java.sql.Timestamp com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1084) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:973) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:918) com.mysql.jdbc.ResultSetRow.getTimestampFast(ResultSetRow.java:1102) com.mysql.jdbc.ByteArrayRow.getTimestampFast(ByteArrayRow.java:127) com.mysql.jdbc.ResultSetImpl.getTimestampInternal(ResultSetImpl.java:6587) com.mysql.jdbc.ResultSetImpl.getTimestamp(ResultSetImpl.java:6187) com.mysql.jdbc.ResultSetImpl.getObject(ResultSetImpl.java:5053) org.talend.dataquality.record.linkage.iterator.ResultSetIterator.next(ResultSetIterator.java:94) ... 7 more {code}",1 TDQ-11437,"Contribute Data Masking API to DataPrep","Dataprep will require data masking features. We need to enrich the sampling library with an easier to use API. Requirements must be defined with the DP team. # Add a method in https://github.com/Talend/data-quality/blob/master/dataquality-sampling/src/main/java/org/talend/dataquality/datamasking/DataMasker.java {code:java} public TOut process(TIn v) {code} This will allow the caller to directly get the output without passing via a list. # Create a ValueDataMasker that extends DataMasker and will work on single values (single columns such as firstname, account number,...) # (not in 6.2 release) -Create a RecordDataMasker that will have information about the record level and will be able to mask two identical records in the same way- # (not in 6.2 release) -Create a ShufflingDataMasker that will shuffle records- ",8 TDQ-11440,"Create an API to validate, format, enrich phone information","Contribute phone number validation (credible), reformatting (country standard), enrichment (land line, cell…) The API will wrap the google library (use maven to get the lastest version - https://github.com/googlei18n/libphonenumber ) It will be created in the data-quality git repository in the standardization project: https://github.com/Talend/data-quality/tree/master/dataquality-standardization Create a package org.talend.dataquality.standardization.phone Use maven dependencies to reference the google library. h1. Features of the API: h2. Method required in the API h3. Validation - isPossiblePhoneNumber to check whether some data are possible phone numbers (will delegate call to Google API) - isValidPhoneNumber to validate the phone number. h3. Transformation h4. Formatting - let the caller of the API format phone number (with a default E164 format, with a specified format, can use also the PhoneNumberUtil.formatOutOfCountryCallingNumber() method ) - let the caller choose the format and format the phone number accordingly h4. Extract information from phone number Create method to extract the following information from a phone number - phone number type - is valid region - country - region - geocode phone number (see PhoneNumberOfflineGeocoder) - getCarrier - getTimeZone See the attached example from http://libphonenumber.appspot.com/phonenumberparser?number=0147012500&country=FR h1. Unit tests for every single method of the API. Test phone numbers. Test data that are not phone numbers and assert on the expected errors. The following phone numbers should be correct: {noformat} +33656965822 000147554323 +33(0)147554323 00(0)147554323 0662965822 754-3010 (541) 754-3010 +1-541-754-3010 1-541-754-3010 001-541-754-3010 191 541 754 3010 636-48018 (089) / 636-48018 +49-89-636-48018 19-49-89-636-48018 (724) 203-2300 {noformat} ---- ",8 TDQ-11469,"The tDataMasking job can not run if enable ""Output the orginale row?"" check box in Advanced settings under Big Data Batch part","1.Design one job such as tFixFlowInput->tDataMasking->tlogrow under Big Data Batch 2.enable ""Output the orginale row?"" check box under Advanced settings 3.Run job Expected result: Job run well Actual result: The error popped.see attachment Another issue: The job can not run if the input data type is int and uncheck nullable check box under standard job. see attachment stardard.jpg",1 TDQ-11470,"update the DQ demo project version","org.talend.dqdemo\resources\demoprojects\DQ_EE_DEMOS.zip now the vession still is 6.0.1 both 6.1 and master",1 TDQ-11489,"Port tStandardizeRow to Spark framework","Batch + Streaming. ",20 TDQ-11492,"Port tTransliterate component to Spark",NULL,8 TDQ-11493,"Create a Data masking routines","Create a data masking routine using the data masking library. Take the following code and refactor it so that - the java code style respects our standard (no underscore, no uppercase for variables,...) - there is no hard coded string (secret strings must be parameters of the functions). - remove the ""DM_"" It's not needed to understand the method name. - it has a clear documentation {code:java} package routines; import java.security.MessageDigest; import java.security.NoSuchAlgorithmException; import java.util.Calendar; import java.util.Random; import java.security.*; import java.security.spec.KeySpec; import javax.crypto.Cipher; import javax.crypto.spec.SecretKeySpec; import javax.crypto.SecretKey; import javax.crypto.SecretKeyFactory; import javax.crypto.spec.DESKeySpec; import sun.misc.*; import java.util.*; /* * user specification: the function's comment should contain keys as follows: 1. write about the function's comment.but * it must be before the ""{talendTypes}"" key. * * 2. {talendTypes} 's value must be talend Type, it is required . its value should be one of: String, char | Character, * long | Long, int | Integer, boolean | Boolean, byte | Byte, Date, double | Double, float | Float, Object, short | * Short * * 3. {Category} define a category for the Function. it is required. its value is user-defined . * * 4. {param} 's format is: {param} [()] [ : ] * * 's value should be one of: string, int, list, double, object, boolean, long, char, date. 's value is the * Function's parameter name. the {param} is optional. so if you the Function without the parameters. the {param} don't * added. you can have many parameters for the Function. * * 5. {example} gives a example for the Function. it is optional. * * Author: rzenker@talend.com * Date: */ public class DataMasking { /** * MD2: Calculate MD2 hash value from String. * * * {talendTypes} String * * {Category} User Defined * * {param} string(""foo"") input: The string need to be masked. * * {example} CreateMD5(""foo"") * @throws NoSuchAlgorithmException */ public static String DM_CreateMD2(String message) throws NoSuchAlgorithmException { if (message == null) { return ""Input String for MD2 caluclation is missing""; } else { /*MD2 Calculation */ MessageDigest thisMD2 = MessageDigest.getInstance(""MD2""); thisMD2.reset(); thisMD2.update(message.getBytes()); byte[] result = thisMD2.digest(); /* Return */ StringBuffer hexString = new StringBuffer(); for (int i=0; i= 0){ hexString.append(""0""); } hexString.append(Integer.toHexString(0xFF & result[i])); } return hexString.toString(); } } /** * MD5: Calculate MD5 hash value from String. * * * {talendTypes} String * * {Category} User Defined * * {param} string(""foo"") input: The string need to be masked. * * {example} CreateMD5(""foo"") * @throws NoSuchAlgorithmException */ public static String DM_CreateMD5(String message) throws NoSuchAlgorithmException { if (message == null) { return ""Input String for MD5 calculation is missing""; } else { /*Calculation */ MessageDigest thisMD5 = MessageDigest.getInstance(""MD5""); thisMD5.reset(); thisMD5.update(message.getBytes()); byte[] result = thisMD5.digest(); /* Return */ StringBuffer hexString = new StringBuffer(); for (int i=0; i= 0){ hexString.append(""0""); } hexString.append(Integer.toHexString(0xFF & result[i])); } return hexString.toString(); } } /** * CreditCard Masking: Masks a 16 digit credit card number with a defined character from 5th to 12th place. * * * {talendTypes} String * * {Category} User Defined * * {param} string(""ccnum"") input: The string needs to be masked. * {param} string(""maskingChar"") input: The masking Character. * * {example} CCcardMasking(""ccnum"",""maskinChar"") * @throws NoSuchAlgorithmException */ public static String DM_CCcardMasking(String ccnum, String maskingChar) throws NoSuchAlgorithmException { int total = ccnum.length(); int startlen=4,endlen = 4; int masklen = total-(startlen + endlen) ; if (ccnum.length() != 16) { return ""No Credit Card Number - length not 16 char""; } else { StringBuffer maskedbuf = new StringBuffer(ccnum.substring(0,startlen)); for(int i=0;i refresh data automatically: TDQ-11513 - collapse analysis metadata: TDQ-11515 - refresh data -> move right (after sampling): TDQ-11514 - ""select data"" -> ""select columns"": TDQ-11518 - icon run with text : |> Run: TDQ-11520 - add select indicator button in analyzed columns section: TDQ-11519 - remove hyperlinks: TDQ-11521 - white background on charts: TDQ-11522 - operation cross : transparent background - have two states for option icon: default and with checkmark (instead of sub item ""has quality thresholds""): TDQ-11524 - hide Graphics section in setting (keep parameter to display it again if needed): TDQ-11526 - automatically switch to results when click run: TDQ-11527 - jfreechart : dynamic transitioning bars? TDQ-11528 - contextual action : when hovering over table or charts, change background color of cells or rows to highlight actions. + add tooltip: ""Right-click for actions"": TDQ-11529 - change ""Pattern Low Frequency Statistics"" to ""Pattern Low Frequency Table"" in analysis results: TDQ-7434 - Add ""expand all"" and ""fold all"" icon buttons in the ""Analysis Results"" section: TDQ-11525 does the change for all types analysis? -->yes do we need to do the same change for report?for example: the chart backgroud color -->no. No change in generated report now",13 TDQ-11496,"Integrate the t-swoosh algorithm in the tMatchgroup components (step 2)",NULL,20 TDQ-11501,"create related TUJ for swoosh",NULL,3 TDQ-11517,"Adapt to new jar file loading mechanism","See TBD-3057",3 TDQ-11531,"The error message shows after double clicking tMatchgroup in the jessicaTestMatchGroup job.","1.create joblet job with tMatchGroup. 2.double click tMatchgroup in the jessicaTestMatchGroup job. Expected result: No error message shows. Actual result: The error log shows.no response after clicking chart .see below: {code} java.lang.reflect.InvocationTargetException at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:421) at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507) at org.talend.designer.component.preview.TGenkeyViewProfileAction.makeFakeNodeAndLoad(TGenkeyViewProfileAction.java:242) at org.talend.designer.component.preview.ui.matchrule.ConfigureMatchRuleDialog.refreshInput(ConfigureMatchRuleDialog.java:472) at org.talend.designer.component.preview.ui.matchrule.ConfigureMatchRuleDialog.refreshWhenOpen(ConfigureMatchRuleDialog.java:164) at org.talend.designer.component.preview.ui.matchrule.ConfigureMatchRuleDialog.create(ConfigureMatchRuleDialog.java:137) at org.eclipse.jface.window.Window.open(Window.java:790) at org.talend.designer.component.preview.ConfigureMatchRuleAction.run(ConfigureMatchRuleAction.java:142) at org.talend.designer.component.preview.service.TdqMatchService.openConfigureMatchRuleDialog(TdqMatchService.java:17) at org.talend.designer.component.preview.shadow.MatchGroupComponent.open(MatchGroupComponent.java:166) at org.talend.designer.core.ui.editor.nodes.NodePart.performRequest(NodePart.java:528) at org.eclipse.gef.tools.SelectEditPartTracker.performOpen(SelectEditPartTracker.java:194) at org.eclipse.gef.tools.SelectEditPartTracker.handleDoubleClick(SelectEditPartTracker.java:137) at org.eclipse.gef.tools.AbstractTool.mouseDoubleClick(AbstractTool.java:1069) at org.eclipse.gef.tools.SelectionTool.mouseDoubleClick(SelectionTool.java:525) at org.eclipse.gef.EditDomain.mouseDoubleClick(EditDomain.java:231) at org.eclipse.gef.ui.parts.DomainEventDispatcher.dispatchMouseDoubleClicked(DomainEventDispatcher.java:291) at org.eclipse.draw2d.LightweightSystem$EventHandler.mouseDoubleClick(LightweightSystem.java:518) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:189) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438) at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.talend.rcp.intro.Application.start(Application.java:167) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:574) at org.eclipse.equinox.launcher.Main.run(Main.java:1407) at org.eclipse.equinox.launcher.Main.main(Main.java:1383) Caused by: java.lang.NullPointerException at org.talend.designer.core.model.process.DataNode.(DataNode.java:33) at org.talend.designer.component.preview.shadow.ViewBlockProfileDataMain.(ViewBlockProfileDataMain.java:58) at org.talend.designer.component.preview.shadow.DQPreviewComponentDataProcess.GetPrevFakeNode(DQPreviewComponentDataProcess.java:391) at org.talend.designer.component.preview.shadow.DQPreviewComponentDataProcess.backTraceAlongwithIncomingLine(DQPreviewComponentDataProcess.java:340) at org.talend.designer.component.preview.shadow.DQPreviewComponentDataProcess.createFakeNodes(DQPreviewComponentDataProcess.java:227) at org.talend.designer.component.preview.shadow.DQPreviewComponentDataProcess.initNodesAndConnections(DQPreviewComponentDataProcess.java:83) at org.talend.designer.component.preview.ConfigureMatchRuleAction.runPreviewDataColumnProcess(ConfigureMatchRuleAction.java:224) at org.talend.designer.component.preview.TGenkeyViewProfileAction$2.run(TGenkeyViewProfileAction.java:250) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) Root exception: java.lang.NullPointerException at org.talend.designer.core.model.process.DataNode.(DataNode.java:33) at org.talend.designer.component.preview.shadow.ViewBlockProfileDataMain.(ViewBlockProfileDataMain.java:58) at org.talend.designer.component.preview.shadow.DQPreviewComponentDataProcess.GetPrevFakeNode(DQPreviewComponentDataProcess.java:391) at org.talend.designer.component.preview.shadow.DQPreviewComponentDataProcess.backTraceAlongwithIncomingLine(DQPreviewComponentDataProcess.java:340) at org.talend.designer.component.preview.shadow.DQPreviewComponentDataProcess.createFakeNodes(DQPreviewComponentDataProcess.java:227) at org.talend.designer.component.preview.shadow.DQPreviewComponentDataProcess.initNodesAndConnections(DQPreviewComponentDataProcess.java:83) at org.talend.designer.component.preview.ConfigureMatchRuleAction.runPreviewDataColumnProcess(ConfigureMatchRuleAction.java:224) at org.talend.designer.component.preview.TGenkeyViewProfileAction$2.run(TGenkeyViewProfileAction.java:250) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:121) {code}",3 TDQ-11541,"The ""Preview"" word does not translate after right selecting one table when the languange is French","1.Change language to be French for studio 2.Preview table/column by right clicking Expected result: The preview word should be translated. Actual result: It can not be translated for table. it's ok for column",1 TDQ-11552,"create junit test case for TDQ-11542",NULL,1 TDQ-11553,"Can't drill down on regex pattern of MSSQL","Hello, We recently acquired your product and we're on the internal setup. I published the RegExMatch UDF Function in the server (side note: the tutorial should be updated to account for recent versions of Visual Studio), and activated the CLR, in order to use regular expressions for pattern matching. The pattern matching effectively shows matching and non-matching percentages in the analysis after correcting the queries for MS SQL Server. However, when going to check the valid or invalid rows in a column test, the SQL editor (or the module behind it) generates a query where the condition is ""null"". Creating a job to extract this information generates no blocks whatsoever either. Thus, we can see the percentages of matching and non-matching values, but we cannot see the values themselves, so the data quality process is stopped. Instructions in the SQL Editor : Valid cases : SELECT * FROM ""pathToDatabase"" WHERE null Invalid cases : SELECT ""field"" FROM ""pathToDatabase"" WHERE (null OR ""field"" IS NULL ) ",3 TDQ-11556,"The table's value is not as same as chart in the generated document after generating report file","1.Create functional dependency anlaysis 2.Create report with it 3.Generate report . Expected result: The result is correct. Actual result: The result in the chart is not same with table.see attachment",1 TDQ-11558,"Support Amazon Redshift database in Profiler","We must be able to connect to Redshift, retrieve all metadata, run all analysis and be able to run reports that analyze this database. The icon on this database must not show ""unsupported"" anymore. Todo: - see subtasks - test all kinds of analysis - test with all types of columns - configure Redshift with some users and personal schema. Check that we can still profile them. ",13 TDQ-11568,"unify the template of basic and evolution for long string--for all frequency indicators","after TDQ-10785, for frequency indicators, we show 30 characters at most for basic template, but evolution template we didn't change, should unify them to same one. also pay attention to dqportal",1 TDQ-11570,"Review Datamart model and its documentation","the documentation of ""tdq_table_analyzed_set"" is missing. Check whether other information is missing too. See doc at https://help.talend.com/display/TalendDataManagementPlatformStudioUserGuide61EN/G.1+Implemented+PDM Todo: create a DOCT issue with all missing information.",1 TDQ-11573,"column analysis report template should change for different indicators.","*Simple Indicator* count: should be Int type, both analysis and basic report(table chart, pic chart) in report for the second column title, should replace ""VALUE"" WITH ""COUNT"" *Summary Indicator:* basic report,horizontal label show ""label"", change to ""Summary Statistics"" just as simple indicators? evolution report vertical label for pic chart should be ""Value"", not ""Count"". *Text Indicators:* basic report doesn't show Frequency, should evolution show it? unify it. evolution report vertical label should replace ""Count"" with ""Value"" *Advanced Statistics(all indicators under this folder except mode):* Basic report, count should be int type. *Pattern Frequency Statistics(all three indicators)* Basic report, count should be int type. Evolution report, count should be Int type vertical value, for the Percentage chart label is not correct(refer to pic) *Phone Number Indicators(refer to pic):* basic: 1. Format Frequency Pie page, table title ""Data Value"" should be ""Indicator"", Value should be ""count"" and should int type(both table chart and pic chart) 2. next page, table title ""Value"" should be ""Count"", and should be count without "".00"" following Evolution: Count for vertical should be without "".00"" *Soundex Statistics:* Basic report: Count should without "".00"" both table and pic *Benford Law Indicators:* Basic report, table chart title ""VALUE"" should be ""Count"", without "".00"" Evolution report, should we show count result or frequency result? for the Expected Result is Frequency not Count. NOTE: for all the count number following with "".00"" should also fix in analysis. pic get from 563 ",2 TDQ-11583,"The column analysis with UDI indicators can not run well","1.Start studio and create column analysis 2.Add UDI to column analysis. 3.Run it. expected result: The analysis can be run well. Actual result: The error dialog popped.the error see below: {code} java.lang.IndexOutOfBoundsException: targetIndex=2, size=2 org.eclipse.emf.common.util.BasicEList.move(BasicEList.java:658) org.eclipse.emf.common.notify.impl.NotifyingListImpl.doMove(NotifyingListImpl.java:1329) org.eclipse.emf.common.notify.impl.NotifyingListImpl.move(NotifyingListImpl.java:1314) org.eclipse.emf.common.util.AbstractEList.move(AbstractEList.java:535) org.eclipse.emf.ecore.util.EcoreUtil$Copier.copyReference(EcoreUtil.java:793) org.eclipse.emf.ecore.util.EcoreUtil$Copier.copyReferences(EcoreUtil.java:688) org.talend.dq.helper.EObjectHelper.preDeepCopy(EObjectHelper.java:511) org.talend.dq.helper.EObjectHelper.deepCopy(EObjectHelper.java:477) org.talend.dq.helper.AnalysisExecutorHelper.checkIndicatorWithChild(AnalysisExecutorHelper.java:292) org.talend.dq.helper.AnalysisExecutorHelper.checkIndicator(AnalysisExecutorHelper.java:269) org.talend.dq.helper.AnalysisExecutorHelper.checkDependentFiles(AnalysisExecutorHelper.java:238) org.talend.dq.helper.AnalysisExecutorHelper.check(AnalysisExecutorHelper.java:202) org.talend.dq.analysis.AnalysisExecutor.check(AnalysisExecutor.java:249) org.talend.dq.analysis.ColumnAnalysisExecutor.check(ColumnAnalysisExecutor.java:231) org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:103) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:149) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1.runInWorkspace(RunAnalysisAction.java:226) org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) {code}",3 TDQ-11597,"DQ Portal: report header ""VIEW FILTER"" show table filter result","1. create an overview analysis, set different value for table filter and view filter 2. run report with the analysis. 3. check the report in dqportal. studio result is correct. Expected Result: table filter and view filter show correct result. Actual Result: both Table Filter and View Filter show result of Table Filter. ",1 TDQ-11599,"t-swoosh algorithm: Default Survivorship Rules-Number Largest/Smallest can not control Null field well ","1. import the zip file 2. run ""match_t_swoosh"" analysis. get error dialog pop up NOTE: 1. with same configuration tMatchGroup also get same error. 2. if analysis remove the ""stuProvinceID2"" column, re-run no error show. 3. click ""chart"" no error show. {code} java.lang.NumberFormatException java.math.BigDecimal.(BigDecimal.java:494) java.math.BigDecimal.(BigDecimal.java:383) java.math.BigDecimal.(BigDecimal.java:806) org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.parseNumberValue(MFBRecordMerger.java:214) org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.createMergeValue(MFBRecordMerger.java:119) org.talend.dataquality.record.linkage.grouping.swoosh.DQMFBRecordMerger.createNewRecord(DQMFBRecordMerger.java:131) org.talend.dataquality.matchmerge.mfb.MFBRecordMerger.merge(MFBRecordMerger.java:47) org.talend.dataquality.record.linkage.grouping.swoosh.DQMFBRecordMerger.merge(DQMFBRecordMerger.java:69) org.talend.dataquality.matchmerge.mfb.MFB.execute(MFB.java:174) org.talend.dataquality.record.linkage.grouping.swoosh.DQMFB.matchOneRecord(DQMFB.java:73) org.talend.dataquality.record.linkage.grouping.TSwooshGrouping.oneRecordMatch(TSwooshGrouping.java:159) org.talend.dataquality.record.linkage.grouping.swoosh.AnalysisSwooshMatchRecordGrouping.doGroup(AnalysisSwooshMatchRecordGrouping.java:92) org.talend.dq.analysis.match.BlockAndMatchManager$OneBlockMatching.run(BlockAndMatchManager.java:203) org.talend.dq.analysis.match.BlockAndMatchManager.run(BlockAndMatchManager.java:97) org.talend.dq.analysis.MatchAnalysisExecutor.execute(MatchAnalysisExecutor.java:174) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:149) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1.runInWorkspace(RunAnalysisAction.java:226) org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) {code}",2 TDQ-11602,"Split overview analysis editor in two pages (settings and results)","Move the analysis summary and statistical information sections to a new ""Analysis Results"" page, just like the other analysis editors. When the analysis is executed, switch automatically to this results page.",5 TDQ-11606,"Add ""data preview"" section in other analysis editors","Add the same section as the ""data preview"" section of the column analysis editor in the following editors: - column set analysis - functional dependency analysis",8 TDQ-11611,"tMatchGroup--t-Swoosh set blocking key can not get correct result","1. import the job attached 2. run the two jobs. the result is not correct check the result.txt(column as blocking key) stuID=10003 the GRP_SIZE=0 and MASTER=false but the whole txt no same GID item exist, which group it belongs to. refer to the chart result: 1 item-12 Group, 2 items--5 Group, 5 items--1 Group so only 5+1 new items generated, so output is input(count)+6 but now input is 27, output is 55.",3 TDQ-11630,"tMatchGroup+t-Swoosh can not show the Detailed labels in ""MATCHING_DISTANCES""","1. create a job with tMatchGroup, select T_Swoosh Matcher algorithm checked ""Output distance details"" and ""Display detailed labels"" 2. add key for tMatchGroup in the configuration dialog. and click ""chart"" check ""MATCHING_DISTANCES"" only show the score but not the key labels should like name: 1.0 NOTE: run job also has this issue.",3 TDQ-11632,"Redesign DQ editors - Step 2","See subtasks",8 TDQ-11633,"Sync versions of manifest and pom files of the Record linkage library","maven snapshot version of record linkage library is 3.1.1: https://github.com/Talend/data-quality/blob/master/dataquality-libraries/pom.xml But the manifest version is 3.1.0. This is confusing because the 3.1.0 of the library release is therefore not a fixed version, but a snapshot version corresponding to the latest 3.1.1 snapshot!",1 TDQ-11636,"Unclear error message when analysis fails to run","I set a pattern on a column in a Redshift database. Then I run the analysis and a dialog opens up to tell me that there is an error. The message is empty. No meaningful error message is displayed. It should be easy to read that the regex indicator could not be computed. In the error log, we can see: {quote} 2016-02-17 15:59:02,200 ERROR org.talend.dq.analysis.AnalysisExecutor - Query not executed for indicator: Text"" query is null {quote} and {quote} 2016-02-17 15:59:02,203 ERROR org.talend.dq.analysis.AnalysisExecutor - For more information please refer to the Error Log view. {quote} This kind of error (when the query cannot be generated) should be clearly identified and reported to the user. ",1 TDQ-11641,"support custom matching type in tMatchGroup when the algorithm is tswoosh","we have support customer matching type in Match Analysis when the algorithm is tswoosh, need to support it in tMatchGroup also another thing is: the title should be ""Matching Function"", bothe Match Analysis and tMatchGroup, both vsr and tswoosh",3 TDQ-11642,"tMatchGroup: vsr and tswoosh has different way to show Null value for int and varchar.","when tMatchGroup select vsr and t-swoosh, has different way to show Null for int and varchar. configuration dialog: refer to the pic attached run job result : varchar type both vsr and t-swoosh show null, it is ok int type t-swoosh show 0 instead of null Expected Result: vsr and t-swoosh should same behavior. Especially for t-swoosh int value when null should not show ""0"".",2 TDQ-11643,"The variance's value for chart can not be shown well in the Report","1.Import variance to UDI indicators. 2.Create column analysis and add variance indicator. 3.Create report with it. 4.Run report. Expected result: The all value shows well. Actual result: The value can not be shown completely.see attachment Another issue: Some values are not as same as chart.",1 TDQ-11644,"tMatchGroup: t-swoosh certain job get compile error or run get NPE","1. import the job attached. 2. run the ""employee"" job, get compile error. 3. run the ""t_swoosh_customer_three_output"" job, get NPE, also error dialog pop up when open configuration wizard. note: if change the key definition to ""country"" then run job get error but configuration wizard ok. {code} Exception in component tFileOutputDelimited_1 java.lang.NullPointerException https_1.t_swoosh_customer_three_output_0_1.t_swoosh_customer_three_output.tMysqlInput_1Process(t_swoosh_customer_three_output.java:13660) https_1.t_swoosh_customer_three_output_0_1.t_swoosh_customer_three_output.tMysqlInput_3Process(t_swoosh_customer_three_output.java:5819) https_1.t_swoosh_customer_three_output_0_1.t_swoosh_customer_three_output.runJobInTOS(t_swoosh_customer_three_output.java:15043) https_1.t_swoosh_customer_three_output_0_1.t_swoosh_customer_three_output.main(t_swoosh_customer_three_output.java:14877) [FATAL]: https_1.t_swoosh_customer_three_output_0_1.t_swoosh_customer_three_output - tFileOutputDelimited_1 null {code}",5 TDQ-11650,"Export babili translations into git (for 6.2.0M3)",NULL,2 TDQ-11660," tMatchGroup set ""Default Survivorship Rules"" can not get correct master result","1. import the job attached(3 jobs). 2. open the configuration wizard--it will compute the result, it is not correct , master record values comes from the last row --issue 1 3. click ""chart"" to get new result, it is different with step2 but some still not correct. refer to the three pic attached. analysis use same rule also attached.",5 TDQ-11661,"Redesign DQ editors - Step 3",NULL,8 TDQ-11665,"Bugs in QBE in 6.1.1","Hi, When I test the QBE in 6.1.1, I found some bugs: 1, the 'Generate query' only works for single field, it throws error when the qurey has more than one. 2, the 'Relationship wizard' only works for single field, it throws error when more than one field. 3, can't save query, it throws NPE error 4, preview query result will throw error 5, there is no refresh on 'selected fields', once you change to 'worksheet' page, you can't change the fileds any more.",5 TDQ-11666,"Integrate the t-swoosh algorithm in the tMatchgroup components (step 3)",NULL,8 TDQ-11668,"multipass of tswoosh on tMatchgroup output empty result","The reason of the empty result : The case has no merged records. (which is not covered by the test case) 1, add junit case for this. 2, fix it.",3 TDQ-11676,"Generic JDBC with inner driver can't works in DQ analysis","Hi, I found if use inner jdbc driver in Generic JDBC, the check button return OK, but when execute analysis on this connection, it always says ""check connection failed"", if use extenal jar, it works well, see attached screenshots and log",3 TDQ-11681,"The selected columns not display and checked on Colunm seletion shell when open the Colunm selection shell again by click the Select Columns button ",NULL,1 TDQ-11683,"t-swoosh tMatchGroup import t-swoosh rules can not show Survivorship Function and Parameter correctly and chart result seems strange.","1. import the match rule in dq repository. 2. import the job in di repository 3. double click the tMatchGroup in the job, on the ""configuration wizard"" dialog import the match rule after imported check the Survivorship Function and Parameter, doesn't same with match rule: ""stuAddress"" key lose the ""Parameter"" value ""stuProvinceID"" set a wrong ""Survivorship Function"". ",3 TDQ-11686,"t-swoosh tMatchGroup can not get same result with match analysis.","1. import analysis and job file 2. compare match analysis and tMatchGroup chart result. can not get same result. for ""t_swoosh_two_Tabs_bothOneKey"" match analysis treat all items in one group. but job get several groups. for ""t_swoosh_two_Tabs_firstTabTwoKeys_import_vsr, analysis get 2 groups, but job get 3, for the group which group size=4, even stuAddress value are same, but threshold for stuProvinceID is 1, and values are not same, this key get 0 score. on my side there is no reason they can in one group.",3 TDQ-11688,"Propagate changes from the pattern to jobs","Hi, According to [https://jira.talendforge.org/browse/TDQ-11612] , when modify an existing pattern which used in component, the changes can't propagate to the job, we should enable it. We need to have a built-in and repository mode for the Patterns in this component and other related components.",5 TDQ-11691,"t-swoosh tMatchGroup can not store the key have added","1. create a job like tfixedFlowInput+tMatchGroup+tlogRow 2. set tMatchGroup t-swoosh algorithm, double click tMatchGroup 3. on the dialog set the key, and click the ""Chart"" get inform dialog, refer to the pic. 4. click ok on the inform dialog,click Ok on the Configuration Dialog. 5. reopen the configuration dialog, key is lost Expected Result: step 3 should works, step 5 should not lose the key. no error in error log.",1 TDQ-11693,"un-select the selected column in ""Column Selection"" dialog doesn't work--still show in analysis editor","1. create a column analysis with 3 columns--about dbconnection 2. click ""Select Columns"" open the column selection dialog, uncheck 1column so only 2 columns selected. 3. click ""ok"" back to analysis editor, still show 3, reopen the column selection dialog, 3 columns selected Expected Result: uncheck the selected column should works. other analysis about columns also has this issue. ",2 TDQ-11700,"add columns/indicators after reopen analysis, run analysis always get no columns/indicators dialog(issue for all analysis)","issue 1. 1. create a basic column analysis, does not select columns. 2. Reopen analysis. select columns, add indicators, so get not saved status 3. click ""Run"" directly, get ""No columns"" dialog. and analysis not save automatic 4. Reopen analysis, click ""Run"", same error with step 3. issue 2. 1. create a basic column analysis, select columns, save 2. Reopen analysis, add indicators, so get not saved status 3. click ""Run"" directly, get ""No indicators"" dialog. and analysis not save automatic 4. Reopen analysis, click ""Run"", same error with step 3. NOTE: Reopen studio then analysis can run. same issue for other analysis: if add columns/table after reopen analysis then can not run. ",3 TDQ-11709,"after running business rule , column analysis, reopen it, editor can not show correctly(restart studio reproduce this issue again)","1. create a business rule analysis, add table, and sql rules , run it, directly show the ""Analysis Results"" page 2. close the editor by click ""x"" 3. reopen the editor failed , refer to the pic NOTES: 1. same issue for column analysis. 2. for no new build testing on lower version, so for dev please help to check: if this issue cause by some issue also commit on lower version, please commit on corresponding version also {code} java.lang.IllegalArgumentException: Argument not valid org.eclipse.swt.SWT.error(SWT.java:4422) org.eclipse.swt.SWT.error(SWT.java:4356) org.eclipse.swt.SWT.error(SWT.java:4327) org.eclipse.swt.graphics.GC.setFont(GC.java:4404) org.eclipse.ui.forms.widgets.ExpandableComposite$ExpandableLayout.layout(ExpandableComposite.java:310) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1290) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1297) org.eclipse.swt.widgets.Composite.updateLayout(Composite.java:1276) org.eclipse.swt.widgets.Composite.setLayoutDeferred(Composite.java:1087) org.eclipse.swt.widgets.Display.runDeferredLayouts(Display.java:4196) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3754) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:197) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code} ",3 TDQ-11710,"SVN/Git : add a matching key for match analysis, save it will get three ""Commit changes on server"" dialog","create a git and svn projects--make sure ""Custom log"" checked 1. create a match analysis, select the analyzed columns, save analysis. 2. click ""Select Matching Key"", then click one column header to select a key, then key show ""Matching Key"" part 3. save analysis. then three ""Commit changes on server"" dialogs pop up one by one for dialogs ""Additional logs"" content as below: User 'talend@talend.com' at 15:50:19 CST 2016-03-02 : Save connection item: file_1 Save metadata_file_delimited item 'file_1' at path '' in project 'dq2' User 'talend@talend.com' at 15:50:43 CST 2016-03-02 : save Analysis item Save tdq_analysis_element item 'match_9' at path '' in project 'dq2' User 'talend@talend.com' at 15:51:06 CST 2016-03-02 : save Analysis item Save tdq_analysis_element item 'match_9' at path '' in project 'dq2' Expected: can we only pop up one, may user confused with this three ones.",1 TDQ-11711,"tDataMasking does not work if exist tlogRow component before it","The attache job can not work well. expect : the job is worked actual: compile error is out",3 TDQ-11736,"after rename udi, pattern which used by analysis, can not change name correctly ,also lose the checked status.","1. create a column analysis 2. add pattern and udi for the analysis, save analysis, close the analysis 3. rename udi and pattern. 4. open the analysis, udi name not changed, and checked the indicator selection dialog, two items lose the checked status. re-add two two items, can add. Expected Result: after rename the two items, should show new name correctly in analysis, besides should not lose the checked status.",2 TDQ-11737,"Frequency Udi can not get correct result in evolution report","1. check the frequency udi result in evolution report, can not get correct template, refer to the pdf attached, should same template with ""Value Frequency"" indicator",1 TDQ-11738,"No chart shown for ""Pattern matching""","I used a regular Expression matching Indicator ""DE Postleitzahl"" on MS SQL Server after Setting up RegEx for MS SQL following the steps described in chapter 14.2 of Teland help. The Analysis ran without Errors, but no results were shown (see screenshot). Error log Shows an exception shortly after running the SELECT Statement that calls the regular Expression. !ENTRY org.talend.platform.logging 4 0 2016-03-10 14:39:07.422 !MESSAGE 2016-03-10 14:39:07,414 ERROR org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo - java.lang.reflect.InvocationTargetException !STACK 0 java.lang.reflect.InvocationTargetException org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:481) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:374) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:527) org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:119) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:101) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.createResultSection(ColumnAnalysisResultPage.java:220) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.createFormContent(ColumnAnalysisResultPage.java:97) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.refresh(ColumnAnalysisResultPage.java:260) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisResultPage.fireRuningItemChanged(AbstractAnalysisResultPage.java:176) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:253) org.eclipse.ui.internal.UILockListener.doPendingWork(UILockListener.java:167) org.eclipse.ui.internal.UISynchronizer$3.run(UISynchronizer.java:165) org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:136) org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4147) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3764) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:78) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) Caused by: java.lang.AbstractMethodError: org.talend.dataprofiler.chart.TOPChartService.decoratePatternMatching(Ljava/lang/Object;)V org.talend.dataprofiler.core.ui.utils.TOPChartUtils.decoratePatternMatching(TOPChartUtils.java:176) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.createChart(ResultPaginationInfo.java:328) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.createResultDataComposite(ResultPaginationInfo.java:229) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.render(ResultPaginationInfo.java:197) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:466) ... 38 more Root exception: java.lang.AbstractMethodError: org.talend.dataprofiler.chart.TOPChartService.decoratePatternMatching(Ljava/lang/Object;)V org.talend.dataprofiler.core.ui.utils.TOPChartUtils.decoratePatternMatching(TOPChartUtils.java:176) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.createChart(ResultPaginationInfo.java:328) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.createResultDataComposite(ResultPaginationInfo.java:229) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.render(ResultPaginationInfo.java:197) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:466) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:374) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:527) org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:119) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:101) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.createResultSection(ColumnAnalysisResultPage.java:220) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.createFormContent(ColumnAnalysisResultPage.java:97) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.refresh(ColumnAnalysisResultPage.java:260) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisResultPage.fireRuningItemChanged(AbstractAnalysisResultPage.java:176) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:253) org.eclipse.ui.internal.UILockListener.doPendingWork(UILockListener.java:167) org.eclipse.ui.internal.UISynchronizer$3.run(UISynchronizer.java:165) org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:136) org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4147) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3764) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:78) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) ",1 TDQ-11746,"reload database/table/ view list can not show newest status.","1. create a sqlserver connection, just set the database filter, then all schema show 2. edit the connection, to set the schema filter, on the pop up reload dialog select reload option. check the Repository still show all the schemas--issue 1. 3. create another connection also just set database filter--show all the schemas, 4. in database create a new schema, 5. do reload database list, the new created schema can not show. --issue2 6. unfold the tables/views folder, show the tables views. then create or drop tables/view in db, then do ""reload table/view list"", only the count changed, but not the table/view list --issue 3. Expected Result: when schema, table,view list changes, reload should show the correct result. ",1 TDQ-11748,"create junit test case for TDQ-11689","will test the ColumnAnaPersistenceHandler.persist() method, because the changed code is private",1 TDQ-11755,"DQ Portal manual service is not working","I set up the DQ Portal using these instructions found here: https://help.talend.com//pages/viewpage.action?pageId=265102560 I also referenced this guide: https://help.talend.com/display/TalendPlatformUniversalInstallationandUpgradeGuide53EN/6.1.2+CommandLine I corrected the parameter for param01 to the right jar file but this did not resolve it. I also used this link: https://help.talend.com/display/KB/How+to+set+up+HSQL+Db+as+a+Windows+Service It also did not work. I will attach my jsl file as well. If I turn it on manually instead of as a service, it works.",2 TDQ-11756,"analyze certain table ""Indicator Selection"" dialog response slow.","1. import the analysis file, open the ""Indicator Selection"" dialog for ""postgresql_ok"" works as expected for ""postgres_not_ok"" the dialog first show as pic show, then show fully content, but try to select indicator or drag the scroll bar it can not response quickly need to wait a moment.",1 TDQ-11761,"when click on the threshold in the swoosh key definition table which just imported, error occurs","Import a swoosh rule which has value on its threshold, and click the threshold value, first click not editable, then re-click the value disappear also get error in error log. {code} org.eclipse.core.runtime.AssertionFailedException: assertion failed: org.eclipse.core.runtime.Assert.isTrue(Assert.java:110) org.eclipse.core.runtime.Assert.isTrue(Assert.java:96) org.eclipse.jface.viewers.TextCellEditor.doSetValue(TextCellEditor.java:231) org.eclipse.jface.viewers.CellEditor.setValue(CellEditor.java:861) org.eclipse.jface.viewers.EditingSupport.initializeCellEditorValue(EditingSupport.java:100) org.eclipse.jface.viewers.ColumnViewerEditor.activateCellEditor(ColumnViewerEditor.java:199) org.eclipse.jface.viewers.ColumnViewerEditor.handleEditorActivationEvent(ColumnViewerEditor.java:452) org.eclipse.jface.viewers.ColumnViewer.triggerEditorActivationEvent(ColumnViewer.java:675) org.talend.commons.ui.runtime.swt.tableviewer.TableViewerCreatorNotModifiable$1.triggerEditorActivationEvent(TableViewerCreatorNotModifiable.java:538) org.eclipse.jface.viewers.ColumnViewer.handleMouseDown(ColumnViewer.java:650) org.eclipse.jface.viewers.ColumnViewer.access$0(ColumnViewer.java:646) org.eclipse.jface.viewers.ColumnViewer$1.mouseDown(ColumnViewer.java:95) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:192) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.jface.window.Window.runEventLoop(Window.java:832) org.eclipse.jface.window.Window.open(Window.java:808) org.talend.designer.component.preview.ConfigureMatchRuleAction.run(ConfigureMatchRuleAction.java:142) org.talend.designer.component.preview.service.TdqMatchService.openConfigureMatchRuleDialog(TdqMatchService.java:17) org.talend.designer.component.preview.shadow.MatchGroupComponent.open(MatchGroupComponent.java:182) org.talend.designer.core.ui.editor.nodes.NodePart.performRequest(NodePart.java:569) org.eclipse.gef.tools.SelectEditPartTracker.performOpen(SelectEditPartTracker.java:194) org.eclipse.gef.tools.SelectEditPartTracker.handleDoubleClick(SelectEditPartTracker.java:137) org.eclipse.gef.tools.AbstractTool.mouseDoubleClick(AbstractTool.java:1069) org.eclipse.gef.tools.SelectionTool.mouseDoubleClick(SelectionTool.java:527) org.eclipse.gef.EditDomain.mouseDoubleClick(EditDomain.java:231) org.eclipse.gef.ui.parts.DomainEventDispatcher.dispatchMouseDoubleClicked(DomainEventDispatcher.java:291) org.eclipse.draw2d.LightweightSystem$EventHandler.mouseDoubleClick(LightweightSystem.java:518) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:196) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:197) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code}",1 TDQ-11762,"Semantic Discovery Wizard Improvements (Step 2)",NULL,5 TDQ-11764,"t-swoosh match analysis can not get same result for ""Chart"" and Run analysis","1. import the match analysis 2. compare the result for ""Chart"" and run analysis. they are different. Expected Result: should get same result",3 TDQ-11774,"set a default for the concatenate function: ',' in survivorship function parameter","When using Swoosh in the match analysis and in the tMatchGroup, the concatenate function should have a default parameter set to "","" For ""Default Survivorship Rule"": for the the concatenate function, also default parameter set to "",""",1 TDQ-11775,"TOS_DQ can not delete items from RecycleBin","1. create some items-- any kind is ok 2. delete them to Recycle Bin 3. right click Recycle Bin-->Empty Recycle Bin or select the items in Recycle Bin to delete them, items can not delete. Expected Result: items should delete without error. Actual Result: when delete item doesn't depend on by others , can not , also no error. when delete db depend on by analysis, get error in error log {code} ERROR org.talend.dataprofiler.core.ui.action.actions.DQDeleteAction - get error when delete file: /TOP_DEFAULT_PRJ/TDQ_Data Profiling/Analyses/c_0.1 {code}",1 TDQ-11779,"bugs related with tMatchGroup",NULL,3 TDQ-11786,"java engine column analysis can not analyze sqlite int type column.","1. create a java engine column analysis , add columns from sqlite when analysis contains int type column can not run. {code} java.lang.ClassCastException: java.lang.Integer cannot be cast to java.lang.String org.talend.dataquality.indicators.impl.BlankCountIndicatorImpl.handle(BlankCountIndicatorImpl.java:167) org.talend.dq.indicators.IndicatorEvaluator.executeSqlQuery(IndicatorEvaluator.java:162) org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:146) org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:207) org.talend.dq.analysis.ColumnAnalysisExecutor.evaluate(ColumnAnalysisExecutor.java:102) org.talend.dq.analysis.AnalysisExecutor.runAnalysis(AnalysisExecutor.java:271) org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:141) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:149) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1.runInWorkspace(RunAnalysisAction.java:226) org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) {code}",1 TDQ-11788,"Typo in Semantic Discovery Wizard help text","Typo on page 2 of SD Wizard help text. Current: This page tries to match the metadata and the categories of your data to the existing concepts available in the Semantic repository. Click on the chart to see how your data match the selected concept. You may still edit the categories of some columns in order to get more precise matches between your data and the concepts. Click on Refresh after any category change. CHANGE: ... to see how your data matches the selected concept. (match -> matches (plural))",1 TDQ-11789,"get an error dialog when run columnSet Analysis ","1.create column analysis with mysql connection 2.run this column analysis ,pop a dialog with error message. but get running result. if you can't reporduce it, you can restart the studio and do above steps {code} java.io.IOError: java.io.IOException: Wrong index checksum, store was not closed properly and could be corrupted. org.mapdb.StoreDirect.checkHeaders(StoreDirect.java:258) org.mapdb.StoreDirect.(StoreDirect.java:207) org.mapdb.DBMaker.extendStoreDirect(DBMaker.java:918) org.mapdb.DBMaker.makeEngine(DBMaker.java:722) org.mapdb.DBMaker.make(DBMaker.java:665) org.talend.dataquality.indicators.mapdb.AbstractDB.initDefaultDB(AbstractDB.java:63) org.talend.dataquality.indicators.mapdb.DBMap.(DBMap.java:73) org.talend.dataquality.indicators.mapdb.DBMap.(DBMap.java:66) org.talend.dataquality.indicators.mapdb.ColumnSetDBMap.(ColumnSetDBMap.java:30) org.talend.dataquality.indicators.columnset.impl.ColumnSetMultiValueIndicatorImpl.initValueForColumnSetDBMap(ColumnSetMultiValueIndicatorImpl.java:262) org.talend.dataquality.indicators.columnset.impl.ColumnSetMultiValueIndicatorImpl.reset(ColumnSetMultiValueIndicatorImpl.java:1242) org.talend.dataquality.indicators.impl.IndicatorImpl.prepare(IndicatorImpl.java:876) org.talend.dq.analysis.MultiColumnAnalysisExecutor.runAnalysis(MultiColumnAnalysisExecutor.java:250) org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:143) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:149) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1.runInWorkspace(RunAnalysisAction.java:226) org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Caused by: java.io.IOException: Wrong index checksum, store was not closed properly and could be corrupted. ... 18 more {code}",1 TDQ-11797,"Support Exasol database type profiling",NULL,5 TDQ-11801,"import nl strings from babili into git",NULL,1 TDQ-11803,"In cheat sheet wizard ""Refresh the Graphics"" doesn't work well for column/column set/three correlation analysis","1. open the cheat sheet view. 2. follow the wizard to create analysis for column/column set/three correlation anaylsis has the ""Refresh the Graphics"" part, click the ""Perform"" under it. get error dialog {code} java.lang.ClassNotFoundException: org.talend.dataprofiler.core.ui.action.actions.RefreshChartAction cannot be found by org.talend.dataprofiler.core_6.2.0.20160328_1936-SNAPSHOT org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:432) org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:345) org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:337) org.eclipse.osgi.internal.loader.ModuleClassLoader.loadClass(ModuleClassLoader.java:160) java.lang.ClassLoader.loadClass(ClassLoader.java:357) org.eclipse.osgi.internal.framework.EquinoxBundle.loadClass(EquinoxBundle.java:568) org.eclipse.ui.internal.cheatsheets.ActionRunner.runAction(ActionRunner.java:44) org.eclipse.ui.internal.cheatsheets.data.Action.execute(Action.java:100) org.eclipse.ui.internal.cheatsheets.views.CoreItem.runExecutable(CoreItem.java:506) org.eclipse.ui.internal.cheatsheets.views.CoreItem.runExecutable(CoreItem.java:501) org.eclipse.ui.internal.cheatsheets.views.CheatSheetViewer.runPerformExecutable(CheatSheetViewer.java:1046) org.eclipse.ui.internal.cheatsheets.views.CoreItem$1.linkActivated(CoreItem.java:89) org.eclipse.ui.forms.widgets.AbstractHyperlink.handleActivate(AbstractHyperlink.java:233) org.eclipse.ui.forms.widgets.ImageHyperlink.handleActivate(ImageHyperlink.java:199) org.eclipse.ui.forms.widgets.AbstractHyperlink.handleMouseUp(AbstractHyperlink.java:327) org.eclipse.ui.forms.widgets.AbstractHyperlink.access$2(AbstractHyperlink.java:311) org.eclipse.ui.forms.widgets.AbstractHyperlink$4.handleEvent(AbstractHyperlink.java:125) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:197) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:497) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code}",1 TDQ-11825,"No information in the Error Log window","I'm using ""TOS_DQ-20160401_1937-V6.2.0SNAPSHOT"" and when I open any error from the Error log window, the event detail is empty (see attached capture). For information, I've imported my DQ old project into this studio from the login window. Project is attached in case.",1 TDQ-11827,"need to restart the studio after download sqlexplorer and top.chart jar","more details see TUP-4234",2 TDQ-11828,"tMatchGroup: t-swoosh certain job get compile error ","import the job attached, try to run it, can not but on 20160317_1358-V6.2.0M3 can run.",1 TDQ-11829,"tRuleSurvivorship ""Generate rules and survivorship flow"" failed","import the job, for tRuleSurvivorship click ""Generate rules and survivorship flow"" , get error in error log. so job can not run, Please comment which issue cause this. {code} java.lang.RuntimeException: The service org.talend.core.ITDQSurvivorshipService has not been registered. org.talend.core.GlobalServiceRegister.getService(GlobalServiceRegister.java:148) org.talend.designer.core.ui.editor.properties.controllers.GenerateSurvivorshipRulesController.generateSuvivorshipRules(GenerateSurvivorshipRulesController.java:111) org.talend.designer.core.ui.editor.properties.controllers.GenerateSurvivorshipRulesController.access$0(GenerateSurvivorshipRulesController.java:102) org.talend.designer.core.ui.editor.properties.controllers.GenerateSurvivorshipRulesController$1$1$1.run(GenerateSurvivorshipRulesController.java:88) org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:187) org.eclipse.ui.internal.UISynchronizer.syncExec(UISynchronizer.java:156) org.eclipse.swt.widgets.Display.syncExec(Display.java:4734) org.talend.designer.core.ui.editor.properties.controllers.GenerateSurvivorshipRulesController$1$1.execute(GenerateSurvivorshipRulesController.java:85) org.eclipse.gef.commands.CommandStack.execute(CommandStack.java:199) org.talend.designer.core.ui.editor.properties.controllers.AbstractElementPropertySectionController.executeCommand(AbstractElementPropertySectionController.java:1145) org.talend.designer.core.ui.editor.properties.controllers.GenerateSurvivorshipRulesController$1.widgetSelected(GenerateSurvivorshipRulesController.java:77) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:197) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:497) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code}",3 TDQ-11831,"indicator drill down open sql editor doesn't use the correct indicator name.","we have change the indicator name but for the indicator drill down result still use the old one",1 TDQ-11832,"The question mark shows in the result after running tStandardizeRow job under Spark","1.Import job. 2.Run job. Expected result: The result should be correct. Actual result: The special symbol shows.see attachment",3 TDQ-11840,"Incorrect version in Talend 611 TDQ portal","When clicking on the info button in talend 611 data quality portal the version is showing as 5.1.0. See attached screen shot",1 TDQ-11847,"Generated ETL job does not compile","I did a Column Set Analysis for my data which connect to Redshift service. Then in the analysis results, right click the All Match section to generate an ETL job, please see attached screen1. Then I have a job like screen2. Screen3 is its codes sources.",1 TDQ-11851,"Cannot cancel a semantic-aware analysis","Run a semantic-aware analysis, when the progress bar of analysis displayed, click ""cancel"" button. But the analysis is still runing and when it finishes, I have the correct results.",5 TDQ-11852,"Enable dynamic charts","When we run an analysis, the editor should automatically switch to the results tab and the chart must be dynamically computed: each result should display in the chart as soon as it's available. ",3 TDQ-11853,"We should handle SQL engine error when apply Fraud Detection to a pure text column","I have used the datas from Redshift connection. In my datas, I have numeric columns and pure text columns, their type is recognized as ""varchar"", as screenshot 1. I applied Fraud Detection, and chose ""SQL"" execution engine. Then I have the error below: 2016-04-08 16:24:03,300 ERROR org.talend.dq.analysis.AnalysisExecutor - Query not executed for indicator: Benford Law FrequencySQL query: SELECT SUBSTRING(cast(""jobtitle"" as char),1,2), COUNT(*) FROM ""public"".""testtable"" t GROUP BY SUBSTRING(cast(""jobtitle"" as char),1,2) order by SUBSTRING(cast(""jobtitle"" as char),1,2) LIMIT 50 com.paraccel.util.PSQLException: ERROR: Invalid characters: Detail: ----------------------------------------------- error: Invalid characters: code: 8001 context: Only ASCII characters are allowed in fixed length strings. Invalid ASCII char: c3 query: 20346 location: funcs_string.cpp:1946 process: query0_50 [pid=1981] ----------------------------------------------- com.paraccel.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1780) com.paraccel.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1515) com.paraccel.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:194) com.paraccel.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:451) com.paraccel.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:336) com.paraccel.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:328) org.talend.dq.analysis.ColumnAnalysisSqlExecutor.executeQuery(ColumnAnalysisSqlExecutor.java:1420) org.talend.dq.analysis.ColumnAnalysisSqlExecutor.executeQuery(ColumnAnalysisSqlExecutor.java:1373) org.talend.dq.analysis.ColumnAnalysisSqlParallelExecutor.run(ColumnAnalysisSqlParallelExecutor.java:103) org.talend.dq.analysis.ColumnAnalysisSqlExecutor$ExecutiveAnalysisJob.run(ColumnAnalysisSqlExecutor.java:1190) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) 2016-04-08 16:24:03,299 ERROR org.talend.dq.analysis.ColumnAnalysisSqlParallelExecutor - com.paraccel.util.PSQLException: ERROR: Invalid characters: Detail: ----------------------------------------------- error: Invalid characters: code: 8001 context: Only ASCII characters are allowed in fixed length strings. Invalid ASCII char: c3 query: 20346 location: funcs_string.cpp:1946 process: query0_50 [pid=1981] ----------------------------------------------- But if I choose ""Java"" execution engine, there is no prb, I have the results as screenshot2.",3 TDQ-11856,"No column and data under ""Data Preview"" section when create column set analysis by right clicking column","The empty in the Data Preview when create column set analysis by right clicking column.see attachment",1 TDQ-11860,"Redesign DQ editors - Step 4 (after add data preview section)",NULL,3 TDQ-11878,"column set analysis based file connection can not run ","create a column set analysis with file connection, run the analysis failed. {code} java.lang.NullPointerException org.talend.dataquality.indicators.columnset.impl.ColumnSetMultiValueIndicatorImpl.computeCounts(ColumnSetMultiValueIndicatorImpl.java:986) org.talend.dataquality.indicators.columnset.impl.ColumnSetMultiValueIndicatorImpl.storeSqlResults(ColumnSetMultiValueIndicatorImpl.java:936) org.talend.dataquality.indicators.columnset.impl.ColumnSetMultiValueIndicatorImpl.finalizeComputation(ColumnSetMultiValueIndicatorImpl.java:1346) org.talend.dq.indicators.Evaluator.finalizeIndicators(Evaluator.java:171) org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:153) org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:207) org.talend.dq.indicators.ColumnSetIndicatorEvaluator.evaluateIndicators(ColumnSetIndicatorEvaluator.java:529) org.talend.dq.analysis.ColumnSetAnalysisExecutor.runAnalysis(ColumnSetAnalysisExecutor.java:100) org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:143) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:149) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1.runInWorkspace(RunAnalysisAction.java:226) org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) java.lang.NullPointerException org.talend.algorithms.AlgoUtils.incrementValueCounts(AlgoUtils.java:41) org.talend.dataquality.indicators.columnset.impl.ColumnSetMultiValueIndicatorImpl.handleDataOnFile(ColumnSetMultiValueIndicatorImpl.java:1430) org.talend.dataquality.indicators.columnset.impl.ColumnSetMultiValueIndicatorImpl.handle(ColumnSetMultiValueIndicatorImpl.java:1392) org.talend.dq.indicators.ColumnSetIndicatorEvaluator.handleObjects(ColumnSetIndicatorEvaluator.java:359) org.talend.dq.indicators.ColumnSetIndicatorEvaluator.orgnizeObjectsToHandel(ColumnSetIndicatorEvaluator.java:311) org.talend.dq.indicators.ColumnSetIndicatorEvaluator.evaluateByDelimitedFile(ColumnSetIndicatorEvaluator.java:226) org.talend.dq.indicators.ColumnSetIndicatorEvaluator.executeSqlQuery(ColumnSetIndicatorEvaluator.java:91) org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:146) org.talend.dq.indicators.Evaluator.evaluateIndicators(Evaluator.java:207) org.talend.dq.indicators.ColumnSetIndicatorEvaluator.evaluateIndicators(ColumnSetIndicatorEvaluator.java:529) org.talend.dq.analysis.ColumnSetAnalysisExecutor.runAnalysis(ColumnSetAnalysisExecutor.java:100) org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:143) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:149) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1.runInWorkspace(RunAnalysisAction.java:226) org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) {code}",1 TDQ-11881,"Spark doesn't have permission to delete the window file","I have a Big Data job which used tStandardizeRow. In my Spark Configuration, I used ""Use local mode"", spark version ""1.6.0"", Spark scratch directory ""/DQ"". After run the job, I have my expected correct results, but have also these errors below: [ERROR]: org.apache.spark.util.ShutdownHookManager - Exception while deleting Spark temp dir: C:\DQ\spark-5c0df763-2e9c-4747-af46-4d9f6051f77b java.io.IOException: Failed to delete: C:\DQ\spark-5c0df763-2e9c-4747-af46-4d9f6051f77b org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:928) org.apache.spark.util.ShutdownHookManager$$anonfun$1$$anonfun$apply$mcV$sp$3.apply(ShutdownHookManager.scala:65) org.apache.spark.util.ShutdownHookManager$$anonfun$1$$anonfun$apply$mcV$sp$3.apply(ShutdownHookManager.scala:62) scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108) org.apache.spark.util.ShutdownHookManager$$anonfun$1.apply$mcV$sp(ShutdownHookManager.scala:62) org.apache.spark.util.SparkShutdownHook.run(ShutdownHookManager.scala:267) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply(ShutdownHookManager.scala:239) org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1741) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply$mcV$sp(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(ShutdownHookManager.scala:239) scala.util.Try$.apply(Try.scala:161) org.apache.spark.util.SparkShutdownHookManager.runAll(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anon$2.run(ShutdownHookManager.scala:218) org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54) [ERROR]: org.apache.spark.util.ShutdownHookManager - Exception while deleting Spark temp dir: C:\DQ\spark-5c0df763-2e9c-4747-af46-4d9f6051f77b\userFiles-c6d6fa0a-76a3-43dc-98f6-814fbf1b96d1 java.io.IOException: Failed to delete: C:\DQ\spark-5c0df763-2e9c-4747-af46-4d9f6051f77b\userFiles-c6d6fa0a-76a3-43dc-98f6-814fbf1b96d1 org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:928) org.apache.spark.util.ShutdownHookManager$$anonfun$1$$anonfun$apply$mcV$sp$3.apply(ShutdownHookManager.scala:65) org.apache.spark.util.ShutdownHookManager$$anonfun$1$$anonfun$apply$mcV$sp$3.apply(ShutdownHookManager.scala:62) scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108) org.apache.spark.util.ShutdownHookManager$$anonfun$1.apply$mcV$sp(ShutdownHookManager.scala:62) org.apache.spark.util.SparkShutdownHook.run(ShutdownHookManager.scala:267) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply(ShutdownHookManager.scala:239) org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1741) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply$mcV$sp(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(ShutdownHookManager.scala:239) scala.util.Try$.apply(Try.scala:161) org.apache.spark.util.SparkShutdownHookManager.runAll(ShutdownHookManager.scala:239) org.apache.spark.util.SparkShutdownHookManager$$anon$2.run(ShutdownHookManager.scala:218) org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54) Job Copy_of_test11489 ended at 18:49 12/04/2016. [exit code=0]",3 TDQ-11882,"incorrect message show on the pop up ""Run analysis error"" dialog","1. create a column analysis about sqlserver connection, set sql engine. 2. add a pattern 3. run the analysis, analysis run failed, and error dialog popup, but a {0} show on the dialog should not, should remove this or show the connection type or connection name? ",1 TDQ-11886,"Analysis results aren't complete inTOS4DQ","when running analyses in TOS_DQ-20160412_1706-V6.2.0RC1, the results are not complete. Only results for some of the columns are shown I've attached to this jira the 2 analyses + input data and the error message from the log file is pasted below: eclipse.buildId=unknown java.version=1.8.0_77 java.vendor=Oracle Corporation BootLoader constants: OS=win32, ARCH=x86_64, WS=win32, NL=en_US Command-line arguments: -os win32 -ws win32 -arch x86_64 org.talend.platform.logging Error Thu Apr 14 00:11:44 CEST 2016 2016-04-14 00:11:44,945 ERROR org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo - java.lang.reflect.InvocationTargetException java.lang.reflect.InvocationTargetException org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:481) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:374) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:527) org.talend.dataprofiler.core.ui.progress.ProgressUI.popProgressDialog(ProgressUI.java:54) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo.renderContents(PaginationInfo.java:67) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.refresh(UIPagination.java:119) org.talend.dataprofiler.core.ui.utils.pagination.UIPagination.init(UIPagination.java:101) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.createResultSection(ColumnAnalysisResultPage.java:224) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.createFormContent(ColumnAnalysisResultPage.java:98) org.talend.dataprofiler.core.ui.editor.analysis.ColumnAnalysisResultPage.refresh(ColumnAnalysisResultPage.java:264) org.talend.dataprofiler.core.ui.editor.analysis.AnalysisEditor.pageChange(AnalysisEditor.java:263) org.eclipse.ui.part.MultiPageEditorPart.setActivePage(MultiPageEditorPart.java:1101) org.eclipse.ui.forms.editor.FormEditor.setActivePage(FormEditor.java:603) org.eclipse.ui.forms.editor.FormEditor.setActivePage(FormEditor.java:509) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.switchToResultPage(AbstractAnalysisMetadataPage.java:334) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.fireRuningItemChanged(AbstractAnalysisMetadataPage.java:322) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1$2.run(RunAnalysisAction.java:253) org.eclipse.ui.internal.UILockListener.doPendingWork(UILockListener.java:167) org.eclipse.ui.internal.UISynchronizer$3.run(UISynchronizer.java:165) org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35) org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:136) org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4147) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3764) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:78) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) java.lang.reflect.Method.invoke(Unknown Source) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) Caused by: java.lang.AbstractMethodError: org.talend.dataprofiler.chart.TOPChartService.decoratePatternMatching(Ljava/lang/Object;)V org.talend.dataprofiler.core.ui.utils.TOPChartUtils.decoratePatternMatching(TOPChartUtils.java:176) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.createChart(ResultPaginationInfo.java:332) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.createResultDataComposite(ResultPaginationInfo.java:233) org.talend.dataprofiler.core.ui.editor.analysis.ResultPaginationInfo.render(ResultPaginationInfo.java:201) org.talend.dataprofiler.core.ui.utils.pagination.PaginationInfo$1.run(PaginationInfo.java:59) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:466) ... 43 more ",2 TDQ-11891,"""Extract information from phone number"" action","How to contribute to DataPrep actions https://in.talend.com/13994718 h3. new action - Name: *Extract Phone Parts* - Category: *Phones* - Parameters: -- a checkbox (default true) per field available to export (type, region, country, etc...) - Action: -- for each checked field, extract a new column name _ -- filled the column with the extracted values, or empty in other cases (cell empty, not a number, error at extraction, etc...) h3. suggestion rule Add a rule to suggest this action on columns which semantic type is phone number",5 TDQ-11906,"Make DQ components compatible with Java 7","EX: tDqReportRun which uses many dependencies built with the studio ",3 TDQ-11913,"tTransliterate component should be available on Big Data Streaming job","User may want to use tTransliterate on Big Data Streaming job. ",2 TDQ-11914,"We cannot save a key definition of tMatchGroup","When I select column(s) from the input flow and apply a matching algorithm in tMatchGroup component, type a match threshold. Then click ""OK"" and save it. Then I click to open this component again and see nothing in my Key Definition field. What I selected is not saved. FYI, Blocking Selection works well. When I open the config wizard and I can see my selected column(s).",2 TDQ-11915,"Documented scenarios using tMatchGroup are not worked ","Please refer to QAI-54238. Investigated with Sizhao, and pretty sure that it's tMatchGroup which causes the problem. May be related to issue TDQ-11914 Using the attached jobs, and see the errors below: Error: java.lang.NullPointerException java.util.Arrays.binarySearch(Arrays.java:1523) newpro.mapred_group_family_0_1.mapred_group_family$NaturalKeyPartitioner_tSortRowAfter_tMatchGroup_10.getPartition(mapred_group_family.java:7377) newpro.mapred_group_family_0_1.mapred_group_family$NaturalKeyPartitioner_tSortRowAfter_tMatchGroup_10.getPartition(mapred_group_family.java:1) org.apache.hadoop.mapred.MapTask$OldOutputCollector.collect(MapTask.java:610) org.talend.hadoop.mapred.lib.Chain$ChainOutputCollector.collect(Chain.java:466) newpro.mapred_group_family_0_1.mapred_group_family$tSortRowAfter_tMatchGroup_10Mapper.map(mapred_group_family.java:7131) newpro.mapred_group_family_0_1.mapred_group_family$tSortRowAfter_tMatchGroup_10Mapper.map(mapred_group_family.java:1) org.talend.hadoop.mapred.lib.ChainMapper.map(ChainMapper.java:63) org.talend.hadoop.mapred.lib.DelegatingMapper.map(DelegatingMapper.java:44) org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:415) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) ",1 TDQ-11916,"Can't open TOS DQ studio in Ubuntu 15.10","will got the Browser error. {code} !ENTRY org.eclipse.osgi 4 0 2016-04-19 12:33:50.101 !MESSAGE Application error !STACK 1 org.eclipse.swt.SWTError: No more handles [Unknown Mozilla path (MOZILLA_FIVE_HOME not set)] org.eclipse.swt.SWT.error(SWT.java:4467) org.eclipse.swt.browser.Mozilla.initMozilla(Mozilla.java:2067) org.eclipse.swt.browser.Mozilla.create(Mozilla.java:685) org.eclipse.swt.browser.Browser.(Browser.java:99) org.talend.registration.wizards.register.TalendForgeDialog.createDialogArea(TalendForgeDialog.java:102) org.talend.registration.wizards.register.TalendForgeDialog.createContents(TalendForgeDialog.java:95) org.eclipse.jface.window.Window.create(Window.java:435) org.eclipse.jface.dialogs.Dialog.create(Dialog.java:1101) org.eclipse.jface.window.Window.open(Window.java:797) org.talend.dataprofiler.rcp.intro.Application.openLicenseAndRegister(Application.java:112) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:60) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) org.eclipse.equinox.launcher.Main.main(Main.java:1438) {code}",1 TDQ-11917,"add the ""org.talend.hadoop.distribution.feature"" into TOS_DQ feature",NULL,1 TDQ-11921,"small UX improvements ","In the semantic wizard: - change text: ""some actions are required before proceeding."" -> ""Enrichment actions are required before proceeding."" - Highlight the ""Semantics"" row in the ""summary"" page (see attached screen capture) - keep ""select columns"" button in ""analyzed columns"" section (see attached colset.png screen capture)",1 TDQ-11924,"Port tStandardizePhoneNumber component to Spark framework","* Batch + Streaming Attached: properties of the component.",5 TDQ-11926,"create column set analysis by right click ""Analyses"" in wizard select db table node, default is java engine should not.","1. right click on ""Analyses"" follow wizard create column set analysis, during the wizard select a table node from dbconnection, then click Finish 2. check the created column set analysis, it is java engine, and can not edit 3. reopen analysis, it is still java engine, but can edit in my opinion on step2 should be editable and default selection be sql is better NOTE: 1. this issue also show on 611. 2. if select columns from table, default is sql not java and editable. ",1 TDQ-11927,"for file connection switch from file connection to db connection, only refresh the ""Analyzed Columns"" part, but not ""Data Preview"" part","1. create a column set analysis based on file connection. 2. in the db connection list, change selection to dbconnection. then after click ""Ok"" on pop up dialog. ""Analyzed Columns"" part is empty but ""Data Preview"" part not",1 TDQ-11930,"certain tMatchGroup job imported to 620 can not run, but works well import to 611","1. import the job run it. failed, NOTE: import to 611 works. create same job in 611 import to 620 works",1 TDQ-11942,"when set a wrong filter clause, can not get data from database, but get a wrong infomation","1. create a column/function/column set analysis 2. set ""a"" in the ""Data Filter"" part 3. click ""refresh data"" 4. can not show any data in data preview part, and get an information: ""No data available because fail to connect connection"" in fact the reason is not fail to connect connection but a wrong filter, the message is not correct on 611 we get inform dialog: ",1 TDQ-11944,"create mdm connection still exist in FR studio cheat sheet","1. start a studio default is EN 2. switch language to fr, 3. restart it. check the cheat sheet, the option for create mdm connection still exist, should remove it. on TDQ-9553 we have remove the mdm code",1 TDQ-11948,"Follow the input format in data masking functions","for example: if a input credit card number is written as 5322 3560 8496 3749 with spaces between groups of four digits, the generated result should be in this format as well. Currently, we can achieve the format using replace digit function. but the generated number may not be valid. Add a column in the table with a column ""keep format"" in the component settings Default is ""no"": we don't keep the format. # DI component # Spark component",5 TDQ-11949,"No response after click chart for matching key when import rule with custom matching type","1.create match analysis with File 2.Crate rule and se matching type to be custom, and class 3.Import rule to be analysis 4.Click Chart under Match and Survivor Expected results: The result shows. Actual result: Nothing shows.the error log as below: {code} java.lang.AbstractMethodError org.talend.dataquality.matchmerge.mfb.MFBRecordMatcher.matchScore(MFBRecordMatcher.java:95) org.talend.dataquality.matchmerge.mfb.MFBRecordMatcher.getMatchingWeight(MFBRecordMatcher.java:67) org.talend.dataquality.record.linkage.record.CombinedRecordMatcher.getMatchingWeight(CombinedRecordMatcher.java:156) org.talend.dataquality.matchmerge.mfb.MFB.doMatch(MFB.java:210) org.talend.dataquality.matchmerge.mfb.MFB.execute(MFB.java:171) org.talend.dataquality.record.linkage.grouping.swoosh.DQMFB.matchOneRecord(DQMFB.java:73) org.talend.dataquality.record.linkage.grouping.TSwooshGrouping.swooshMatch(TSwooshGrouping.java:138) org.talend.dataquality.record.linkage.grouping.TSwooshGrouping.swooshMatch(TSwooshGrouping.java:122) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.end(AbstractRecordGrouping.java:432) org.talend.dataquality.record.linkage.grouping.AnalysisMatchRecordGrouping.end(AnalysisMatchRecordGrouping.java:158) org.talend.dataquality.record.linkage.grouping.AnalysisMatchRecordGrouping.run(AnalysisMatchRecordGrouping.java:107) org.talend.dq.analysis.match.ExecuteMatchRuleHandler.computeMatchGroupResult(ExecuteMatchRuleHandler.java:142) org.talend.dq.analysis.match.ExecuteMatchRuleHandler.computeMatchGroupWithBlockKey(ExecuteMatchRuleHandler.java:85) org.talend.dq.analysis.match.ExecuteMatchRuleHandler.execute(ExecuteMatchRuleHandler.java:53) org.talend.dataquality.record.linkage.ui.section.AbstractMatchKeyWithChartTableSection.computeMatchResult(AbstractMatchKeyWithChartTableSection.java:193) org.talend.dataquality.record.linkage.ui.section.MatchingKeySection.refreshChart(MatchingKeySection.java:545) org.talend.dataquality.record.linkage.ui.section.MatchingKeySection.refreshChart(MatchingKeySection.java:523) org.talend.dataquality.record.linkage.ui.action.RefreshChartAction.run(RefreshChartAction.java:32) org.talend.dataquality.record.linkage.ui.section.AbstractMatchAnaysisTableSection$5.widgetSelected(AbstractMatchAnaysisTableSection.java:289) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.dataprofiler.rcp.intro.Application.start(Application.java:78) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code}",1 TDQ-11956,"resolve the TUJ issues related with DQ","https://tuj.talend.com/1_8_colibri/jobs.php there exist some failed TUJ related with DQ, need to fix them: - tMatchGroup_TDQ6001_noblock_disk {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GRP_QUALITY cannot be resolved or is not a field p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk$15.outputRow(tMatchGroup_TDQ6001_noblock_disk.java:13496) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.updateWithExtendedColumn(AbstractRecordGrouping.java:469) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.vsrMatch(AbstractRecordGrouping.java:308) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.doGroup(AbstractRecordGrouping.java:239) p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk.tFixedFlowInput_5Process(tMatchGroup_TDQ6001_noblock_disk.java:13567) p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk.tFixedFlowInput_4Process(tMatchGroup_TDQ6001_noblock_disk.java:11559) p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk.tFixedFlowInput_3Process(tMatchGroup_TDQ6001_noblock_disk.java:8571) p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk.tFixedFlowInput_2Process(tMatchGroup_TDQ6001_noblock_disk.java:6283) p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk.tFixedFlowInput_1Process(tMatchGroup_TDQ6001_noblock_disk.java:3995) p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk.tFileInputDelimited_1Process(tMatchGroup_TDQ6001_noblock_disk.java:1776) p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk.runJobInTOS(tMatchGroup_TDQ6001_noblock_disk.java:19878) p_java_8020.tmatchgroup_tdq6001_noblock_disk_0_1.tMatchGroup_TDQ6001_noblock_disk.main(tMatchGroup_TDQ6001_noblock_disk.java:19675) {code} - tMatchGroup_TDQ6001_noblock_memory {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GRP_QUALITY cannot be resolved or is not a field p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory$15.outputRow(tMatchGroup_TDQ6001_noblock_memory.java:13496) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.updateWithExtendedColumn(AbstractRecordGrouping.java:469) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.vsrMatch(AbstractRecordGrouping.java:308) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.doGroup(AbstractRecordGrouping.java:239) p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory.tFixedFlowInput_5Process(tMatchGroup_TDQ6001_noblock_memory.java:13567) p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory.tFixedFlowInput_4Process(tMatchGroup_TDQ6001_noblock_memory.java:11559) p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory.tFixedFlowInput_3Process(tMatchGroup_TDQ6001_noblock_memory.java:8571) p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory.tFixedFlowInput_2Process(tMatchGroup_TDQ6001_noblock_memory.java:6283) p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory.tFixedFlowInput_1Process(tMatchGroup_TDQ6001_noblock_memory.java:3995) p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory.tFileInputDelimited_1Process(tMatchGroup_TDQ6001_noblock_memory.java:1776) p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory.runJobInTOS(tMatchGroup_TDQ6001_noblock_memory.java:19878) p_java_8019.tmatchgroup_tdq6001_noblock_memory_0_1.tMatchGroup_TDQ6001_noblock_memory.main(tMatchGroup_TDQ6001_noblock_memory.java:19675) {code} - tMatchGroup_TDQ6001_withblock_disk {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GRP_QUALITY cannot be resolved or is not a field p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk$15.outputRow(tMatchGroup_TDQ6001_withblock_disk.java:14321) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.updateWithExtendedColumn(AbstractRecordGrouping.java:469) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.vsrMatch(AbstractRecordGrouping.java:308) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.doGroup(AbstractRecordGrouping.java:239) p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk.tFixedFlowInput_5Process(tMatchGroup_TDQ6001_withblock_disk.java:14397) p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk.tFixedFlowInput_4Process(tMatchGroup_TDQ6001_withblock_disk.java:12223) p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk.tFixedFlowInput_3Process(tMatchGroup_TDQ6001_withblock_disk.java:9069) p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk.tFixedFlowInput_2Process(tMatchGroup_TDQ6001_withblock_disk.java:6615) p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk.tFixedFlowInput_1Process(tMatchGroup_TDQ6001_withblock_disk.java:4161) p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk.tFileInputDelimited_1Process(tMatchGroup_TDQ6001_withblock_disk.java:1776) p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk.runJobInTOS(tMatchGroup_TDQ6001_withblock_disk.java:20708) p_java_8020.tmatchgroup_tdq6001_withblock_disk_0_1.tMatchGroup_TDQ6001_withblock_disk.main(tMatchGroup_TDQ6001_withblock_disk.java:20505) {code} - tMatchGroup_TDQ6001_withblock_memory {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GRP_QUALITY cannot be resolved or is not a field p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory$10.outputRow(tMatchGroup_TDQ6001_withblock_memory.java:14262) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.end(AbstractRecordGrouping.java:427) p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory.tFixedFlowInput_5Process(tMatchGroup_TDQ6001_withblock_memory.java:14341) p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory.tFixedFlowInput_4Process(tMatchGroup_TDQ6001_withblock_memory.java:12175) p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory.tFixedFlowInput_3Process(tMatchGroup_TDQ6001_withblock_memory.java:9033) p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory.tFixedFlowInput_2Process(tMatchGroup_TDQ6001_withblock_memory.java:6591) p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory.tFixedFlowInput_1Process(tMatchGroup_TDQ6001_withblock_memory.java:4149) p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory.tFileInputDelimited_1Process(tMatchGroup_TDQ6001_withblock_memory.java:1776) p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory.runJobInTOS(tMatchGroup_TDQ6001_withblock_memory.java:20648) p_java_8019.tmatchgroup_tdq6001_withblock_memory_0_1.tMatchGroup_TDQ6001_withblock_memory.main(tMatchGroup_TDQ6001_withblock_memory.java:20445) {code} - tGroup_14165_block1_exact0_unSorted {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GRP_QUALITY cannot be resolved or is not a field p_java_8019.tgroup_14165_block1_exact0_unsorted_0_1.tGroup_14165_block1_exact0_unSorted$2.outputRow(tGroup_14165_block1_exact0_unSorted.java:3352) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.end(AbstractRecordGrouping.java:427) p_java_8019.tgroup_14165_block1_exact0_unsorted_0_1.tGroup_14165_block1_exact0_unSorted.tFixedFlowInput_2Process(tGroup_14165_block1_exact0_unSorted.java:3429) p_java_8019.tgroup_14165_block1_exact0_unsorted_0_1.tGroup_14165_block1_exact0_unSorted.tFileInputDelimited_1Process(tGroup_14165_block1_exact0_unSorted.java:1180) p_java_8019.tgroup_14165_block1_exact0_unsorted_0_1.tGroup_14165_block1_exact0_unSorted.runJobInTOS(tGroup_14165_block1_exact0_unSorted.java:6435) p_java_8019.tgroup_14165_block1_exact0_unsorted_0_1.tGroup_14165_block1_exact0_unSorted.main(tGroup_14165_block1_exact0_unSorted.java:6268) {code} - tGroup_14165_block1_exact0_unSorted_disk {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GRP_QUALITY cannot be resolved or is not a field p_java_8020.tgroup_14165_block1_exact0_unsorted_disk_0_1.tGroup_14165_block1_exact0_unSorted_disk$3.outputRow(tGroup_14165_block1_exact0_unSorted_disk.java:3364) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.end(AbstractRecordGrouping.java:427) p_java_8020.tgroup_14165_block1_exact0_unsorted_disk_0_1.tGroup_14165_block1_exact0_unSorted_disk.tFixedFlowInput_2Process(tGroup_14165_block1_exact0_unSorted_disk.java:3442) p_java_8020.tgroup_14165_block1_exact0_unsorted_disk_0_1.tGroup_14165_block1_exact0_unSorted_disk.tFileInputDelimited_1Process(tGroup_14165_block1_exact0_unSorted_disk.java:1181) p_java_8020.tgroup_14165_block1_exact0_unsorted_disk_0_1.tGroup_14165_block1_exact0_unSorted_disk.runJobInTOS(tGroup_14165_block1_exact0_unSorted_disk.java:6448) p_java_8020.tgroup_14165_block1_exact0_unsorted_disk_0_1.tGroup_14165_block1_exact0_unSorted_disk.main(tGroup_14165_block1_exact0_unSorted_disk.java:6281) {code} - tGroup_14165_block2_exact2_Sorted {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GRP_QUALITY cannot be resolved or is not a field p_java_8019.tgroup_14165_block2_exact2_sorted_0_1.tGroup_14165_block2_exact2_Sorted$2.outputRow(tGroup_14165_block2_exact2_Sorted.java:3428) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.end(AbstractRecordGrouping.java:427) p_java_8019.tgroup_14165_block2_exact2_sorted_0_1.tGroup_14165_block2_exact2_Sorted.tFixedFlowInput_2Process(tGroup_14165_block2_exact2_Sorted.java:3507) p_java_8019.tgroup_14165_block2_exact2_sorted_0_1.tGroup_14165_block2_exact2_Sorted.tFileInputDelimited_1Process(tGroup_14165_block2_exact2_Sorted.java:1180) p_java_8019.tgroup_14165_block2_exact2_sorted_0_1.tGroup_14165_block2_exact2_Sorted.runJobInTOS(tGroup_14165_block2_exact2_Sorted.java:6525) p_java_8019.tgroup_14165_block2_exact2_sorted_0_1.tGroup_14165_block2_exact2_Sorted.main(tGroup_14165_block2_exact2_Sorted.java:6358) {code} - tGroup_14165_block1 {code} Exception in thread ""main"" java.lang.Error: Unresolved compilation problem: GRP_QUALITY cannot be resolved or is not a field p_java_8020.tgroup_14165_block1_0_1.tGroup_14165_block1$2.outputRow(tGroup_14165_block1.java:3360) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.updateWithExtendedColumn(AbstractRecordGrouping.java:469) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.vsrMatch(AbstractRecordGrouping.java:308) org.talend.dataquality.record.linkage.grouping.AbstractRecordGrouping.doGroup(AbstractRecordGrouping.java:239) p_java_8020.tgroup_14165_block1_0_1.tGroup_14165_block1.tFixedFlowInput_2Process(tGroup_14165_block1.java:3433) p_java_8020.tgroup_14165_block1_0_1.tGroup_14165_block1.tFileInputDelimited_1Process(tGroup_14165_block1.java:1181) p_java_8020.tgroup_14165_block1_0_1.tGroup_14165_block1.runJobInTOS(tGroup_14165_block1.java:6455) p_java_8020.tgroup_14165_block1_0_1.tGroup_14165_block1.main(tGroup_14165_block1.java:6288) {code} seems all failed TUJ cause by: GRP_QUALITY cannot be resolved or is not a field after discuss with zshen, these problems will be resolved after TDQ-11843 done",1 TDQ-11957,"at certain operations, error log get failed status, but the Analysis result UI doesn't change","1. create a column analysis about mysql, run it, successfully. 2. create a pattern, add ""Default"" definition. 3. add pattern to analysis. 4. change pattern definition to ""Oracle"", then analysis should run failed (If run analysis before change pattern, it will not fail.） 5. run analysis , other indicators not run at all. in error log, get failed status, but in Analysis UI doesn't change, still step 1 result, other indicator also doesn't run,Attached the log and pic. on 611 will get failed status, and{color:red}+ other indicators will run+{color} what our process, first check definition is ok or not, if all ok, then run?, but in error log we connect to db, if we don't run can we avoid connect db. if one not ok, then stop the process? 622 error log {code} !ENTRY org.talend.platform.logging 1 0 2016-04-28 12:06:36.879 !MESSAGE 2016-04-28 12:06:36,879 INFO org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction - DB Product Name: MySQL !ENTRY org.talend.platform.logging 1 0 2016-04-28 12:06:36.879 !MESSAGE 2016-04-28 12:06:36,879 INFO org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction - DB Product Version: 5.6.19-log !ENTRY org.talend.platform.logging 1 0 2016-04-28 12:06:37.159 !MESSAGE 2016-04-28 12:06:37,159 INFO org.talend.dq.helper.AnalysisExecutorHelper - Connection to mysql_db_for_testlink !ENTRY org.talend.platform.logging 4 0 2016-04-28 12:06:37.169 !MESSAGE 2016-04-28 12:06:37,159 ERROR org.talend.dq.analysis.AnalysisExecutor - No pattern found for database type: MySQL for indicator pp_1 !ENTRY org.talend.platform.logging 4 0 2016-04-28 12:06:37.169 !MESSAGE 2016-04-28 12:06:37,169 ERROR org.talend.dq.analysis.ColumnAnalysisSqlExecutor - Error when creating query with indicator ""pp_1"" !ENTRY org.talend.platform.logging 1 0 2016-04-28 12:06:37.549 !MESSAGE 2016-04-28 12:06:37,549 INFO org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction - ""Analysis ""column_mysql"" execution code: KO: No pattern found for database type: MySQL for indicator pp_1. Duration: 0.23 s. {code}",1 TDQ-11959,"result page can not show result dynamically","*issue 1* 1. create a column analysis, add two varchar columns, add simple indicators. run it, change to Analysis Result page , ok 2. back to Analysis Settings page, add Text indicators and benford law indicators. 3. re-run analysis, but it can only show simple indicator, only when analysis run finished show Text indicators and benford law indicator, should show all indicators first, then dynamic show result. *issue 2* 1. create a column analysis, add varchar columns, add frequency indicators for the analysis. 2. run it, it will changes to Result page , on the result page, pic get chart firstly, table chart only get result after analysis run finished, for this please make all frequency indicators ok. *issue 3* 1. run column analysis with summary indicators, ok 2. focus on ""Analysis Results"" page, re-run analysis, only result on table chart dynamic show, the pic chart show last result directly. 3. same issue for Pattern ",5 TDQ-11963,"Create tDataShuffling component","Function: the component tDataShuffling allows to rearrange the data through the rows in the same column. Description: The input is a table. User choose the groups of columns to be shuffled. If no columns set as partition, the shuffling process will be implemented through the whole table. However, if one or more columns are chosen as the partition group, first the whole table is separated into several sub table who share the same value in the partitioned columns. Then the shuffling process will be implemented independently in each sub table. Finally, all the sub tables are merged as a table as output. Basic settings: shuffling columns, this table has two columns: the first column inherits all the columns' names from the previous step. The second column indicates the shuffling group and the default number is 0 which means these columns do not participate in shuffling (no change is done in these columns). User can replace a number different to 0 to indicate the group. If two or more columns have the same number, it means these columns are shuffled together. Advanced settings: partitioned columns: in this table, the user can add the columns used for partitioning the data. These columns separate the shuffling process into small partitions. Only the rows within a partition can be shuffled together. See also documentation in TDQ-11904",3 TDQ-11968,"""Invalid Region Code Count"" can not show with other phone number indicators in same page, but 611 does","1. create a column analysis with all indicators under Phone Number Statistics (column analysis should be java engine) 2. create report with the analysis, run report(use mysql datamart) the generated pdf file can not show same structure result with 611,""Invalid Region Code Count"" show in separated page from others, but 611 show in same page,refer the two pdf file ",3 TDQ-11978,"Unique SSN generation with tDataMasking","With the current data masking component the probability to have a duplicate when you generate SSN is high, we have to combine datamasking component with tUniqRow component to get unique SSN Customer would like to have a way to directly generate unique SSN even if his size of data is big. The new ""generate unique (country) SSN"" will handle this issue. More precisely it will generate a SSN related to the input while the ""generate (country) SSN"" with generate a SSN in a purely random way. It means that for two identical SSNs, the new method will return the same SSN, while the old one may return two different (with a high probability). On the contrary, for two different SSNs, the new method will return two different SSNs, while the old one may return the same (with a very low probability). All the countries already defined (i.e. FR, Germany, JP, UK, US) are handled, as well as two new countries (China and India), for both cases.",1 TDQ-11979,"The Version's values do not show completely during creating hdp connection in TOP","1.Created hdp connection 2.Select Version Expected result: The all version should be shown. Actual result: Just hdp 2.3.0 and 2.4.0 shows.see attachment",1 TDQ-11981,"The related data can not shown in the ""Data Preview"" section after selecting column when create column analysis and set context variable in Where clause","1.Create column analysis by right clicking Analyses.(do not choose column) 2.Set context varaible for Where clause 3.Click Select Columns button 4.Click OK button Expected result: The all column names and data should be shown under ""Data Preview"" section. Actual result: Just column name show, no data shows.see attachment, the error log as below: {code} com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown column 'context.new1' in 'where clause' sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) java.lang.reflect.Constructor.newInstance(Constructor.java:408) com.mysql.jdbc.Util.handleNewInstance(Util.java:409) com.mysql.jdbc.Util.getInstance(Util.java:384) com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4232) com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4164) com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2615) com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2776) com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2832) com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2781) com.mysql.jdbc.StatementImpl.execute(StatementImpl.java:908) com.mysql.jdbc.StatementImpl.execute(StatementImpl.java:788) org.talend.cwm.db.connection.DatabaseSQLExecutor.executeQuery(DatabaseSQLExecutor.java:151) org.talend.dataquality.record.linkage.ui.composite.table.ColumnAnalysisDataSamTable.createPreviewData(ColumnAnalysisDataSamTable.java:125) org.talend.dataquality.record.linkage.ui.composite.table.DataSampleTable.getPreviewData(DataSampleTable.java:1074) org.talend.dataquality.record.linkage.ui.composite.table.DataSampleTable.reDrawTable(DataSampleTable.java:1054) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.refreshPreviewTable(AbstractAnalysisMetadataPage.java:1103) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.refreshPreviewData(AbstractAnalysisMetadataPage.java:1455) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.openColumnsSelectionDialog(AbstractAnalysisMetadataPage.java:1357) org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage$12.mouseDown(AbstractAnalysisMetadataPage.java:1330) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:192) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:197) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code}",1 TDQ-12020,"Check whether we can allow multiple connections with hive server","in the analysis editor, there is a parameter to set the number of concurrent connections. This parameter is not used when we profile Hive. See code of ColumnAnalysisSqlExecutor.canParallel(Connection connection) The more recent versions of Hive should probably support parallel executions. # Investigate and list versions of Hive that will support parallel executions # Raise a Jira feature to support parallel execution whenever it's possible. ",3 TDQ-12035,"Profiler column analysis for Hive creates map/reduce job for each column/indicator","Customer has a Hive table with 75 columns. He's created a column analysis with multiple indicators. When he runs the analysis, it runs a map/reduce job for each column/indicator. This is causing performance issues. Need to have a better way to do this. Customer is using MapR so maybe can use MapR Apache Drill service.",13 TDQ-12036,"bugs related with git project",NULL,8 TDQ-12042,"The ""No replacement found for database type:hive for indicator Pattern Low Frequency"" error dialog shows when create pattern analysis by right selecting Pattern frequency analysis","1.Create cdh55 hive connection 2.Create pattern frequency analysis by right selecting table_automationlw table 3.Run analysis. Expected result: The analysis can be run well. Actual result: It can not run well.see attachment.",1 TDQ-12043,"perspective name is not correct when using Japanese","see screen-shot profile.jpg",1 TDQ-12080,"When navigating from the Integration Perspective to the Profiling and back to the Integration one - there is an issue with the refresh ","When navigating from the Integration Perspective to the Profiling and back to the Integration one - there is an issue with the refresh or some windows are not closing ...",5 TDQ-12053,"Collapse/Expand button's wording incorrect for columns","In the analysis tab, the collapse/expand buttons say ""Collapse all columns"" and ""Expand all columns"" on the individual columns. These buttons only expand for the specified column. They should just say ""Collapse column"" and ""Expand column"". Unfortunately, I cannot screen capture the actual message. I did a screen capture of the buttons I'm talking about.",1 TDQ-12054,"Numerical Analysis results screen not rendering consistently ","Numerical Analysis results screen not rendering consistently. When you run the analysis, you can full screen the results, after when you close the full screen you cannot open it again as the options are no longer viable. You have to rerun the analysis to get the full screen option.",1 TDQ-12061,"tMatchGroup highlighting is not working correctly for imported job","I imported a job from 6.1. I changed the tMatchGroup from Simple VSR to T_Swoosh. The highlighting is not correct. Also, it's showing 0 for GID for all of the records. ",2 TDQ-12078,"Profiler - using Redshift column analysis and generating a job from a REGEX pattern causes problems","I have created a column analysis using Redshift. I set the US Zipcode REGEX pattern on a zipcode field and ran it. It correctly shows the results. I performed a right mouse click and selected the option to generate a job and then the first option to generate an ELT job to get only valid rows. It creates the job, but the Job Selector screen doesn't go away. I can click Finish, but normally it will close by itself. If I click on Finish it will create another job. It creates a blank DI job.",1 TDQ-12084,"Activate Exchange indicators and regexes and rules for 6.3","Upgrade interesting extensions in Talend Exchange. the list of Exchange from https://jira.talendforge.org/browse/TDQ-9003 Exchange * {color:red} 14 Indicators{color} ** Duplicate Rows (x) ** EMail validation via mail server (x) ** Frequency table of hours (/) ** ISO Week Number Frequency (/) ** Length Range Frequency (/) ** Order of Magnitude (/) ** Sample Standard Deviation (/) ** Trimmed (/) ** US_customers_count (/) ** Variance (/) ** Week Frequency (/) ** email_indicator (/) ** phone_area_code_freq (/) ** udi_average_yearly_income (/) * {color:red} 1 ParserRule{color} ** Tweets (/) * {color:red} 5 Regexes{color} ** Only alphabetical characters not empty ** Repeated Character ** Unaccented Words ** Words ** Text ** Email Address (with list of top-level domains) ** Regular Text ** FR Phone Number (parenthesis allowed) ** Names_with_unicode_characters ** Dutch_Phone_Number_(_Local_or_International_) ** Dutch_Postal_Code ** Minutes:Seconds ** Temperature in Celsius (/) * {color:red} SQL{color} ** hotmail email ",3 TDQ-12086,"before add matching key change algorithm for match analysis get two dialog pop up,AND t-swoosh can not show the key have added before reopen","1. create match analysis, by right click table/columns in Repository, then analysis created with columns added, and saved status, default algorithm is vsr, doesn't add any matching key 2. change algorithm to t-swoosh get two dialog pop up, should not----issue 1 3. click the ""Select Matching key"" then select column header to select as matching key, but can not show in the key list, refer to the pic attached.--issue 2. this issue show on 621 and 612",1 TDQ-12087," Analysis run failed after Retrieve schema by select all ","The Issue failed on Studio and SWTbot",1 TDQ-12090,"Create tDataShuffling on Spark",NULL,3 TDQ-12093,"create analysis about connection, connection doesn't contains the client information, cause can delete connection directly.","1. create a dbconnection, file connection. 2. create analysis depend on two connections. 3. delete two connection to recycle bin. 4. try to delete two connection from recycle Bin. delete directly,but two analysis still there-- just get delete confirm dialog, but doesn't get delete the dependency items dialog. check the db item file no client information exist. WHEN export analysis also can not directly checked the used connection. for 612, 602 db item also doesn't store the client information, but when delete connection get dependency dialog, restart studio, can directly delete the connection. ",1 TDQ-12096,"tDqReportRun need to download org.talend.dataquality.common-1.4.4.jar, but the build contains ""*_1.4.5""","try to use tDqReportRun , but it need to manually add org.talend.dataquality.common-1.4.4.jar, serarch it in the build get org.talend.dataquality.common_1.4.5.jar when we change the jar version, also need to update the code/xml where we use it.",1 TDQ-12099,"tMatchGroup with separate out will have compile error in MR job","Hi, Create a job with tMatchGroup with advanced setting ""separete out"", connect to an output component, in this case, change to the code page, we will find there has an compile error: ""mos"" and ""reporterFinal"" cannot be resolved See attached screenshot.",2 TDQ-12110,"after rename the report, can not preview the new generated report","1. create a report ""a"", generate a report, can preview report 2. rename the report ""a"" to ""b"" in the editor, generate a report, can NOT preview the generate report(close the eidtor and reopen, can preview) ",1 TDQ-12111,"save analysis's clientDependency twice","1. create a column analysis with a column seletecd 2. add a pattern, the analysis is dirty status 3. run analysis check the pattern and analysis item file, the saved clientDependency twice like follows in analysis saved: in pattern rule saved: for business rule analysis add a rule with get the same result",1 TDQ-12116,"let junit test case CWMPluginTest run successfully","when run the junit test case CWMPluginTest , there will get many NPE: {code} EclipseTestRunner.run(EclipseTestRunner.java:208) [exec] org.eclipse.swtbot.eclipse.junit.headless.UITestApplication.runTests(UITestApplication.java:116) [exec] org.eclipse.e4.ui.internal.workbench.swt.E4Testable$1.run(E4Testable.java:73) [exec] java.lang.Thread.run(Thread.java:745) [exec] ERROR: java.lang.NullPointerException [exec] java.lang.NullPointerException [exec] net.sourceforge.sqlexplorer.service.SqlexplorerService.getPropertyFile(SqlexplorerService.java:427) [exec] net.sourceforge.sqlexplorer.service.SqlexplorerService.addConnetionAliasToSQLPlugin(SqlexplorerService.java:296) [exec] org.talend.dq.helper.SqlExplorerUtils.addConnetionAliasToSQLPlugin(SqlExplorerUtils.java:225) [exec] org.talend.dq.CWMPlugin.addConnetionAliasToSQLPlugin(CWMPlugin.java:76) [exec] org.talend.dq.CWMPluginTest.runAddConnetionAliasToSQLPlugin(CWMPluginTest.java:87) [exec] org.talend.dq.CWMPluginTest.testAddConnetionAliasToSQLPlugin_supportDB(CWMPluginTest.java:79) [exec] sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [exec] sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [exec] sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [exec] java.lang.reflect.Method.invoke(Method.java:498) [exec] junit.framework.TestCase.runTest(TestCase.java:176) [exec] junit.framework.TestCase.runBare(TestCase.java:141) [exec] junit.framework.TestResult$1.protect(TestResult.java:122) [exec] junit.framework.TestResult.runProtected(TestResult.java:142) [exec] junit.framework.TestResult.run(TestResult.java:125) [exec] junit.framework.TestCase.run(TestCase.java:129) [exec] junit.framework.TestSuite.runTest(TestSuite.java:255) [exec] junit.framework.TestSuite.run(TestSuite.java:250) [exec] org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84) [exec] org.junit.runners.Suite.runChild(Suite.java:127) [exec] org.talend.test.GenericTestsJUnit4Suite.runChild(GenericTestsJUnit4Suite.java:151) [exec] org.junit.runners.Suite.runChild(Suite.java:26) [exec] org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [exec] org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [exec] org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [exec] org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [exec] org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [exec] org.junit.runners.ParentRunner.run(ParentRunner.java:309) [exec] org.talend.test.GenericTestsJUnit4Suite.run(GenericTestsJUnit4Suite.java:176) [exec] junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38) [exec] org.eclipse.swtbot.eclipse.junit.headless.EclipseTestRunner.run(EclipseTestRunner.java:350) [exec] org.eclipse.swtbot.eclipse.junit.headless.EclipseTestRunner.run(EclipseTestRunner.java:208) [exec] org.eclipse.swtbot.eclipse.junit.headless.UITestApplication.runTests(UITestApplication.java:116) [exec] org.eclipse.e4.ui.internal.workbench.swt.E4Testable$1.run(E4Testable.java:73) [exec] java.lang.Thread.run(Thread.java:745) [exec] [exec] !ENTRY org.talend.platform.logging 4 0 2016-05-27 09:02:41.929 [exec] !MESSAGE 2016-05-27 09:02:41,929 ERROR net.sourceforge.sqlexplorer.service.SqlexplorerService - java.lang.NullPointerException [exec] [exec] !STACK 0 [exec] java.lang.NullPointerException [exec] net.sourceforge.sqlexplorer.service.SqlexplorerService.getPropertyFile(SqlexplorerService.java:427) [exec] net.sourceforge.sqlexplorer.service.SqlexplorerService.addConnetionAliasToSQLPlugin(SqlexplorerService.java:296) [exec] org.talend.dq.helper.SqlExplorerUtils.addConnetionAliasToSQLPlugin(SqlExplorerUtils.java:225) [exec] org.talend.dq.CWMPlugin.addConnetionAliasToSQLPlugin(CWMPlugin.java:76) [exec] org.talend.dq.CWMPluginTest.runAddConnetionAliasToSQLPlugin(CWMPluginTest.java:87) [exec] org.talend.dq.CWMPluginTest.testAddConnetionAliasToSQLPlugin_supportDB(CWMPluginTest.java:79) [exec] sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [exec] sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [exec] sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [exec] java.lang.reflect.Method.invoke(Method.java:498) [exec] junit.framework.TestCase.runTest(TestCase.java:176) [exec] junit.framework.TestCase.runBare(TestCase.java:141) [exec] junit.framework.TestResult$1.protect(TestResult.java:122) [exec] junit.framework.TestResult.runProtected(TestResult.java:142) [exec] junit.framework.TestResult.run(TestResult.java:125) [exec] junit.framework.TestCase.run(TestCase.java:129) [exec] junit.framework.TestSuite.runTest(TestSuite.java:255) [exec] junit.framework.TestSuite.run(TestSuite.java:250) [exec] org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84) [exec] org.junit.runners.Suite.runChild(Suite.java:127) [exec] org.talend.test.GenericTestsJUnit4Suite.runChild(GenericTestsJUnit4Suite.java:151) [exec] org.junit.runners.Suite.runChild(Suite.java:26) [exec] org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [exec] org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [exec] org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [exec] org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [exec] org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [exec] org.junit.runners.ParentRunner.run(ParentRunner.java:309) [exec] org.talend.test.GenericTestsJUnit4Suite.run(GenericTestsJUnit4Suite.java:176) [exec] junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38) [exec] org.eclipse.swtbot.eclipse.junit.headless.EclipseTestRunner.run(EclipseTestRunner.java:350) [exec] org.eclipse.swtbot.eclipse.junit.headless.EclipseTestRunner.run(EclipseTestRunner.java:208) [exec] org.eclipse.swtbot.eclipse.junit.headless.UITestApplication.runTests(UITestApplication.java:116) [exec] org.eclipse.e4.ui.internal.workbench.swt.E4Testable$1.run(E4Testable.java:73) [exec] java.lang.Thread.run(Thread.java:745) [exec] ERROR: java.lang.NullPointerException [exec] java.lang.NullPointerException [exec] net.sourceforge.sqlexplorer.service.SqlexplorerService.getPropertyFile(SqlexplorerService.java:427) [exec] net.sourceforge.sqlexplorer.service.SqlexplorerService.addConnetionAliasToSQLPlugin(SqlexplorerService.java:296) [exec] org.talend.dq.helper.SqlExplorerUtils.addConnetionAliasToSQLPlugin(SqlExplorerUtils.java:225) [exec] org.talend.dq.CWMPlugin.addConnetionAliasToSQLPlugin(CWMPlugin.java:76) [exec] org.talend.dq.CWMPluginTest.runAddConnetionAliasToSQLPlugin(CWMPluginTest.java:87) [exec] org.talend.dq.CWMPluginTest.testAddConnetionAliasToSQLPlugin_supportDB(CWMPluginTest.java:79) [exec] sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [exec] sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [exec] sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [exec] java.lang.reflect.Method.invoke(Method.java:498) [exec] junit.framework.TestCase.runTest(TestCase.java:176) [exec] junit.framework.TestCase.runBare(TestCase.java:141) [exec] junit.framework.TestResult$1.protect(TestResult.java:122) [exec] junit.framework.TestResult.runProtected(TestResult.java:142) [exec] junit.framework.TestResult.run(TestResult.java:125) [exec] junit.framework.TestCase.run(TestCase.java:129) [exec] junit.framework.TestSuite.runTest(TestSuite.java:255) [exec] junit.framework.TestSuite.run(TestSuite.java:250) [exec] org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84) [exec] org.junit.runners.Suite.runChild(Suite.java:127) [exec] org.talend.test.GenericTestsJUnit4Suite.runChild(GenericTestsJUnit4Suite.java:151) [exec] org.junit.runners.Suite.runChild(Suite.java:26) [exec] org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) [exec] org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) [exec] org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) [exec] org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) [exec] org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) [exec] org.junit.runners.ParentRunner.run(ParentRunner.java:309) [exec] org.talend.test.GenericTestsJUnit4Suite.run(GenericTestsJUnit4Suite.java:176) [exec] junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38) [exec] org.eclipse.swtbot.eclipse.junit.headless.EclipseTestRunner.run(EclipseTestRunner.java:350) [exec] org.eclipse.swtbot.eclipse.junit.headless.EclipseTestRunner.run(EclipseTestRunner.java:208) [exec] org.eclipse.swtbot.eclipse.junit.headless.UITestApplication.runTests(UITestApplication.java:116) [exec] org.eclipse.e4.ui.internal.workbench.swt.E4Testable$1.run(E4Testable.java:73) [exec] java.lang.Thread.run(Thread.java:745) {code} more details see: http://192.168.31.21:8080/view/Junits_Studio/job/Studio_JUnit_master_DQ/203/console",1 TDQ-12119,"Job select shell of generate job did not closed after click button"" finish""",NULL,1 TDQ-12126,"cannot create twice report","create an analysis right click on analysis to create a new report right click a second time to create a new report message : the physical folder already exists ",1 TDQ-12129,"connection/catalog overview report content is not correct ","1. create a mysql connection--in creation wizard set ""Database"" parameter as tbi 2. create a connection overview analysis about the connection. 3. create a report about the analysis. run report with mysql datamart. Check the result, the first page, on the chart show a green bar with ""Views"" marked, but the connection not only contains views , but also tables,keys, index refer to two attached pdf files. and also second page content is different with 611 --*issue 1* 4. create a sqlserver connection--in creation wizard set ""Database"" and ""Schema"" parameters. 5. create a catalog overview analysis about the sqlserver connection, create a report with the analysis, run report with mysql datamart. the report content is different with 611 --*issue 2*",1 TDQ-12137,"Port tGenKey to Spark","Batch + Streaming. It should be compatible with Spark 1.4 up to 1.6 Make sure that it can also be compatible with Spark 2.0. !tGenKeyProperties.png|thumbnail! There is a button to open a wizard to import rules from repository. The table cells are grayed out in some conditions. This is currently not possible the new component framework. We may need to make changes in the new framework in order to be able to do it. ",5 TDQ-12139,"Port tVerifyEmail to Spark","* Syntactic validation only * Batch + Streaming * Update TLD list (add a ""refresh"" button in the Studio) * Build a reusable library !tVerifyEmail.png|thumbnail!",13 TDQ-12140,"Port tRuleSurvivorship to Spark","!tRuleSurvivorship.png|thumbnail! Make this component available in the Spark palette.",3 TDQ-12141,"Have a component similar to tUniqRows on Spark","* Based on Bloom filters * Batch + Streaming * Shouldn't we rename the component since it won't be an exact porting? http://highscalability.com/blog/2016/4/4/how-to-remove-duplicates-in-a-large-dataset-reducing-memory.html Check with the BD team whether it can be implemented in the tUniqRow or in a new component. ",5 TDQ-12143,"Port tSynonymSearch to Spark","Batch + Streaming",5 TDQ-12149,"text indicator will show threshold added icon even no any threshold add.","1. create a column analysis. 2. add a varchar column, add all indicators under ""Text Statistics"" 3. check the analysis editor, all text indicators show icon like added threshold, but doesn't add. should not show this icon.",1 TDQ-12150,"""Pattern Low Frequency"" indicator show wrong indicator name--""Value Low Frequency"" indicator.","1. create a column analysis, add a varchar column. 2. try to add ""Pattern Low Frequency"" indicator , but it show wrong name in Indicator selection dialog, analysis editor, and Analysis Results page.",1 TDQ-12153,"The NPE error message shows after clicking Next button in the Sematic Category Inference dialog","1.Select Sematci-aware Analysis by right clicking one table 2.Click Next button in the Sematic Category Inference dialog Expected result： Everything worked well Actual result: The NPE shows.see attachment. the error message as below: {code} java.lang.NullPointerException java.lang.NullPointerException org.talend.dataquality.ontology.mapping.OntologyRepositoryManager.getTdColumnToAttributeMap(OntologyRepositoryManager.java:158) org.talend.dataquality.ontology.ui.wizard.MapOntologyPage.createDataset(MapOntologyPage.java:204) org.talend.dataquality.ontology.ui.wizard.MapOntologyPage.computeChart(MapOntologyPage.java:174) org.talend.dataquality.ontology.ui.wizard.MapOntologyPage.createChart(MapOntologyPage.java:148) org.talend.dataquality.ontology.ui.wizard.MapOntologyPage.createJFreeChartComposite(MapOntologyPage.java:131) org.talend.dataquality.ontology.ui.wizard.MapOntologyPage.createSamplingStrategySection(MapOntologyPage.java:119) org.talend.dataquality.ontology.ui.wizard.MapOntologyPage.createControl(MapOntologyPage.java:87) org.eclipse.jface.wizard.WizardDialog.updateForPage(WizardDialog.java:1276) org.eclipse.jface.wizard.WizardDialog.access$4(WizardDialog.java:1268) org.eclipse.jface.wizard.WizardDialog$8.run(WizardDialog.java:1257) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.jface.wizard.WizardDialog.showPage(WizardDialog.java:1254) org.eclipse.jface.wizard.WizardDialog.nextPressed(WizardDialog.java:942) org.talend.dataquality.ontology.ui.wizard.SemanticDiscoveryWizardDialog.nextPressed(SemanticDiscoveryWizardDialog.java:60) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:434) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:619) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.jface.window.Window.runEventLoop(Window.java:832) org.eclipse.jface.window.Window.open(Window.java:808) org.talend.dataquality.ontology.service.SemanticStudioServiceImpl.openSemanticDiscoveryWizard(SemanticStudioServiceImpl.java:45) org.talend.dataprofiler.core.ui.action.actions.predefined.SemanticDiscoveryAction.run(SemanticDiscoveryAction.java:54) org.eclipse.jface.action.Action.runWithEvent(Action.java:519) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:595) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:511) org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:420) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:208) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code}",1 TDQ-12154,"migrate items from 562 get error dialog popup, and ""Pattern Frequency"" indicator still show old name in analysis.","1. start 562 tac, on configuration page select mysql database, create two svn projects in (Project type: DataQuality) in two projects create items like file attached(attached zip file is a remote project) 2. stop 562 tac. 3. start 621 tac, on the configuration page select the database used in 562, then it will inform need to migration, do migration. 4. logon the 621 tac, will show the project has created on 562. 5. start 621 studio, make sure it is a new workspace, logon the remote project. then first perspective is DI, then change to DQ, get error dialog pop up. 6. check the analysis ""column_java_in_first"" and ""column_sql_in_first"", the ""Pattern Frequency"" ,""Pattern Low Frequency"" and ""Date Pattern Frequency"" indicators still show old name. 7. exit studio, then logon another project, during the start up also get error dialog popup.",2 TDQ-12155,"improve NumericVarianceInteger and NumericVarianceLong to avoid integer overflow","We can modify the code to detect integer overflows and substract the variance value from the big integer when it happens (instead of adding it) And try to used {code:java} i+i*rate/100 {code} instead of {code:java} i * (rate + 100) / 100 {code} * to reduce the rate of generate integer overflow.",3 TDQ-12156,"GenerateFromListInteger scalability problem","There is a scalability problem when the input is an int or a double and the number of parameters is too big (> 20). In this case, we can get an exception java.lang.OutOfMemoryError because the parser list increases its size (by the number of parameters) for each row in input. We just need to initialize the parameters at the beginning to avoid this issue.",2 TDQ-12160,"It can not be used after install dqportal with Installer on centos system","1.install tdqportal Advanced +Custom with installer(TP_ALL license) 2.Start tdqportal server 3.Type http://IP:8580/tdqportal Expected result: It can be opened. Actual result: The dqportal website can not be opened.check the tomcat and dqportal server are started. ",1 TDQ-12162,"Can't find drools_0.1.package when tRuleSurvivorship in a subjob of a subjob","Hi, I created a deduplication job that it is using tRuleSurvivorship to apply the survivor to the records. I tested in local and it is working properly. but when publish to nexus or build and run in cmd, it shows error: Caused by: java.io.FileNotFoundException: items\aa\metadata\survivorship\AccountDedupe\drools_0.1.package (系统找不到指定的路径。) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.(FileInputStream.java:146) at org.drools.core.io.impl.FileSystemResource.getInputStream(FileSystemResource.java:123) at org.drools.compiler.compiler.DrlParser.parse(DrlParser.java:150) at org.drools.compiler.compiler.DrlParser.parse(DrlParser.java:144) at org.drools.compiler.builder.impl.KnowledgeBuilderImpl.drlToPackageDescr(KnowledgeBuilderImpl.java:445) at org.drools.compiler.builder.impl.KnowledgeBuilderImpl.addPackageFromDrl(KnowledgeBuilderImpl.java:433) at org.drools.compiler.builder.impl.KnowledgeBuilderImpl.addKnowledgeResource(KnowledgeBuilderImpl.java:653) This only happened when tRuleSurvivorship in a subjob, I attached the testing job and the runtime log.",1 TDQ-12164,"Improve architecture hierarchy in Function class","From org.talend.dataquality.datamasking.functions.Function, there are many inheritances. We can detect redondancies from a class to an other. For example, in MaskEmailDomain and GenerateFromFile classes, there is a redundancy between the attributes ""replacements"" and ""substituteList"". It's an issue if we want to improve these algorithms properly.",2 TDQ-12173,"Remove requirement that Drools server must access to Internet ","currently, Drools server needs an Internet access in order to download the demo project. Without it, it won't start. ",1 TDQ-12178,"tDataMasking in spark and spark streaming job get compile error","1. create spark and sparking job like tFixedFlowInput+tDataMasking+tlogRow. configuration like the attached job. run the two jobs. Actual Result: job run failed Expected Result: job run without error. NOTE: studio is on win7",1 TDQ-12179,"run mr job contains tMatchGroup imported from 611 get error dialog popup","1. in 611 created tMatchGroup mr job, as job attached, run ok 2. import to 621 studio, get error dialog popup,refer to pic attached. Expected Result: should run without error. NOTE: if click ""continue"" on the dialog. job will run ok.",2 TDQ-12180,"SVN: Overwrite import db, analysis, the imported items can not show in the svn server","logon svn project. 1. import ""621_TOP_BD_Fileconnection.zip"" file-- only db and file connection, items show in svn server 2. import ""621_analysis_1.zip"", contains some analysis, db and file connection which same name with step 1. so have to check ""Overwrite ..."" check box to import the db and file connection 3. check the repository, it show well. 4. re-check the svn server, the connections and fileDelimited folder are empty now. 5. import ""621_analysis_2.zip"" , contains same name analysis ""column_mysql"", so have to check the ""Overwrite ..."" check box In order to import it. 6. re-check the svn server, the ""column_mysql"" disappear. NOTE: this issue also exit in 611 release. Expected Result: after Overwrite import some items, the new items should commit to svn. ",5 TDQ-12193,"Upgrade QAS components ","* Batch v7 * Proweb ? * Cloud ? Shall we keep backward compatibility? ",8 TDQ-12194,"deprecate 3 QAS Proweb components","deprecate 3 components tQASAddressIncomplete tQASAddressUnknown tQASAddressVerified Keep these components hidden in the palette. ",2 TDQ-12196,"indicator still use old name in log","1. create a column analysis, add all indicators, run it. 2. check the log file, the log information still show old indicators name, refer to pic attached. Expected Result: should show new name in the log.",1 TDQ-12197,"""Bin low Frequency"" in analysis show result order by desc, should asc","1. create a column analysis, add ""Bin low Frequency"" indicator 2. run the analysis, in analysis result page check the result, Actual Result: show result as count desc, Expected Result: show resutlt as count asc",1 TDQ-12208,"tDqReportRun job can not run when dbconnection use context mode","1. create a mysql connection, click export as context 2. create a column analysis, create a report based on the analysis, set datamart as mysql 3. run report works. 4. generate a tDqReportRun job. run failed. {code} [ERROR]: org.talend.dq.persistence.DatabasePersistence - org.hibernate.PropertyValueException: not-null property references a null or transient value: org.talend.dataprofiler.datamart.hibernate.TdqAnalyzedElement.eltConnectionUuid org.hibernate.PropertyValueException: not-null property references a null or transient value: org.talend.dataprofiler.datamart.hibernate.TdqAnalyzedElement.eltConnectionUuid org.hibernate.engine.Nullability.checkNullability(Nullability.java:72) org.hibernate.event.def.AbstractSaveEventListener.performSaveOrReplicate(AbstractSaveEventListener.java:284) org.hibernate.event.def.AbstractSaveEventListener.performSave(AbstractSaveEventListener.java:180) org.hibernate.event.def.AbstractSaveEventListener.saveWithGeneratedId(AbstractSaveEventListener.java:108) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.saveWithGeneratedOrRequestedId(DefaultSaveOrUpdateEventListener.java:186) org.hibernate.event.def.DefaultSaveEventListener.saveWithGeneratedOrRequestedId(DefaultSaveEventListener.java:33) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.entityIsTransient(DefaultSaveOrUpdateEventListener.java:175) org.hibernate.event.def.DefaultSaveEventListener.performSaveOrUpdate(DefaultSaveEventListener.java:27) org.hibernate.event.def.DefaultSaveOrUpdateEventListener.onSaveOrUpdate(DefaultSaveOrUpdateEventListener.java:70) org.hibernate.impl.SessionImpl.fireSave(SessionImpl.java:535) org.hibernate.impl.SessionImpl.save(SessionImpl.java:523) org.hibernate.impl.SessionImpl.save(SessionImpl.java:519) org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.getCacheTdqAnalyzedElement(AbstractPersistenceHandler.java:331) org.talend.dq.persistence.handlertype.ColumnAnaPersistenceHandler.persist(ColumnAnaPersistenceHandler.java:98) org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.persist(AbstractPersistenceHandler.java:159) org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:142) org.talend.dataquality.reporting.engine.ReportDocGenerator.historizeData(ReportDocGenerator.java:505) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:275) local_project.tdqreportrun_1466143900769_0_1.tdqReportRun_1466143900769.tDqReportRun_1Process(tdqReportRun_1466143900769.java:817) local_project.tdqreportrun_1466143900769_0_1.tdqReportRun_1466143900769.runJobInTOS(tdqReportRun_1466143900769.java:1331) local_project.tdqreportrun_1466143900769_0_1.tdqReportRun_1466143900769.main(tdqReportRun_1466143900769.java:1109) _PAp2IDRSEeaxyadYW7rpFw|simple_1_0.1.rep|2016-06-17 14:12:00|2.306|false|Error during historization of data of report simple_1 : not-null property references a null or transient value: org.talend.dataprofiler.datamart.hibernate.TdqAnalyzedElement.eltConnectionUuid [statistics] disconnected {code}",1 TDQ-12210,"Import demo:error msg at error log list after import DQ demo project ","1.Create project and logon 2.from DI side, Import demo project ,select DQ demo project import Actual Result: error log show up at error log list (*project could import successfully at last*) {noformat} java.lang.reflect.InvocationTargetException org.talend.repository.items.importexport.handlers.ImportExportHandlersManager.importItemRecords(ImportExportHandlersManager.java:536) org.talend.repository.ui.actions.importproject.ImportDemoProjectItemsPage$4.run(ImportDemoProjectItemsPage.java:338) org.talend.commons.ui.swt.dialogs.ProgressDialog$1.run(ProgressDialog.java:79) org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:466) org.eclipse.jface.operation.ModalContext.run(ModalContext.java:374) org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:527) org.talend.commons.ui.swt.dialogs.ProgressDialog$3.run(ProgressDialog.java:146) org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:187) org.eclipse.ui.internal.UISynchronizer.syncExec(UISynchronizer.java:156) org.eclipse.swt.widgets.Display.syncExec(Display.java:4734) org.talend.commons.ui.swt.dialogs.ProgressDialog.executeProcess(ProgressDialog.java:128) org.talend.commons.ui.swt.dialogs.ProgressDialog.executeProcess(ProgressDialog.java:63) org.talend.repository.ui.actions.importproject.ImportDemoProjectItemsPage.performFinish(ImportDemoProjectItemsPage.java:360) org.talend.repository.ui.actions.importproject.ImportDemoProjectItemsWizard.performFinish(ImportDemoProjectItemsWizard.java:62) org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:853) org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:438) org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:619) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.jface.window.Window.runEventLoop(Window.java:832) org.eclipse.jface.window.Window.open(Window.java:808) org.talend.repository.ui.actions.importexport.ImportDemoItemAction.doRun(ImportDemoItemAction.java:122) org.talend.repository.ui.actions.importexport.ImportDemoItemAction.run(ImportDemoItemAction.java:133) org.eclipse.ui.internal.PluginAction.runWithEvent(PluginAction.java:253) org.eclipse.ui.internal.WWinPluginAction.runWithEvent(WWinPluginAction.java:237) org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:595) org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:511) org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:462) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:208) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) Caused by: org.eclipse.core.runtime.CoreException: Import errors org.talend.repository.items.importexport.handlers.ImportExportHandlersManager.importItemRecords(ImportExportHandlersManager.java:537) ... 57 more {noformat}",3 TDQ-12212,"reuse record linkage library for similarity computation","Change in the Scala API so that we reuse our own record linkage library for string similarity computation. Compare the performance between the scala ""stringmetric"" library and our own. If the scala library is better, then see whether we can improve our library. (If not and there is a big gap, then we'll keep the scala library)",3 TDQ-12213,"filter data in the tMatchPairing output","-The aim is to give to the user a balanced data set so that he gets about as many positive matches as false matches.- -for each suspects pairs compute different measures(e.g. jaro, initial, levenshtein...)- -if no measure is higher than a given threshold, filter the suspect pair- -one threshold per measure or one global threshold? the distribution of each measure maybe different. => One global percentile- -add an option for selecting the columns which should be match exactly, those column names should be save in the output model.- -In TDS, the user must be able to filter the data to see the pairs which are highly suspects and also pairs that are poorly suspect. (using a cursor with a min value and max value ? and also an option to choose to be inside the bounds - in [0.2, 0.85] or outside the bounds in [0, 0.2] and [0.85,1] ?-ote -Idea : give the percentile for a set of measures- -TODO : Give an API for filtering (need to compute measures and percentile)- *Note:* {color:red} The suspect output may be different with every execution of the job when set a small nb for the param ""size of the sample for percentile computation"".{color} A ramdon seed option (for fixing the output) will be added after TDQ-12370 be done. ",8 TDQ-12215,"when table use ""Column Filter"", the existing analysis show wrong text on column selection dialog","1. create a column analysis with the tbi-->employee table, select all the columns 2. close the analysis editor. 3. right click on tbi->employee select menu ""Column Filter"" , on the pop up dialog set value ""employee_id"" for ""Column Filter"" parameter, click ""ok"" on the dialog. 4. open the analysis editor, click ""Select Columns"", on the ""Column Selection"" dialog bottom part get text. Actual Result: show wrong text: This analysis contains columns that belong to different tables. Please, select columns that belong to only table Expected Result: should show correct text. please find which issue cause this, and which version affected.",1 TDQ-12220,"first time running business rule anlaysis, the dynamic result show Match with red color and with warning icon","1. import the attached file, create a new business rule analysis as attached, also add the five sql rules. 2. run the new analysis, check the result on result page show can show result dynamic, but show Match and Not Match with red color, and Match with a warning icon, it is different with second time run and final show status. refer to pic attached. Expected Result: should show the result always same.",1 TDQ-12223,"when report logo file set a not exist jpg file, the popup message is not correct.","1. in report editor select a valid jpg file as logo 2. change the name to not exist one, then save report. get dialog pop up file, but the text is not correct Expected Result: should not show ""select a valid template file"" but a logo file.",1 TDQ-12230,"The inputs of tMatchPredict could be also the suspect pairs of records","# ""Match pairing model"" should be a option: don't need to ""Pair"" the records, if the inputs are already the suspect pairs. # Disable ""uniqueOut"" and ""exactOut"" connections if the option ""Match pairing model"" is not selected.",3 TDQ-12232,"can't generate report file successfully","generate report file get error: {code} java.lang.NullPointerException org.talend.cwm.management.i18n.InternationalizationUtil.getCategoryInternationalizationLabel(InternationalizationUtil.java:57) org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.getCategoryLabel(AbstractPersistenceHandler.java:692) org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.createTdqIndicatorDefinition(AbstractPersistenceHandler.java:658) org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.getCachedTdqIndicatorDef(AbstractPersistenceHandler.java:631) org.talend.dq.persistence.handlertype.ColumnAnaPersistenceHandler.persist(ColumnAnaPersistenceHandler.java:102) org.talend.dq.persistence.handlertype.AbstractPersistenceHandler.persist(AbstractPersistenceHandler.java:159) org.talend.dq.persistence.DatabasePersistence.persist(DatabasePersistence.java:142) org.talend.dataquality.reporting.engine.ReportDocGenerator.historizeData(ReportDocGenerator.java:505) org.talend.dataquality.reporting.engine.ReportDocGenerator.generate(ReportDocGenerator.java:275) org.talend.dataprofiler.core.tdq.action.LocalReportDocGenerator.generate(LocalReportDocGenerator.java:129) org.talend.dataprofiler.core.tdq.ui.action.GenerateReportFileAction$2.run(GenerateReportFileAction.java:342) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) {code}",1 TDQ-12238,"[5.6.1] profiling hive with simple column analysis fails if column name is div","If you do a column analysis on hive which has table with column named ""div"" then it fails with error ENTRY org.talend.platform.logging 1 0 2016-06-23 11:15:02.221 !MESSAGE 2016-06-23 11:15:02,221 INFO org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction - ""Analysis ""bug"" execution code: KO: Error while compiling statement: FAILED: ParseException line 1:45 cannot recognize input near 'div' 'IS' 'NULL' in expression specification. Duration: 25.73 s. Same if I have to change the column name to something like ""diva"" or ""divb"" then column analysis is successfull Environment to reproduce : Hive-0.13 , MapR 4.0.1 , Talend 5.6.1 ",3 TDQ-12240,"Remove the ""demo_cluster_wholesales"" demo job","There are 4 standard jobs + 1 big data job Remove these demo jobs that are based on an old deprecated component (tMahoutClustering)",1 TDQ-12245,"export analysis depend on connection comes from reference project get error, and import to new project can not use.","1. create two remote git project: is pro1, pro2(Reference checked), and make pro2 is reference of pro1 2. logon pro2 create a dbconnection named ""db_2"", and a column analysis 3. logon pro1 create a column analysis, functional analysis based on ""db_2"", and duplicate the analysis create on step2. then 3 new analysis in pro1 created. 4. try to export the 3 analysis, on the export dialog check the analysis, get error in error log, click ""Include dependencies"" also get error-*issue1* 5. logon a local project, import the items just exported. 6. open the 3 analysis, functional analysis can not open, column analysis there is no any data-*issue 2* Expected Result: when do export, no error show, after import file should be used.",2 TDQ-12253,"Remove adherence of DQ libraries to org.talend.utils","Move the few classes that are used by the DQ libraries and components to Daikon so that no DQ library depends on org.talend.utils. Deprecated classes in org.talend.utils (they will simply extend the daikon classes) DQ libraries should not depend anymore on this utils project. Review all components and remove the dependency wherever it's possible. Review all components that use record linkage lib (tDqReportRun, tMatchGroup,...)",3 TDQ-12258,"[swt] Export as context failed from menu ""Preferences""->""Reporting"" ","Only repro on SWT build not on studio build",1 TDQ-12269,"Reduce the technical debt","TBD: list here things to do. Start to fix all critical issues: https://sonar.datapwn.com/component_issues?id=org.talend.dataquality%3Adataquality-parent%3Amaster#resolved=false%7Ctypes=BUG%2CVULNERABILITY%7Cseverities=CRITICAL%7CfacetMode=count ",2 TDQ-12270,"Create tMatchModel which will replace tMatchFeaturing + Classification Model",NULL,5 TDQ-12283,"Check impacts of changing ELK to version 5","Can the ontology still be stored in ElasticSearch? How to migrate it from a ELK version 3 to version 5? tests + test with Shield + update dashboards",5 TDQ-12299,"Impala connection can not get tables.","1. create an Impala connection about cdh54, cdh55 2. try to unfold connection to get tables, but failed, get error in error log. {code} java.lang.ClassNotFoundException: org.apache.hive.jdbc.HiveDriver cannot be found by org.talend.metadata.managment_6.2.1.20160704_1411 org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:432) org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:345) org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:337) org.eclipse.osgi.internal.loader.ModuleClassLoader.loadClass(ModuleClassLoader.java:160) java.lang.ClassLoader.loadClass(ClassLoader.java:357) java.lang.Class.forName0(Native Method) java.lang.Class.forName(Class.java:348) org.talend.metadata.managment.connection.manager.ImpalaConnectionManager.createConnection(ImpalaConnectionManager.java:52) org.talend.metadata.managment.utils.MetadataConnectionUtils.createConnection(MetadataConnectionUtils.java:154) org.talend.metadata.managment.utils.MetadataConnectionUtils.createConnection(MetadataConnectionUtils.java:301) org.talend.metadata.managment.utils.MetadataConnectionUtils.createConnection(MetadataConnectionUtils.java:234) org.talend.core.model.metadata.builder.database.DqRepositoryViewService.getViews(DqRepositoryViewService.java:293) org.talend.dq.nodes.DBViewFolderRepNode.createRepositoryNodeViewFolderNode(DBViewFolderRepNode.java:173) org.talend.dq.nodes.DBViewFolderRepNode.getChildren(DBViewFolderRepNode.java:104) org.talend.repository.model.RepositoryNode.hasChildren(RepositoryNode.java:168) org.talend.dataprofiler.core.ui.views.provider.ResourceViewContentProvider.hasChildren(ResourceViewContentProvider.java:453) org.eclipse.ui.internal.navigator.extensions.SafeDelegateTreeContentProvider.hasChildren(SafeDelegateTreeContentProvider.java:110) org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.callNormalHasChildren(NavigatorContentServiceContentProvider.java:430) org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.access$4(NavigatorContentServiceContentProvider.java:425) org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider$3.run(NavigatorContentServiceContentProvider.java:395) org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:42) org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.hasChildren(NavigatorContentServiceContentProvider.java:381) org.eclipse.ui.internal.navigator.NavigatorContentServiceContentProvider.hasChildren(NavigatorContentServiceContentProvider.java:422) org.eclipse.jface.viewers.AbstractTreeViewer.isExpandable(AbstractTreeViewer.java:2133) org.eclipse.jface.viewers.TreeViewer.isExpandable(TreeViewer.java:553) org.eclipse.jface.viewers.AbstractTreeViewer.isExpandable(AbstractTreeViewer.java:2171) org.eclipse.jface.viewers.AbstractTreeViewer.updatePlus(AbstractTreeViewer.java:2863) org.eclipse.jface.viewers.TreeViewer.updatePlus(TreeViewer.java:804) org.eclipse.jface.viewers.AbstractTreeViewer.createTreeItem(AbstractTreeViewer.java:844) org.eclipse.jface.viewers.AbstractTreeViewer$1.run(AbstractTreeViewer.java:818) org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:70) org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:791) org.eclipse.jface.viewers.TreeViewer.createChildren(TreeViewer.java:611) org.eclipse.jface.viewers.AbstractTreeViewer.createChildren(AbstractTreeViewer.java:762) org.eclipse.jface.viewers.AbstractTreeViewer.handleTreeExpand(AbstractTreeViewer.java:1495) org.eclipse.jface.viewers.TreeViewer.handleTreeExpand(TreeViewer.java:903) org.eclipse.jface.viewers.AbstractTreeViewer$4.treeExpanded(AbstractTreeViewer.java:1507) org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:132) org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1085) org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1070) org.eclipse.swt.widgets.Tree.wmNotifyChild(Tree.java:7633) org.eclipse.swt.widgets.Control.wmNotify(Control.java:5618) org.eclipse.swt.widgets.Composite.wmNotify(Composite.java:1935) org.eclipse.swt.widgets.Control.WM_NOTIFY(Control.java:5169) org.eclipse.swt.widgets.Control.windowProc(Control.java:4666) org.eclipse.swt.widgets.Display.windowProc(Display.java:5023) org.eclipse.swt.internal.win32.OS.CallWindowProcW(Native Method) org.eclipse.swt.internal.win32.OS.CallWindowProc(OS.java:2443) org.eclipse.swt.widgets.Tree.callWindowProc(Tree.java:1553) org.eclipse.swt.widgets.Tree.WM_LBUTTONDOWN(Tree.java:6501) org.eclipse.swt.widgets.Control.windowProc(Control.java:4646) org.eclipse.swt.widgets.Tree.windowProc(Tree.java:6024) org.eclipse.swt.widgets.Display.windowProc(Display.java:5023) org.eclipse.swt.internal.win32.OS.DispatchMessageW(Native Method) org.eclipse.swt.internal.win32.OS.DispatchMessage(OS.java:2549) org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3759) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032) org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148) org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636) org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332) org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579) org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) org.talend.rcp.intro.Application.start(Application.java:208) org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:497) org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) org.eclipse.equinox.launcher.Main.run(Main.java:1465) {code}",1 TDQ-12300,"The new tNaiveBayesModel with native spark mllib","The current tNaiveBayesModel component is based in our own API ([see code|https://github.com/Talend/tdq-studio-ee/tree/master/main/plugins/org.talend.datascience.mllib/src/main/scala/org/apache/spark/mllib/classification/talend]) with Spark1.3, but we've met some compatibility issues(see TDQ-12249) with the different spark versions. It should be more easy to maintenance if we use the native spark mllib API for [NaiveBayes|https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala]. We want to keep the old implementation if run this component in spark 1.3 but to use the native spark mllib api if run this component in spark 1.4+. So we may need to add a combo list in UI for choosing the spark versions: 1.3 or 1.4+ and include different javajets according to the spark version. See the example of the component [tPredict|https://github.com/Talend/tdq-studio-ee/tree/master/main/plugins/org.talend.designer.components.tdqsparkprovider/components/tPredict] which also has a combo list for choosing the different model types to include different javajets. For coding the javajet with Spark 1.4, please see the example of component: [tKmeansModel|https://github.com/Talend/tdq-studio-ee/tree/master/main/plugins/org.talend.designer.components.tdqsparkprovider/components/tKMeansModel], and read the [Spark Documentation|http://spark.apache.org/docs/latest/mllib-naive-bayes.html] for help. P.S. tNaiveBayesModel should has two models inside of this components: 1. the pipelineModel for preprocess, 2. the model of Naive Bayes (like [tKmeansModel|https://github.com/Talend/tdq-studio-ee/blob/master/main/plugins/org.talend.designer.components.tdqsparkprovider/components/tKMeansModel/tKMeansModel_sparkconfig.javajet], see L62 and L135 in config.javajet) ",5 TDQ-12307,"column set analysis with pattern can not run.","1. create a column set analysis add tbi->employee->email, set java engine. 2. add Regex->internet->Email Address 3. run the analysis, failed get error as below. {code} java.lang.NullPointerException org.talend.dq.analysis.ModelElementAnalysisHandler.initializeIndicator(ModelElementAnalysisHandler.java:174) org.talend.dq.analysis.AnalysisExecutor.initializeIndicators(AnalysisExecutor.java:583) org.talend.dq.analysis.AnalysisExecutor.execute(AnalysisExecutor.java:114) org.talend.dq.analysis.AnalysisExecutorSelector.executeAnalysis(AnalysisExecutorSelector.java:149) org.talend.dataprofiler.core.ui.action.actions.RunAnalysisAction$1.runInWorkspace(RunAnalysisAction.java:226) org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38) org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) {code}",1 TDQ-12312,"Email validation improvements","The current regex used in Dataprep for email validation is very simple. Remove the current regex (as it yields to false negatives) and create a validator class that is based on the email project. ",5 TDQ-12324,"Make data-sampling library Java 7 compatible",NULL,1 TDQ-12336,"Add reject flow on tAddressRowCloud","When the input data contains a wrong country name to Loqate, the address API throws an exception because Loqate simply returns an empty ""Error"" message. Catch any kind of exception, and send the data to the reject flow when an exception happens. ",2 TDQ-12351,"Add test plugins to feature","The list of plugins are not included in the build of junits... Update the test feature to add those plugins org.talend.datacleansing.core.ui.test org.talend.dataprofiler.datamart.test org.talend.dataquality.address.test org.talend.dataquality.hadoop.test org.talend.dataquality.reporting.engine.test org.talend.designer.components.libs.tdq.test org.talend.designer.routines.tdqprovider.test org.talend.survivorship.test org.talend.survivorship.ui.test org.talend.dataquality.ontology.ui.test",1 TDQ-12354,"Match Analysis Reporting - Step 2",NULL,13 TDQ-12357,"No value shows in Database field when create valid/invalid job by business rule analysis with mssql","1.Create mssql database 2.Create one business rule analysis with one table and run 3.Select Generate job by right clicking rule value part 4.Select ""generate an ELT job to get only valid rows"" and click Finish button 5.Double click tMssqlValidRows component Expected result: For the Database field, it's should be shown value by automatically. Actual result: No value shows, need to fill by manual.see attachment ",3 TDQ-12365,"Some UI changes for the Spark tMatch* components","# rename the fix column ""matchingLabel"" to ""LABEL"" in tMatchPairing and tMatchPredict # remove the output schema in tMatchModel # rename the fix column ""percentile"" to ""SCORE"" in tMatchPairing # tMatchPredict must also display a SCORE? ",2 TDQ-12369,"tMelissaDataAddress component improvements -- Part 2","need to improve: 1. Use mapping like Loqate for input and output schemas 1)maybe no need for RightFielder option in the advanced settings: We can use the fact that the input mapping only contains one field ""Address"" we still have Address, Address1, Address2, city, ... in the fields. but when the user selects only the single field: ""Address"", in this case, you must use RightFielder we use rightfielder only when the user select the single Address field when the user selects more than one field in the input mapping, then we don't use RightFielder 2)Test the Migration of old jobs (the migration should do the mapping correctly) the user choose all the output columns, be careful about migration: we should automatically configure the mapping table with the old fixed columns 2 change the order of GeoCoder options: put ""no geocoder license at first place"" 3. Labels: Write: ""RightFielder"" 4. when the user select ""no geocoder license at first place"", we will not init geocoder 5 .remove the ""If All Melissa DAT Files Exist In The Root Data Folder"" from the advance settings 6. remove the ""Choose RightFielder For Address Parsing Of AddressLine-1"" from the advance settings 7. when the mdAddr or rightFielder InitializeDataFiles get error, this component will return(means do nothing), but mdGeo InitializeDataFiles get error, we will continue to get result output maybe we can add the follows to doc: 1. What's the difference between geocode and geopoint?they are just two different geocoder methods? -->Yes these are just 2 different GeoCoder API Methods. The GeoCoder Method lets you retrieve a maximum latitude/longitude accuracy of a 9-digit zip code centroid. The GeoPoint Method lets you retrieve the best latitude/longitude accuracy that is at the rooftop of the address, provided you are licensed for it. 2. what happens when geocoder license is expired? Are the geocoder fields set to null? -->When a license expires, the object reverts back to demo mode. In this case, you will only be able to process records from Nevada and only get the 5-digit level centroid lat/long. All other states will return a GE03 (Demo Mode) in the GetResults method. 3. Can we test the license validity at the initialization of the component and then choose automatically whether we can use geocode and geopoint? -->no, we can not.In order to find out what a license supports, you will need to refer to your sales representative for that 4. There are 3 different methods for parsing fields with RightFielder. Which only one method is used in the component? -->we use the RightFielder.Parse(String address1Str) method",5 TDQ-12370,"Changes of the advanced settings in tMatchPairing ","# add a seed in order to control the random values. # sampling: change ""size"" to ""percentage"" of the data set.",2 TDQ-12374,"when run analysis, before run the query if get error, the analysis run time should +1","mainly change the follow method: AnalysisExecutor.execute(final Analysis analysis) ",1 TDQ-12383,"Several data types can not set options to set the "" Number of results shown"" in indicate when set Datamining Type to ""interval""","Several data typessuch as: BIGINT ,NUMERIC,VERCHAR can not set options to set the "" Number of results shown"" in indicate when set Datamining Type to ""interval"" Repro step: 1. create a sybase / MySQL connection. 2. create a column analysis, select one column--make your column distinct count is lager than 10(such as distinct count is N, N>10) 3. add ""[low] frequency table"" indicator for this column. 4. run, go to result page check result 5.in analysis, click  ""options"" for thie ""[low] frequency table"" indicator.    on the pop up dialog ,set  ""Number of results show"" as M (M<=N), ""finish"" the dialog",1 TDQ-12398,"udi drill down sql doesn't add `` for <%=__COLUMN_NAMES__%>","1. create a User Defined Count indicator in Indicator Definition part set -> {code}<%=__COLUMN_NAMES__%> is not null{code} then Full SQl part set as below automatically {code} SELECT COUNT(*) FROM <%=__TABLE_NAME__%> WHERE (<%=__COLUMN_NAMES__%> is not null) <%=__AND_WHERE_CLAUSE__%> {code} view sql template part set as below automatically {code} SELECT * FROM <%=__TABLE_NAME__%> WHERE (<%=__COLUMN_NAMES__%> is not null) <%=__AND_WHERE_CLAUSE__%> {code} use it in mysql , check the udi Execute Query {code} SELECT COUNT(*) FROM `dba`.`itemmore500` WHERE (`state` is not null) {code} and drill down query {code} SELECT * FROM `dba`.`itemmore500` WHERE (state is not null) {code} in Executed query we get `` for column name, but dirll down query not, for this case there is no any influence, but if column name is special one will get error, such as column name contains space ",1