Wednesday, November 22, 2017

Teiid 9.3.5 Released

Teiid 9.3.5 has been released.  It resolves 8 issues:
  • [TEIID-5130] - Document/refine behavior of treating result parameter as the first parameter
  • [TEIID-5128] - transaction support value not cloned on access node
  • [TEIID-5133] - XmlTable path language is not always identical to XPathValue expressions
  • [TEIID-5137] - SystemAdmin.usage column dependency issue
  • [TEIID-5146] - UNION of two similar JOIN queries fails with ASSERTION FAILED error if it contains table function of procedural call with arguments
  • [TEIID-5152] - "No value was available" error message when evaluating an expression
  • [TEIID-5153] - RAND function gives same results in view
  • [TEIID-5166] - Google spreadsheet insert fails
For those in the US happy Thanksgiving.  You can expect community activity to return to normal next week.

Thanks,
Steve

Monday, November 6, 2017

Teiid 9.2.7 Released

Teiid 9.2.7 has been released.  It resolves 6 issues:
  • [TEIID-4870] - Google translator unexpected behavior for view update without trigger
  • [TEIID-5094] - Is DISTINCT FROM evaluation with two null values
  • [TEIID-5098] - Unsyncronized static date format for Salesforce bulk inserts
  • [TEIID-5107] - teiid-olingo-*.war not deploying in wildfly when using domain
  • [TEIID-5109] - Set operations and parenthesis
  • [TEIID-5133] - XmlTable path language is not always identical to XPathValue expressions
This is the last community release on the 9.2.x line.

Thanks,
Steve

Thursday, November 2, 2017

Teiid 10.0.0.Final Released

After 5 months of work we are pleased to announce the release of Teiid 10.0.0.Final.  This is longer than a typical cycle, but it should be worth the wait as we were able to pick up WildFly 11.0 and address 165 issues.  The major feature highlight are:
  • TEIID-4981 Amazon S3 translator support, now read the objects directly from Amazon S3 with security
  • TEIID-5026 The behavior of the FROM_UNIXTIME function was corrected and the related datetime functions UNIX_TIMESTAMP, TO_MILLIS, and FROM_MILLIS were added.
  • TEIID-1131 Added support for importing sequence information.
  • TEIID-5073 Added a salesforce-41 translator/resource adapter pair, which defaults to accessing the v40 salesforce API.
  • TEIID-4208 Added parallelism to plan execution involving large sorts.
  • TEIID-5002 Upgraded to WildFly 11
  • TEIID-4711 Generalized IS DISTINCT support.
Other Important Stuff:
  • Take note of major changes in the release in particular the removal of XML document models and switching the artifact group from org.jboss.teiid to org.teiid.
  • Teiid Spring Boot was launched make getting starting with Teiid and Spring seamless - thank you Ganesh Pol and Christian Posta for early testing
  • With TEIID-4208 and other performance enhancements you should expect to see a performance boost especially for higher data volume / lower query volume workloads.
  • Couchbase access is now quite robust
  • OsiSoft Pi access has gone under more review and will be continue to be refined in 10.1
Special thanks to the many community members who contributed to this release.  In particular dalex dalex and Mike Higgins who identified several important issues.

On the horizon:
  • Teiid 9.2.7 will be the last community release on 9.2.x and is expected tomorrow.  Teiid 9.3.x will receive "extended" community support until the release of 10.2 as to ease any transition issues.
  • Teiid WildFly Swarm will be updated in the near future.  Initially this may be against the 9.3.x release stream as Swarm is not yet on WildFly 11.
Thank you,
The Teiid Team

Thursday, October 26, 2017

Low-risk Monolith to Microservice Evolution

Christian Posta has written a series of blog posts covering a host of Red Hat technologies that enable migrating from a monolith to microservices.  For the impatient, the third part highlights the usage of Teiid Spring Boot.  Ramesh has done great work getting this effort off the ground and we hope that it continues to gain attention and community usage.  Please interact with us through JIRA or the forums if you have a data integration or migration scenario with Spring Boot that Teiid could help enable.

Thanks,
Steve

Wednesday, October 25, 2017

Teiid 10.0.0 CR2 Released

Now that WildFly 11 Final is available, we have released Teiid 10.0.0.CR2.  A recap of all feature highlights:
  • TEIID-4981 Amazon S3 translator support, now read the objects directly from Amazon S3 with security
  • TEIID-5026 The behavior of the FROM_UNIXTIME function was corrected and the related datetime functions UNIX_TIMESTAMP, TO_MILLIS, and FROM_MILLIS were added.
  • TEIID-1131 Added support for importing sequence information.
  • TEIID-5073 Added a salesforce-41 translator/resource adapter pair, which defaults to accessing the v40 salesforce API.
  • TEIID-4208 Added parallelism to plan execution involving large sorts.
  • TEIID-5002 Upgraded to WildFly 11
  • TEIID-4711 Generalized IS DISTINCT support.
Additionally there were recent changes to refine Osi Pi integration, improve with clause performance, and add more import options. 

Given that this has been longer than our usual time box release, there have been a total of 162 issues addressed so far.  Please ensure that your issues have been addressed as expected before the final release.

In the works:
  • Spring Boot integration is should be considered beta level.  See the current state.  There will be additional documentation and development around supporting Teiid 11, but it is expected to have a somewhat independent life cycle to meet community needs.
  • Expect a 10.0.0.Final in a week to 10 days.
Thanks,
Steve

Monday, October 23, 2017

Teiid 9.3.4 Released

Teiid 9.3.4 has been released.  It resolves 21 issues:
  • [TEIID-4567] - UCASE and LCASE functions do not work with CLOBs.
  • [TEIID-4870] - Google translator unexpected behavior for view update without trigger
  • [TEIID-5039] - Couchbase document type definition for a table
  • [TEIID-5041] - Couchbase documentID column enforced also in a view
  • [TEIID-5063] - Issues with bigdecimal values and odata
  • [TEIID-5065] - Unable to connect to VDB having names with unicode characters
  • [TEIID-5067] - Incorrect source query with simple inherent updates
  • [TEIID-5068] - Couchbase retrieval causes ClassCastException
  • [TEIID-5069] - Blob getBytes() handling of input streams reads the stream multiple times without a reset
  • [TEIID-5075] - Couchbase incorrect update count returned
  • [TEIID-5076] - Couchbase update syntax error
  • [TEIID-5077] - Couchbase strange behaviour for long numbers
  • [TEIID-5081] - FORMATTIMESTAMP is not pushed down to postgresql but formattimestamp is
  • [TEIID-5082] - Salesforce default URL incorrect
  • [TEIID-5085] - NullPointerException after SortUtility blocks in initialSort
  • [TEIID-5090] - Issues with matview scripts
  • [TEIID-5094] - Is DISTINCT FROM evaluation with two null values
  • [TEIID-5098] - Unsyncronized static date format for Salesforce bulk inserts
  • [TEIID-5104] - BigInteger mapped to string for OData 4
  • [TEIID-5107] - teiid-olingo-*.war not deploying in wildfly when using domain
  • [TEIID-5109] - Set operations and parenthesis
This fix pack was delayed slightly as several important issue came up prior to release.  Notice that Couchbase support continues to be refined, but the issues are getting more targeted to narrow functional areas.

Unfortunately we are still on hold with Teiid 10.0.0.CR2 as we wait on the release of WildFly 11.  It is expected any day now.  Teiid 10.0.0.Final should follow about a week after that.

Thanks,
Steve

Friday, October 6, 2017

Teiid 10.0.0.CR1 Released

Even though we do not yet have a WildFly 11 final, we have released Teiid 10.0.0.CR1.  This may mean that a CR2 will be needed.  A recap of all feature highlights:
  • TEIID-4981 Amazon S3 translator support, now read the objects directly from Amazon S3 with security
  • TEIID-5026 The behavior of the FROM_UNIXTIME function was corrected and the related datetime functions UNIX_TIMESTAMP, TO_MILLIS, and FROM_MILLIS were added.
  • TEIID-1131 Added support for importing sequence information.
  • TEIID-5073 Added a salesforce-41 translator/resource adapter pair, which defaults to accessing the v40 salesforce API.
  • TEIID-4208 Added parallelism to plan execution involving large sorts.
  • TEIID-5002 Upgraded to WildFly 11
In the works:
  • Spring Boot integration is on-going.  You can see the incremental progress
  • Expect a 9.3.4 next week.
Thanks,
Steve

Monday, September 18, 2017

Teiid 10.0.0 Beta2 Released

We have upgraded to WildFly 11.0.0.CR1 for the Beta2 release in anticipation of syncing to the final for our final release.  Since Beta1 the feature highlight is:
  • TEIID-5026 The behavior of the FROM_UNIXTIME function was corrected and the related datetime functions UNIX_TIMESTAMP, TO_MILLIS, and FROM_MILLIS were added.
In the works:
  • Spring Boot integration is on-going.  You can see the incremental progress
  • Expect a 9.3.4 in about 3 weeks.
Thanks,
Steve

Tuesday, September 12, 2017

Teiid 9.2.6 Released

Teiid 9.2.6 has been released.  It resolves 10 issues:
  • [TEIID-5021] - Latest openjdk does not include anon cipher suites
  • [TEIID-4567] - UCASE and LCASE functions do not work with CLOBs.
  • [TEIID-5014] - Unable to use parameterized query with node pg module and Teiid/JBoss VDB
  • [TEIID-5045] - Rewriter allows "true" criteria to be modified
  • [TEIID-5054] - autoFailover with a multi-batch result timing issue
  • [TEIID-5059] - CacheEntry memory leak due to issues with touch method
  • [TEIID-5063] - Issues with bigdecimal values and odata
  • [TEIID-5067] - Incorrect source query with simple inherent updates
  • [TEIID-5069] - Blob getBytes() handling of input streams reads the stream multiple times without a reset
  • [TEIID-5082] - Salesforce default URL incorrect

Thanks,
Steve

Monday, September 11, 2017

Teiid 9.3.3 Released

Teiid 9.3.3 has been released.  It resolves 22 issues:
  • [TEIID-5021] - Latest openjdk does not include anon cipher suites
  • [TEIID-5028] - SystemFunctions should be loaded once
  • [TEIID-5017] - More aggressively use enhanced join sorted index to prevent buffering
  • [TEIID-5013] - Google Spreadsheet Data Sources with custom client_id and client_secret
  • [TEIID-4974] - Couchbase - TRANSLATE function is transalted as REPLACE
  • [TEIID-4983] - Couchbase tests rely on unpredictable order
  • [TEIID-5014] - Unable to use parameterized query with node pg module and Teiid/JBoss VDB
  • [TEIID-5019] - Makedep hint using @ syntax sometimes ignored
  • [TEIID-5020] - Join query results in NullPointerException
  • [TEIID-5029] - Regression with outer join optimization
  • [TEIID-5030] - Couchbase error in date/timestamp/time datatype pushdown
  • [TEIID-5031] - Couchbase issues in functions where result is different datatype than the argument
  • [TEIID-5033] - Couchbase substring function is 0-based
  • [TEIID-5035] - Couchbase INTERSECT doesn't return any values
  • [TEIID-5036] - Couchbase EXCEPT returns more values than expected
  • [TEIID-5037] - Couchbase UNION doesn't work correctly
  • [TEIID-5039] - Couchbase document type definition for a table
  • [TEIID-5042] - Couchbase supported data types restriction issues
  • [TEIID-5044] - Using "SHOW PLAN" statement only shows initial plan
  • [TEIID-5045] - Rewriter allows "true" criteria to be modified
  • [TEIID-5054] - autoFailover with a multi-batch result timing issue
  • [TEIID-5059] - CacheEntry memory leak due to issues with touch method
Note that TEIID-5059 is a particularly important issue as it leads to a memory leak of heap cache entries in certain situations.

Expect a 9.2.6 in the next day or two.

Thanks,
Steve

Tuesday, August 29, 2017

Teiid 10.0 Beta1 Released

We were hoping to get in a WildFly upgrade for the beta releases, but that ultimately was not possible for Beta1.  We'll continue to assess the feasibility for the 10.0 release.  Since Alpha2 the feature highlight is:

  • TEIID-4981 Amazon S3 translator support, now read the objects directly from Amazon S3 with security
In the works:
  • Spring Boot integration is on-going.  You can see the incremental progress
  • Along with general issue work, there are another round of Couchbase issues that have been identified for Beta2.
  • Expect a 9.3.3 in about 1.5 weeks.
Thanks,
Steve

Wednesday, August 9, 2017

Teiid 9.3.2 Released

Teiid 9.3.2 has been released.  It resolves 10 issues:
  • [TEIID-4993] - for each row trigger forcing txn to start
  • [TEIID-4977] - Support materialization as the 8.12.x version did
  • [TEIID-4988] - Oracle - table alias is not used in whole query
  • [TEIID-4989] - Impala - Select * fails with reserved words in query
  • [TEIID-4990] - Embedded Teiid with JPA layer Transaction Management detection
  • [TEIID-4996] - Teiid embedded with Solr (exception max boolean clauses)
  • [TEIID-5001] - TextTable usage in UNION/UNION ALL queries with JOINs fails with "No value was available" or NPE errors
  • [TEIID-5004] - INNER JOINs of two CTEs fail with ASSERTION FAILED error message
  • [TEIID-5005] - Boolean expression is incorrectly rewritten in WHERE condition and causes errors on PG
  • [TEIID-4903] - Create a new server quickstart for the new infinispan hotrod connector/translator
The 9.3.3 should be expected in ~5 weeks.  10.0.0 Beta1 will be available next week.

Thanks,
Steve

Friday, July 28, 2017

Teiid 9.2.5 Released

Teiid 9.2.5 has been released.  6 issues were addressed:
  • [TEIID-4960] - Problems when using External Materialized Views
  • [TEIID-4962] - 9.3 teiid-standalone-mode-install.cli gives an error on startup
  • [TEIID-4968] - oids are not unique in pg_attribute
  • [TEIID-5001] - TextTable usage in UNION/UNION ALL queries with JOINs fails with "No value was available" or NPE errors
  • [TEIID-5004] - INNER JOINs of two CTEs fail with ASSERTION FAILED error message
  • [TEIID-5005] - Boolean expression is incorrectly rewritten in WHERE condition and causes errors on PG
The next 9.2 release will be in approximately 8 weeks.  9.3.2 is due next week.

Thanks,
Steve

Monday, July 24, 2017

Teiid 10.0.0.Alpha2 Released

Teiid 10.0.0 Alpha2 has been released.  Feature work is still ongoing. There's been progress on on Spring Boot support and an OrientDB translator.

Re-licensing to ASL2 is now complete, and the initial set of Couchbase issues have been addressed.

Special thanks to dalex dalex for raising several planning issues.

Other News:
  • We have started to utilize the Maven Central Repository and use the org.teiid group instead of org.jboss.teiid.  Only the main project has been converted so far.  There are no plans as of yet to change the JBoss Module names.
  • Teiid 9.2.5 will be available by the end of week.
Thanks,
Steve

Monday, July 10, 2017

Teiid 9.3.1 Released

Teiid 9.3.1 has been released.  23 issues were addressed:
  • [TEIID-4636] - In the SWARM readme's, need to indicate the URL to connect
  • [TEIID-4793] - Change of class loading no longer requires module dependencies
  • [TEIID-4985] - Update Quickstart to use new columns in status table
  • [TEIID-4315] - HBase Quickstart issues
  • [TEIID-4896] - Two VDB's referencing same teiid_ispn:cache is not using the same cache
  • [TEIID-4942] - Statement batch does not enforce autoCommitTxn
  • [TEIID-4947] - Error with Salesforce translator if criteria on outer join on a custom table is from the right side table
  • [TEIID-4948] - java.lang.IllegalArgumentException: No marshaller registered for ispn.G1
  • [TEIID-4950] - PostgreSQL Linux ODBC driver v09.06.0100 and newer does not work with Teiid Server 9.1.1
  • [TEIID-4953] - JOIN of CTEs fails if one of them is dependent and has window functions with inner DISTINCT in underlying queries
  • [TEIID-4960] - Problems when using External Materialized Views
  • [TEIID-4961] - External Materialized View With State Loaded but 0 Cardinality
  • [TEIID-4962] - 9.3 teiid-standalone-mode-install.cli gives an error on startup
  • [TEIID-4967] - Couchbase - incorrect data returned from VIEW if one value is NULL
  • [TEIID-4968] - oids are not unique in pg_attribute
  • [TEIID-4969] - Couchbase - ORDER BY returns empty result
  • [TEIID-4970] - Couchbase - GROUP BY returns empty result
  • [TEIID-4972] - Couchbase - query with comparison criteria not properly translated
  • [TEIID-4973] - Couchbase - Teiid returns empty result if source query fails
  • [TEIID-4974] - Couchbase - TRANSLATE function is transalted as REPLACE
  • [TEIID-4975] - Couchbase - SUBSTRING function is not translated correctly
  • [TEIID-4986] - Couchbase import nested array handling
  • [TEIID-4952] - release notes is not having tokens replaced
The next preview release of 10.0 will be due out in about 2 weeks.

Thanks,
Steve

Tuesday, July 4, 2017

Teiid 10.0.0 Alpha1 Released

Teiid 10.0.0 Alpha1 has been released.  Feature work is still ongoing. We're active in Spring Boot support, an OrientDB translator, and re-licensing - as of this release the main project and documentation are under ASL2 license instead of the LGPL.

Other News:
  • Couchbase testing has revealed a host of issues with this new translator.  We'll address these in both 9.3.x and 10.0.
  • Teiid 9.3.1 will be available in the next week.
  • Please have a look at the Red Hat effort around Spark in OpenShift - radanalytics.io.  As our OpenShift support evolves you will be able to rapidly integrate Teiid with elastic analytical workloads in Spark.
Thanks,
Steve

Monday, June 12, 2017

Teiid 9.2.4 Released

Teiid 9.2.4 has been released.  7 issues were addressed:
  • [TEIID-4858] - hive translator is extremely slow
  • [TEIID-4838] - View with a union that projects nulls fails to resolve properly
  • [TEIID-4875] - Planning issue with multiple aggregate decompositions through a join tree
  • [TEIID-4913] - MetadataFactory is not replacing . in column names
  • [TEIID-4927] - Update dockerfile
  • [TEIID-4942] - Statement batch does not enforce autoCommitTxn
  • [TEIID-4953] - JOIN of CTEs fails if one of them is dependent and has window functions with inner DISTINCT in underlying queries
From here the pace of fix releases for 9.2 will begin to slow.  The next fix will be released in 6-8 weeks.  9.3.x will become the primary focus of support - expect a 9.3.1 in 2-3 weeks.

Also the first preview release of 10.0 will be due out in about 1.5 weeks.

Thanks,
Steve

Friday, June 9, 2017

Teiid 9.1.5 Released

Teiid 9.1.5 has been released.  This will be the last patch release off of 9.1.x.

9 issues were addressed:
  • [TEIID-4797] - Oracle: empty catalog messed up VDB schemas name
  • [TEIID-4819] - Tree page modifications removing the previous page, don't remove immediately
  • [TEIID-4852] - Wrong OData results with multiple self relationships
  • [TEIID-4877] - Boolean syntax is broken on pg 9.5 data sources
  • [TEIID-4890] - DatabaseMetadata Procedure Columns order is incorrect
  • [TEIID-4892] - oData v4 error using $expand
  • [TEIID-4893] - Inconsistent behavior of SUBSTRING function
  • [TEIID-4927] - Update dockerfile
  • [TEIID-4953] - JOIN of CTEs fails if one of them is dependent and has window functions with inner DISTINCT in underlying queries
We will continue to support 9.2 and 9.3.  Expect a 9.2.4 release early next week.

Thanks,
Steve

Tuesday, June 6, 2017

Teiid 9.3 Final Released

With about 3 1/2 months of work, 138 issues later, 9.3 Final release is ready.  Feature highlights include:
  • TEIID-3624 CREATE DOMAIN support for user-defined simple types.
  • TEIID-4724 DDL .vdb deployment.
  • TEIID-4557 TEIID-2465 Memory restrictions at the operation and session level.
  • TEIID-4578 SQLAlchemy and Superset support through our pg/odbc access.
  • TEIID-4646 LEAD/LAG/FIRST_VALUE/LAST_VALUE analytic/value function support.
  • TEIID-2820 Couchbase support via a new translator and resource adapter.
  • TEIID-4733 Infinispan Support via a new translator and resource adapter.
There were also several important planning issues that were resolved including: More join pruning and left outer join optimization.

DDL VDB support has been enhanced to be nearly equivalent to of its XML counterpart.  We will continue to improve the usability, feature set, and refine the syntax when necessary.


UI Work

If you haven't seen it, please also check out Data Service Builder - which is a streamlined web UI for JDV/Teiid. We will release a Designer version based on Teiid 9.3 in near future. However after that Designer will be mostly in maintenance mode.  We are going to focus more on Web-based UI for future.

10.x and Beyond

Although initially slated for 9.3 change data capture (CDC) event handling based on Debezium to keep the materialization tables in sync with source data sources like MySQL and PostgreSQL will be delayed until 10.0 or later.

With the emergence of Cloud-based processing and Microservices architectures, we have been taking a hard look at Teiid and how we could progress technology into future. We have laid out some initial plans about our thinking and some immediate actions. We are soliciting your input all these matters, so please get involved so that we can shape Teiid together.

Thanks again to everyone who contributed to this release.
Ramesh & Steve

Friday, May 26, 2017

Teiid 9.3 CR1

Teiid 9.3 CR1 has been released.  A recap of all feature highlights:
  • TEIID-3624 CREATE DOMAIN support for user defined simple types.
  • TEIID-4724 DDL .vdb deployment.
  • TEIID-4557 TEIID-2465 Memory restrictions at the operation and session level.
  • TEIID-4578 SQLAlchemy and Superset support through our pg/odbc access.
  • TEIID-4646 LEAD/LAG/FIRST_VALUE/LAST_VALUE analytic/value function support.
  • TEIID-2820 Couchbase support via a new translator and resource adapter.
  • TEIID-4733 Infinispan Support via a new translator and resource adapter.
There have been 136 issues addressed so far - https://issues.jboss.org/projects/TEIID/versions/12332954 - please test your issues if possible before the final release in early June.

Other news:
  • A Teiid 9.1.5 will be released shortly after 9.3 Final.
  • Teiid 10.0 work has begun.
    • Please comment on TEIID-4895 with regards to WildFly utilization.  Comments on JRE support are welcome as well - can you describe what circumstances may be holding you to 1.6 or 1.7?
    • We will likely start including the Data Services Builder in the all-in-one download.  Data Services Builder and other efforts will be at the forefront of offering data virtualization on OpenShift.
Thanks,
Steve

Thursday, May 11, 2017

Teiid 9.2.3 Released

Teiid 9.2.3 is now available.  This fix release covers 12 issues:
  • [TEIID-4861] - ASSERTION FAILED: expected reference to be not null
  • [TEIID-4868] - formats in timestampformat functions on sybase are ignored.
  • [TEIID-4874] - SQL Server translator should support full outer join by default
  • [TEIID-4875] - Planning issue with multiple aggregate decompositions through a join tree
  • [TEIID-4876] - Salesforce connector not working properly in 9.2.2 release
  • [TEIID-4877] - Boolean syntax is broken on pg 9.5 data sources
  • [TEIID-4887] - Domain mode configuration fails with CNF
  • [TEIID-4890] - DatabaseMetadata Procedure Columns order is incorrect
  • [TEIID-4892] - oData v4 error using $expand
  • [TEIID-4893] - Inconsistent behavior of SUBSTRING function
  • [TEIID-4899] - import foreign schema "import qualifiers" problem
Thanks,
Steve

Tuesday, May 9, 2017

Teiid 10 Planning

As we get closer to staring on Teiid 10.x, we want to elicit as much community feedback on our initiatives as possible.  Some of the major themes are:
  • Refining our messaging around and our usage of WildFly TEIID-4895
  • Removal of the XML document model logic TEIID-4894 and other deprecated features
  • Spring Boot TEIID-4863 and eventually vert.x support
  • More documentation and demos around microservices
  • General project updates including 
    • more build automation
    • possibly do away with pre-release names (e.g. Beta1) and instead promote specific micro releases
    • Relicense under a more permissive license TEIID-4474
Of course there's a lot more already in the 10.0 and 10.x release buckets as well.  Please provide whatever feedback you can - especially on WildFly usage.  Also have a look at all of your relevant issues and comment or vote on any that need more immediate inclusion.

Beyond the core project we are in the initial stages of working towards an OpenShift ready data integration suite including:
If you have any desire to coordinate on these additional efforts, please let us know so that we can loop you in once the appropriate git and other resources are in place.

Thanks,
Steve

Monday, May 8, 2017

Teiid 9.3 Beta2 Released

Teiid 9.3 Beta2 has been released.  Feature highlights since Beta1 include:
  • TEIID-4733 Infinispan Support via a new translator and resource adapter.
The new infinispan support greatly simplifies integration with Infinispan 9.0+. And over 110 issues have been resolved so far - please test your issues if possible before the final release.

Other news:
  • We have a GSOC student Artyom Lyan who will be working on an OrientDB translator. Welcome Artyom!
  • A Teiid 9.2.3 will be available tomorrow.
  • Teiid 9.3 CR1 will be released in about 2 weeks.
  • Teiid 10.0 work will begin in about 1 week.  It is anticipated there will be major changes and cleanups for that release.
Thanks,
Steve

Friday, April 21, 2017

Teiid 9.3 Beta1 Released

Teiid 9.3 Beta1 has been released.  Feature highlights since Alpha2 include:
  • TEIID-4646 LEAD/LAG/FIRST_VALUE/LAST_VALUE analytic/value function support.
Feature Progress:
  • Couchbase connectivity TEIID-2820 has been committed and will evolve from here. Thanks Kylin great work.
  • SQLAlchemy/Superset access TEIID-4578 has been committed but will still undergo additional changes with more testing.
If you have any interest please evaluate these in progress features as they mature.
Beyond the feature work, there were a lot general issues addressed - nearly 90 issues have been resolved so far.

Other news:
  • A Teiid 9.2.3 will be available in about 2 weeks.
  • Teiid 10.0 work will begin in about 3 weeks.  It is anticipated there will be major changes and cleanups for that release.
Thanks,
Steve

Saturday, April 15, 2017

Teiid 9.2.2 Released

Teiid 9.2.2 is now available.  This fix release covers 13 issues:
  • [TEIID-4501] - Salesforce 34 resource adapter should default to the 34 api
  • [TEIID-4812] - Processor is not exiting the join as soon as it's determined one side contains 0 rows
  • [TEIID-4814] - BatchedUpdateException should be provided for JDBC prepared statement batches
  • [TEIID-4816] - SQL Server 2012+ offset order by issue
  • [TEIID-4819] - Tree page modifications removing the previous page, don't remove immediately
  • [TEIID-4823] - joining 2 procedures results in QueryPlannerException: TEIID30275 Join region with unsatisfied access patterns cannot be satisfied by the join criteria
  • [TEIID-4828] - ST_GeomFromGeoJson fails for certain geometry types
  • [TEIID-4830] - Parsing Error when deploying VDB with "geometry" as column name
  • [TEIID-4832] - NullPointException in GroupingNode.initialize
  • [TEIID-4844] - Google translator unexpected behavior for comparison with time
  • [TEIID-4845] - Google translator comparison with boolean value matches all rows
  • [TEIID-4852] - Wrong OData results with multiple self relationships
Teiid 9.3 Beta1 is expected this coming week.  Also if there is a need for a 9.1.5, please let us know - only 3 issues have been addressed there so far.

Thanks,
Steve

Wednesday, March 29, 2017

Teiid 9.3 Alpha2 Released

Teiid 9.3 Alpha2 has been released.  Feature highlights since Alpha1 include:
Feature Progress:
  • Couchbase connectivity is still progressing under TEIID-2820
  • JDG integration continues to get easier - but some major changes are coming, including move the JDG connectivity to its own repository TEIID-4820
Beyond the feature work, there were a lot general issues addressed - nearly 70 issues have been resolved so far.

Other news:

  • A Teiid 9.2.2 will be available in the next 1-2 weeks.
  • JIRA issue cleanup has been ongoing.  There's quite a few backlog issues that should still be dealt with.
  • Teiid 10.0 work will begin by the end of April.  It is anticipated there will be major changes and cleanups for that release.
Thanks,
Steve

Tuesday, March 14, 2017

Teiid 9.2.1 Released

Teiid 9.2.1 is now available.  This fix release covers 18 issues:
  • [TEIID-4765] - The notion of resolving order may need to be extended beyond a schema
  • [TEIID-4788] - DDL vdb is expensive to process
  • [TEIID-4809] - lob performance issues
  • [TEIID-4770] - The convert script generates empty GRANT statements for roles that don't have permission to access a certain schema.
  • [TEIID-4771] - The convert script generates GRANT TEMPORARY_TABLE ON DATABASE statements but these fail.
  • [TEIID-4774] - Convert VDB utility does not work when translator overrides are present
  • [TEIID-4776] - Issues with array type metadata
  • [TEIID-4783] - missing message keys for functions
  • [TEIID-4785] - Add options through alter table in DDL does not work.
  • [TEIID-4791] - Bypass lookup function's keycolumn reserved word
  • [TEIID-4797] - Oracle: empty catalog messed up VDB schemas name
  • [TEIID-4807] - DDL format of a vdb lacks import information
  • [TEIID-4652] - SybaseIQ translator: DAYOFYEAR function not pushed correctly
  • [TEIID-4653] - SybaseIQ translator: Input parameter not set in prepared statement in source command
  • [TEIID-4775] - External materialization, after transaction timeout, LoadState continues to be LOADING
  • [TEIID-4778] - External Materialization, When TTL is less than loading time, the scheduling is off
  • [TEIID-4780] - Clone TEIID-4734 (Backwards compatible solution)
  • [TEIID-4782] - Change framework to catch RutineException from translator/connector
Note that several of these are related to the new DDL vdb feature - thanks Bram Gadeyne for the initial feedback.  This feature will continue to evolve even in 9.2.x to maintain forward compatibility with 9.3.x.

Looking forward, Teiid 9.2.2 should be available in 3-4 weeks.

Thanks,
Steve


Saturday, March 11, 2017

Teiid 9.3 Alpha1 Released

Teiid 9.3 Alpha1 has been released.  Feature highlights include:
Feature Progress:
  • Couchbase connectivity is progressing under TEIID-2820
  • The full DDL metadata system feature continues to evolve.  Several early issues have been addressed that slightly change the syntax and order or statements that supported.  This will all be reflected in the docs.  The hope is that the feature will be fully realized by the end of the 9.3 release.
  • The Debezium integration work continues as Ramesh has contributed changes to their community.
  • JDG integration continues to get easier and support for JDG 7.1 will be added.
We will try to stay to a two week pre-release cycle from this point.  Also expect a 9.2.1 early next week.

Thanks,
Steve

Tuesday, February 28, 2017

Teiid 9.1.4 Released

9.1.4 is available for download or from the Maven repository.  It addresses 8 important issues:
  • [TEIID-4737] - Incorrect work of left join statement
  • [TEIID-4754] - Wrong result with bidirectional relationship
  • [TEIID-4776] - Issues with array type metadata
  • [TEIID-4791] - Bypass lookup function's keycolumn reserved word
  • [TEIID-4775] - External materialization, after transaction timeout, LoadState continues to be LOADING
  • [TEIID-4778] - External Materialization, When TTL is less than loading time, the scheduling is off
  • [TEIID-4780] - Clone TEIID-4734 (Backwards compatible solution)
  • [TEIID-4782] - Change framework to catch RutineException from translator/connector
From here the release pace on 9.1.x will slow as primary support will be on the 9.2.x branch. There will also be a 9.3 Alpha1 release next week with significant work toward JDG, materialization, and allowing domain types.

Thanks,
Steve

Thursday, February 23, 2017

Teiid 9.0.6 Released

Teiid 9.0.6 is now available.  This release contains 12 important fixes:
  • [TEIID-4663] - Support a more secure block mode for client/server encryption
  • [TEIID-4546] - On setting jboss-teiid cluster : throwing java.lang.IllegalArgumentException.
  • [TEIID-4547] - getQueryPlan fails in adminapi
  • [TEIID-4553] - COUNT returns inconsistent results when column statistics are not gathered
  • [TEIID-4608] - Insert statement - multi-value insert into view - incorrect type resolution if first tuple contains NULL
  • [TEIID-4661] - Subsequent queries hang after materialized view TTL expires.
  • [TEIID-4668] - Google translator skips NULL value in INSERT
  • [TEIID-4710] - Request id conflict with CommandContext connection
  • [TEIID-4727] - Aggregation is performed incorrectly for JOIN queries
  • [TEIID-4732] - Teiid Server does not honor columns name in external materialization
  • [TEIID-4737] - Incorrect work of left join statement
  • [TEIID-4776] - Issues with array type metadata
It is the final release of the 9.0.x line.  You should upgrade to 9.1 or later when feasible.  Note there will be a 9.1.4 release early next week.

Thanks,
Steve

Tuesday, February 21, 2017

Teiid Implements SQL-MED Specification

Teiid community is very excited to announce that with 9.2 release we have extended the support to define VDB completely in DDL. Previous to this version, a Virtual Database (VDB) is defined either using combination of XML/DDL format or one could have designed using Teiid Designer, which is in custom binary format (.vdb)

So, what the big deal? Well when you look at any traditional relational database, DDL is primary language to create any database and its Schema. Even though Teiid is a Data Virtualization engine, for consumers it always behaves like a relational database. Having separate concepts to define your schema really impedes the adoption and learning curve for a developer. We want to make working with Teiid, as simple as you working with any relational database. However, Teiid needs are different than a traditional databases, in that Teiid needs to interface with external systems, now how can that be represented? that is where SQL-MED specification comes to light.

What is SQL-MED?

"The SQL/MED, or Management of External Data, extension to the SQL standard is defined by ISO/IEC 9075-9:2008 (originally defined for SQL:2003). SQL/MED provides extensions to SQL that define foreign-data wrappers and datalink types to allow SQL to manage external data. External data is data that is accessible to, but not managed by, an SQL-based DBMS. This standard can be used in the development of federated database systems." -  https://en.wikipedia.org/wiki/SQL/MED

See why this is cool http://rhaas.blogspot.com/2011/01/why-sqlmed-is-cool.html

What are the Benefits?

In essence SQL-MED defines the DDL semantics to connect and communicate with external sources, where this part of the configuration in Teiid VDB was designed using proprietary methods. With the support of the SQL-MED, we have removed vendor lock-in as well as learning curve for a developer who is already familiar with SQL-MED.

Previous to this release we were mixing usage of XML and DDL text to define a VDB, now everything can be defined using DDL. Since this is all text based this could automatically generated, easily understood. Possible external tool support.

Compare to .vdb binary file, since this all text based, this can be easily used with team collaboration tools like git, cvs, svn, sharepoint etc, and can be versioned and easily see the differences between different versions your VDB.  Since, all changes to the existing schema can be defined using ALTER statements in case of changes, you keep easily keep track of new changes.

Even though a VDB is completely defined using the DDL, Teiid still requires the deployment model aka you need to deploy the VDB before you can use it. However, in a Database like MySQL, PostgreSQL, one can use a command line tool like mysql, psql or tool like TOAD, and issue DDL commands interactively to create databases, tables, views etc. Having full support of DDL paves way for this next step. 

Example VDB

Below is example VDB that talks to a PostgresSQL database, both using XML/DDL and as well as SQL-MED DDL

XML/DDL based VDB:

 <vdb name="my_example" version="1.0.0">  
   <model name="test" type="PHYSICAL">  
     <property name="importer.schemaPattern" value="public"/>  
     <property name="importer.useFullSchemaName" value="false"/>  
     <property name="importer.tableTypes" value="TABLE,VIEW"/>  
     <source name="pqsql" translator-name="postgresql" connection-jndi-name="java:/postgres-ds"/>  
   </model>  
 </vdb>  

The same VDB now defined in SQL-MED based DDL

 CREATE DATABASE "my_example" VERSION '1.0.0';  
 USE DATABASE "my_example" VERSION '1.0.0'  
 CREATE FOREIGN DATA WRAPPER postgresql;  
 CREATE SERVER pgsql TYPE 'postgresql-9.4-1201.jdbc41.jar'  
   VERSION 'one' FOREIGN DATA WRAPPER postgresql  
   OPTIONS (  
     "jndi-name" 'java:/postgres-ds'  
   );  
 CREATE SCHEMA test SERVER pgsql;  
 IMPORT FOREIGN SCHEMA public FROM SERVER pgsql INTO test  
   OPTIONS(  
     importer.useFullSchemaName false,  
     importer.tableTypes 'TABLE,VIEW'  
 );  


Both above VDBs defining a VDB that connect to a PostgreSQL database and importing metadata into a schema called "test" in a VDB called "my_example". As you can see DDL is more descriptive and easy to understand and follows the standards. As I mentioned before this also paves a way interactively design your VDB in future releases.

Two really new concepts from SQL-MED, that are "DATA WRAPPERS" which are translators, and "SERVER" which represents an external server. A SERVER provides a connection to external data source and a DATA WRAPPER is adapter between Teiid and data source. Apart from above DDL commands, Teiid also supports full range of other DDL commands to define/alter schema elements like Tables, Views, Procedures and Functions. For more explanation of all the allowed DDL statements, checkout Teiid documentation at https://teiid.gitbooks.io/documents/content/reference/vdb_guide.html

We also provide a command line tool called "teiid-convert-vdb.bat" which can convert your existing XML/DDL or .vdb based VDBs into DDL format automatically, so it easy to switch over.  For time being we are going to support both formats of VDB, but in future is more defined towards DDL based VDB.

Enjoy.

Ramesh..

Thursday, February 16, 2017

Teiid 9.2 Final Released

It's been 4 months of hard work and we're ready to sign off on the 9.2 Final release.  Feature highlights include:

  • TEIID-4284 Salesforce Bulk API for SELECT queries.
  • TEIID-4556 TEIID-4545 TEIID-4515 Phoenix/Hbase Translator now supports joins, more system functions/pushdown functions, and offset
  • TEIID-4532 Hashing Functions were added for md5, sha1, sha2-256, and sha2-512.
  • TEIID-4627 Source Triggers to handle source change events.
  • TEIID-4643 Encrypt/decrypt functions were added for 128bit AES.
  • TEIID-4622 Data Quality Functions contributed by OSDQ.
  • TEIID-4441 FTP/SFTP Connectivity via a new ftp resource adapter.
  • TEIID-4629 DDL Replacement for vdb.xml to eliminate the need to mix XML and DDL.
  • TEIID-4398 VDB Migration tool - Migration tool to convert .vdb & -vdb.xml files into DDL based VDB
In addition to reading up on the individual JIRA issues, here's a summary of where several important efforts stand.

DDL Support

The DDL option (TEIID-4629/TEIID-4398) for defining VDBs is an exciting feature set. You will no longer need to mix XML and DDL to define a VDB, it can all be done in DDL. These features are evolving though, so please bear with us if you discover issues such as syntax that needs tweaked or inconsistencies with XML metadata. Just log an issue and we'll get things addressed - a special thanks to Bram Gadeyne who has already helping catch issues.


Data Quality

Vivek Singh contributed more OSDQ Data Quality Functions. Please see the OSDQ tooling for data quality / preparation functionality that is now compatible with Teiid. Some hashing and encryption functions (TEIID-4532/TEIID-4643) were also added as regular Teiid system functions. Expect more functions to become available in subsequent releases. We'll continue to work across both communities on data quality and related efforts.


UI Work

If you haven't seen it, please also check out Data Service Builder - which is a streamlined web GUI for JDV/Teiid on OpenShift.

There will also be a Teiid Designer compatible with 9.2 out shortly - unless full UI support for some of the language features, such as source triggers, is initially targeted.


9.3

TEIID-4627 added DDL support for source table AFTER triggers - that is just part of a major thrust. Additional issues in 9.3 will allow Debezium integration to help keep materialized views synchronized with live data via change events.

We will also be adding domain support as a first step toward making the type system more flexible.

We expect that we'll hit the 3 month target for the release, so if there is anything that seems of high value to identify for the release please let us know early.

Thanks again to everyone who contributed in some way to this release,
Steve

Wednesday, February 8, 2017

Teiid 9.2 CR1 Released

We are nearing the final release of 9.2.  CR1 can be downloaded or is available from Maven.

A feature was added since Beta2:
  • TEIID-4398 VDB Migration tool - Migration tool to convert .vdb & -vdb.xml files into DDL based VDB
At over 160 issues addressed this is a pretty significant release.  We'll now work hard to close out the remaining issues and make sure the documentation is ready.  Thanks to all who have brought issues to our attention.  In particular Pedro Inácio highlighted several issues with external materialization management.

Please try out all of issues on the CR to provide feedback before the final release.  If nothing significant is found we'll be ready for a final in about a week to 10 days.

Thank you,
Steve

Wednesday, February 1, 2017

Teiid 9.1.3 Released

9.1.3 is available for download or from the Maven repository.  It address 17 important issues:
  • [TEIID-4298] - Support in Odata4 for the Partner NavigationProperty attribute
  • [TEIID-4633] - Odata $expand over Oracle tables generates bad query
  • [TEIID-4644] - anonymous block dynamic issues
  • [TEIID-4679] - PrestoDB translator - locate function - source specific function has different order of arguments
  • [TEIID-4680] - PrestoDB translator - error executing locate(string, string, int)
  • [TEIID-4681] - PrestoDB tranlator - NPE while executing CHR function with illegal argument (char)
  • [TEIID-4685] - PrestoDB translator - IFNULL is translated as NULLIF
  • [TEIID-4692] - upsert delegating override not correct
  • [TEIID-4693] - mysql "booleans" translation issues
  • [TEIID-4698] - Adding an INFO validation to a model can invalidate the vdb
  • [TEIID-4700] - Google translator inconsistent behavior for DELETE and SELECT for null values
  • [TEIID-4710] - Request id conflict with CommandContext connection
  • [TEIID-4722] - TEIID30019: java.lang.AssertionError: Assertion failed assertion due to guard against a corner condition.
  • [TEIID-4725] - ObjectTranslator SearchByKey limit handling issue
  • [TEIID-4727] - Aggregation is performed incorrectly for JOIN queries
  • [TEIID-4729] - Multisource SOURCE_NAME field pushes to source
  • [TEIID-4732] - Teiid Server does not honor columns name in external materialization
There will also be a 9.2 CR1 release next week, so please give that an early evaluation if possible.

Thanks,
Steve

Wednesday, January 25, 2017

Teiid 9.2 Beta2 Released

Teiid 9.2 Beta2 has been released. Feature highlights since Beta1:
  • TEIID-4622 Data Quality Functions contributed by OSDQ.
  • TEIID-4441 FTP/SFTP Connectivity via a new ftp resource adapter.
  • TEIID-4629 DDL Replacement for vdb.xml to eliminate the need to mix XML and DDL.
Please let us know if you discover any issues as there is still plenty of time to get the fix in before the final release.

We anticipate a CR1 release in about two weeks, followed by the final release.  Also there should be 9.1.3 next week.

Thanks,
Steve

Sunday, January 8, 2017

Teiid 9.2 Beta1 Available

Teiid 9.2 Beta1 has been released. Feature highlights since Alpha2:
  • TEIID-4627 Source Triggers to handle source change events.
  • TEIID-4643 Encrypt/decrypt functions were added for 128bit AES.
Feature Progress:
  • The DDL metadata system feature TEIID-4629 will be ready for inclusion in Beta2
We anticipate a Beta2 followed by a CR1 release before the Final.  If needed however we may delay the Final by a couple of weeks to get more feature development in.

Thanks,
Steve

Thursday, January 5, 2017

Teiid 9.1.2 Released

Happy New Years to everyone. The next fix release on the 9.1.x line is now available. It addresses 21 issues:
  • [TEIID-4551] - Improve exception handling in Admin methods
  • [TEIID-4663] - Support a more secure block mode for client/server encryption
  • [TEIID-4553] - COUNT returns inconsistent results when column statistics are not gathered
  • [TEIID-4566] - Ordered limit against preserved view fails
  • [TEIID-4573] - Modeshape query
  • [TEIID-4580] - ST_PointOnSurface returns point on the boundary of the polygon
  • [TEIID-4584] - SimpleDB doesn' work
  • [TEIID-4589] - Teiid throws NPE if multi-value insert is issued on global temporary table
  • [TEIID-4595] - Wrong pushdown of several spatial functions to Oracle
  • [TEIID-4598] - NPE when analytic Source function for Greenplum doesn't get pushdown
  • [TEIID-4605] - SqlServer translator - insert/update statements - timestamp is cast to datetime
  • [TEIID-4608] - Insert statement - multi-value insert into view - incorrect type resolution if first tuple contains NULL
  • [TEIID-4631] - IN clause causes an error when used within a function in SELECT clause
  • [TEIID-4637] - join of aliased views with partitioned unions not handled correctly.
  • [TEIID-4648] - MySQL unsigned type detection is incorrect
  • [TEIID-4649] - SybaseIQ translator: different order of arguments in CONVERT function
  • [TEIID-4650] - SybaseIQ translator: week function can't be pushed directly
  • [TEIID-4651] - SybaseIQ translator: different order of arguments in LOCATE function
  • [TEIID-4661] - Subsequent queries hang after materialized view TTL expires.
  • [TEIID-4668] - Google translator skips NULL value in INSERT
  • [TEIID-4673] - Translator import of google spreadsheet not updatable

If needed a 9.0.6 will be made available prior to the release of 9.2 Final.  9.2 Beta1 will be available tomorrow.

Thanks,
Steve